tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) worker1 # Formatting '/build/vm-state-worker1/tmp.pd4NHiGRbo', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: d80a9e16-2163-42f9-9de3-690e024b8368 worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # client # Disk image does not exist, creating the virtualisation disk image... worker1 # Allocating group tables: 0/8 done client # Formatting '/build/vm-state-client/tmp.0e8aPH9Rm0', fmt=raw size=1073741824 client: QEMU running (pid 49) worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done client # mke2fs 1.47.4 (6-Mar-2025) lb: QEMU running (pid 50) lb # Disk image does not exist, creating the virtualisation disk image... worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Formatting '/build/vm-state-lb/tmp.N6jPdFWUqn', fmt=raw size=1073741824 client # Discarding device blocks: 0/262144 done worker2 # Disk image does not exist, creating the virtualisation disk image... lb # mke2fs 1.47.4 (6-Mar-2025) client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Formatting '/build/vm-state-worker2/tmp.3EPTp2HsE8', fmt=raw size=1073741824 lb # Discarding device blocks: 0/262144 done client # Filesystem UUID: 759ca026-cf93-4c44-bd04-aab8640abc48 worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # Superblock backups stored on blocks: worker2 # Discarding device blocks: 0/262144 done lb # Filesystem UUID: 949b70ce-620c-474d-8417-b0beaf0e3485 client # 32768, 98304, 163840, 229376 worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Superblock backups stored on blocks: client # worker2 # Filesystem UUID: 239e6c9e-df98-4cbb-a903-433ce793521c lb # 32768, 98304, 163840, 229376 client # Allocating group tables: 0/8 done worker2 # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 lb # worker2: QEMU running (pid 52) worker1 # lb # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done lb # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done worker1 # Virtualisation disk image created. lb # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Starting virtiofs daemons... lb # Writing superblocks and filesystem accounting information: 0/8 done client # worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # client # Virtualisation disk image created. worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # Virtualisation disk image created. client # Starting virtiofs daemons... worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Starting virtiofs daemons... client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests (finished: start all VMs, in 0.23 seconds) worker2 # lb # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests client: waiting for unit network-addresses-eth1.service worker2 # Allocating group tables: 0/8 done lb # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests client: waiting for the VM to finish booting worker2 # Writing inode tables: 0/8 done lb # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests worker2 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. worker2 # Starting virtiofs daemons... worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # worker2 # lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # client # Booting from ROM... worker1 # Booting from ROM... lb # Booting from ROM... worker2 # Booting from ROM... client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test/init regInfo=/nix/store/s9k7mpd3day04qzf19r71x8dq0q2ycs2-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dyab6c8i372v5waficb63zp79vnsaxrg-nixos-system-worker1-test/init regInfo=/nix/store/a01b4wkhhfw171hhg3lf8p5ygrq1fswf-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gvbzy0g4j2sf3am2wkwfga8lrrdci67y-nixos-system-worker2-test/init regInfo=/nix/store/788l1h41glyfk32if77z9ksf8qk2j16n-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] kvm-clock: using sched offset of 445158384 cycles lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] kvm-clock: using sched offset of 464652817 cycles worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.002761] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002773] Using GB pages for direct mapping lb # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002932] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker1 # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] SMBIOS 2.8 present. client # [ 0.002940] ACPI: Early table checksum verification disabled worker1 # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.002943] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.002947] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.002733] Using GB pages for direct mapping lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.002951] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002839] RAMDISK: [mem 0x5e370000-0x5ffcffff] lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.002847] ACPI: Early table checksum verification disabled client # [ 0.002957] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] kvm-clock: using sched offset of 450500607 cycles worker1 # [ 0.002850] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.002959] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.002961] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.002854] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000004] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] Hypervisor detected: KVM client # [ 0.002963] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002858] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000803] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002964] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002866] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000001] kvm-clock: using sched offset of 451213154 cycles worker1 # [ 0.002868] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002966] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.002869] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.002967] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.002746] Using GB pages for direct mapping worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.002887] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker1 # [ 0.002871] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002968] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002894] ACPI: Early table checksum verification disabled client # [ 0.002969] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002872] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.002897] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.002969] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.002874] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.002901] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002970] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002723] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.002875] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002734] Using GB pages for direct mapping lb # [ 0.002905] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002970] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.002876] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002838] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.002971] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.002912] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002848] ACPI: Early table checksum verification disabled worker1 # [ 0.002877] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.003195] No NUMA configuration found lb # [ 0.002914] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.002851] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002877] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.003196] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.002915] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002878] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.003198] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.002855] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005465] Zone ranges: lb # [ 0.002917] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002878] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.005465] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002863] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002879] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.002918] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005467] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.005468] Normal empty worker2 # [ 0.002869] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003109] No NUMA configuration found client # [ 0.005469] Device empty worker2 # [ 0.002871] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.002920] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005470] Movable zone start for each node worker1 # [ 0.003111] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.005470] Early memory node ranges lb # [ 0.002921] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002873] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003113] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005404] Zone ranges: client # [ 0.005471] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.002922] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002874] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005404] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.005472] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.002923] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.005406] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.002876] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005407] Normal empty client # [ 0.005473] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.002923] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.005408] Device empty client # [ 0.005492] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.005408] Movable zone start for each node worker2 # [ 0.002877] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002924] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.005409] Early memory node ranges client # [ 0.005757] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002879] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.002924] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.005409] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.032777] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.033232] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.002880] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.002925] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.005410] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.003144] No NUMA configuration found client # [ 0.033242] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.002880] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.005411] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.033269] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.003145] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.005435] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.002881] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.003147] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.033271] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.005699] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002881] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.005886] Zone ranges: client # [ 0.033273] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.005887] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.031996] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.002882] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.032453] ACPI: PM-Timer IO Port: 0x608 client # [ 0.033274] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.005888] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.002882] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.005889] Normal empty worker1 # [ 0.032465] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.033275] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.005890] Device empty worker2 # [ 0.003108] No NUMA configuration found worker1 # [ 0.032492] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.005890] Movable zone start for each node client # [ 0.033276] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.003109] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.005891] Early memory node ranges worker1 # [ 0.032495] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.003111] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.033278] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.005892] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.005393] Zone ranges: worker1 # [ 0.032496] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.033279] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.005893] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.005395] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.033282] TSC deadline timer available worker1 # [ 0.032497] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.033286] CPU topo: Max. logical packages: 1 lb # [ 0.005894] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.005396] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.032498] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.033287] CPU topo: Max. logical dies: 1 worker2 # [ 0.005397] Normal empty lb # [ 0.005913] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.005398] Device empty client # [ 0.033288] CPU topo: Max. dies per package: 1 worker1 # [ 0.032499] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.005399] Movable zone start for each node lb # [ 0.006187] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.033291] CPU topo: Max. threads per core: 1 worker2 # [ 0.005400] Early memory node ranges worker1 # [ 0.032501] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.033366] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.033291] CPU topo: Num. cores per package: 1 worker2 # [ 0.005400] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.033818] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.032502] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.033292] CPU topo: Num. threads per package: 1 worker1 # [ 0.032505] TSC deadline timer available worker2 # [ 0.005401] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.033846] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.033292] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.032509] CPU topo: Max. logical packages: 1 worker2 # [ 0.005402] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.033871] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.032510] CPU topo: Max. logical dies: 1 client # [ 0.033310] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.005423] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.032510] CPU topo: Max. dies per package: 1 lb # [ 0.033874] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.033339] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.032513] CPU topo: Max. threads per core: 1 worker2 # [ 0.005685] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.033876] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.032514] CPU topo: Num. cores per package: 1 client # [ 0.033341] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.032014] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.033877] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.032514] CPU topo: Num. threads per package: 1 worker2 # [ 0.032469] ACPI: PM-Timer IO Port: 0x608 client # [ 0.033342] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.033878] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.032515] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.033344] Booting paravirtualized kernel on KVM worker2 # [ 0.032480] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.033879] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.032533] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.032508] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.033347] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.033881] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.032510] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.032561] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.033882] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.037821] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.032512] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.033885] TSC deadline timer available worker1 # [ 0.032563] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.040021] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.033889] CPU topo: Max. logical packages: 1 worker2 # [ 0.032513] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.032564] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.040064] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.033890] CPU topo: Max. logical dies: 1 worker1 # [ 0.032565] Booting paravirtualized kernel on KVM worker2 # [ 0.032514] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.033890] CPU topo: Max. dies per package: 1 lb # [ 0.033894] CPU topo: Max. threads per core: 1 worker2 # [ 0.032515] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.032568] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.033894] CPU topo: Num. cores per package: 1 worker2 # [ 0.032518] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.033895] CPU topo: Num. threads per package: 1 worker1 # [ 0.037040] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.032519] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.033895] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.032522] TSC deadline timer available worker1 # [ 0.039188] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.032526] CPU topo: Max. logical packages: 1 client # [ 0.040065] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test/init regInfo=/nix/store/s9k7mpd3day04qzf19r71x8dq0q2ycs2-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.033912] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.039234] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.032527] CPU topo: Max. logical dies: 1 lb # [ 0.033942] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.032527] CPU topo: Max. dies per package: 1 worker2 # [ 0.032531] CPU topo: Max. threads per core: 1 client # [ 0.040156] Unknown kernel command line parameters "regInfo=/nix/store/s9k7mpd3day04qzf19r71x8dq0q2ycs2-closure-info/registration", will be passed to user space. lb # [ 0.033944] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.040169] random: crng init done worker2 # [ 0.032531] CPU topo: Num. cores per package: 1 lb # [ 0.033945] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.032532] CPU topo: Num. threads per package: 1 client # [ 0.040169] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.033947] Booting paravirtualized kernel on KVM worker2 # [ 0.032532] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.042534] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.039236] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dyab6c8i372v5waficb63zp79vnsaxrg-nixos-system-worker1-test/init regInfo=/nix/store/a01b4wkhhfw171hhg3lf8p5ygrq1fswf-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.033954] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.032551] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.043638] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.032584] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.043670] Fallback order for Node 0: 0 lb # [ 0.038432] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.039330] Unknown kernel command line parameters "regInfo=/nix/store/a01b4wkhhfw171hhg3lf8p5ygrq1fswf-closure-info/registration", will be passed to user space. worker1 # [ 0.039343] random: crng init done lb # [ 0.040530] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.032585] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.043673] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.043674] Policy zone: DMA32 lb # [ 0.040573] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.032587] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.039343] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.046267] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.032588] Booting paravirtualized kernel on KVM worker1 # [ 0.041477] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.049312] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.052495] allocated 3145728 bytes of page_ext worker2 # [ 0.032591] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.042721] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.062173] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.042753] Fallback order for Node 0: 0 worker2 # [ 0.037060] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.062176] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.042757] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.063217] Dynamic Preempt: lazy lb # [ 0.040574] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.042758] Policy zone: DMA32 worker2 # [ 0.039217] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.063342] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.039264] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.045231] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.063343] rcu: RCU event tracing is enabled. lb # [ 0.040664] Unknown kernel command line parameters "regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration", will be passed to user space. worker1 # [ 0.048313] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.063343] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.040677] random: crng init done worker1 # [ 0.051663] allocated 3145728 bytes of page_ext client # [ 0.063345] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.061468] ftrace: allocating 48787 entries in 192 pages lb # [ 0.040679] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.063345] Rude variant of Tasks RCU enabled. worker1 # [ 0.061471] ftrace: allocated 192 pages with 2 groups client # [ 0.063346] Tracing variant of Tasks RCU enabled. worker1 # [ 0.062317] Dynamic Preempt: lazy lb # [ 0.042748] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.039266] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gvbzy0g4j2sf3am2wkwfga8lrrdci67y-nixos-system-worker2-test/init regInfo=/nix/store/788l1h41glyfk32if77z9ksf8qk2j16n-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.063346] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.062437] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.043778] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.062437] rcu: RCU event tracing is enabled. lb # [ 0.043808] Fallback order for Node 0: 0 client # [ 0.063347] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.062438] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.043811] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.039360] Unknown kernel command line parameters "regInfo=/nix/store/788l1h41glyfk32if77z9ksf8qk2j16n-closure-info/registration", will be passed to user space. client # [ 0.063362] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.043812] Policy zone: DMA32 worker1 # [ 0.062440] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.039372] random: crng init done worker1 # [ 0.062440] Rude variant of Tasks RCU enabled. lb # [ 0.046411] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.063363] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.039373] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.062441] Tracing variant of Tasks RCU enabled. lb # [ 0.049505] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.041672] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.063364] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.052725] allocated 3145728 bytes of page_ext worker1 # [ 0.062441] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.062475] ftrace: allocating 48787 entries in 192 pages client # [ 0.067781] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.042722] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.062442] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.042754] Fallback order for Node 0: 0 lb # [ 0.062477] ftrace: allocated 192 pages with 2 groups client # [ 0.068047] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.063291] Dynamic Preempt: lazy worker1 # [ 0.062496] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.042757] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.063428] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.042758] Policy zone: DMA32 client # [ 0.068053] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.063428] rcu: RCU event tracing is enabled. worker1 # [ 0.062497] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.045233] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.063429] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.068148] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.048356] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.062498] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.063430] Trampoline variant of Tasks RCU enabled. client # [ 0.071682] Console: colour VGA+ 80x25 worker2 # [ 0.051630] allocated 3145728 bytes of page_ext worker1 # [ 0.067099] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.071686] printk: legacy console [tty0] enabled lb # [ 0.063431] Rude variant of Tasks RCU enabled. worker2 # [ 0.061466] ftrace: allocating 48787 entries in 192 pages lb # [ 0.063431] Tracing variant of Tasks RCU enabled. client # [ 0.101117] printk: legacy console [ttyS0] enabled worker1 # [ 0.067379] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.061469] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.062508] Dynamic Preempt: lazy client # [ 0.197594] ACPI: Core revision 20250807 lb # [ 0.063432] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.067387] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.062629] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.063432] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.062630] rcu: RCU event tracing is enabled. client # [ 0.198464] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.067488] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.063485] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.062631] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.071005] Console: colour VGA+ 80x25 client # [ 0.199935] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.062632] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.071007] printk: legacy console [tty0] enabled lb # [ 0.063487] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.200915] x2apic enabled worker2 # [ 0.062633] Rude variant of Tasks RCU enabled. worker1 # [ 0.100758] printk: legacy console [ttyS0] enabled worker2 # [ 0.062633] Tracing variant of Tasks RCU enabled. lb # [ 0.063488] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.197424] ACPI: Core revision 20250807 client # [ 0.201694] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.062634] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.067826] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.062634] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.068100] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.198267] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.203501] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.062687] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.199773] APIC: Switch to symmetric I/O mode setup lb # [ 0.068106] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.200729] x2apic enabled worker2 # [ 0.062689] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.068203] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.204465] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.071714] Console: colour VGA+ 80x25 worker1 # [ 0.201505] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.062690] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.071717] printk: legacy console [tty0] enabled client # [ 0.206099] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.067097] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.101170] printk: legacy console [ttyS0] enabled worker2 # [ 0.067384] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.196377] ACPI: Core revision 20250807 worker1 # [ 0.203371] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.207184] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.067391] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.208218] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.197210] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.204348] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.209097] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.067494] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.198704] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.071025] Console: colour VGA+ 80x25 worker1 # [ 0.205975] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.199687] x2apic enabled worker2 # [ 0.071029] printk: legacy console [tty0] enabled worker2 # [ 0.100666] printk: legacy console [ttyS0] enabled client # [ 0.210100] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.207062] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.200456] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.197015] ACPI: Core revision 20250807 client # [ 0.212097] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.208105] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.213097] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.197905] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.209732] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.202247] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.214096] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.199420] APIC: Switch to symmetric I/O mode setup lb # [ 0.203263] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.200430] x2apic enabled worker1 # [ 0.210721] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.215097] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.201215] APIC: Switched APIC routing to: physical x2apic lb # [ 0.204930] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.211972] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.212972] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.206015] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.203074] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.214723] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.207075] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.216096] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.215653] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.208603] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.204074] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.218104] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.205744] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.209671] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.218866] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.220097] active return thunk: srso_alias_return_thunk worker2 # [ 0.206829] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.210927] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.215972] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.208687] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.211927] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.221119] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.217979] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.209429] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.222097] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.213621] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.218973] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.223811] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.213927] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.210488] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.219973] active return thunk: srso_alias_return_thunk client # [ 0.224097] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.225097] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.211741] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.221629] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.212742] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.226096] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.221972] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.214466] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.214927] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.223694] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.227096] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.216934] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.215420] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.224700] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.228983] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.225704] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.217928] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.229805] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.218927] active return thunk: srso_alias_return_thunk client # [ 0.230805] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.226698] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.231825] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.219949] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.226972] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.216469] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.232812] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.220927] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.228972] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.217749] Spectre V2 : Enabling IBPB for BPF lb # [ 0.222648] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.229972] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.233096] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.218742] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.222927] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.230882] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.219741] active return thunk: srso_alias_return_thunk lb # [ 0.223927] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.231680] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.221400] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.224927] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.232693] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.222649] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.225927] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.233694] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.223481] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.227836] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.224504] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.228681] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.225533] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.229696] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.226523] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.230699] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.231685] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.227566] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.228741] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.232687] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.229740] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.230741] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.231741] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.232741] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.233741] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.268101] Freeing SMP alternatives memory: 44K client # [ 0.268918] pid_max: default: 32768 minimum: 301 client # [ 0.269775] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.270206] landlock: Up and running. client # [ 0.271572] Yama: becoming mindful. worker1 # [ 0.267928] Freeing SMP alternatives memory: 44K client # [ 0.272315] LSM support for eBPF active worker1 # [ 0.268554] pid_max: default: 32768 minimum: 301 client # [ 0.273212] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.269625] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.270068] landlock: Up and running. client # [ 0.274133] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.270973] Yama: becoming mindful. worker1 # [ 0.272192] LSM support for eBPF active client # [ 0.276745] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.273111] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.266932] Freeing SMP alternatives memory: 44K lb # [ 0.267725] pid_max: default: 32768 minimum: 301 client # [ 0.277609] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.274012] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.278101] ... version: 2 lb # [ 0.268012] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.278824] ... bit width: 48 lb # [ 0.269036] landlock: Up and running. client # [ 0.279099] ... generic counters: 6 lb # [ 0.269928] Yama: becoming mindful. worker1 # [ 0.276722] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.279798] ... generic bitmap: 000000000000003f lb # [ 0.271099] LSM support for eBPF active client # [ 0.280144] ... fixed-purpose counters: 0 worker1 # [ 0.277483] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.271830] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.280865] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.277978] ... version: 2 worker2 # [ 0.268842] Freeing SMP alternatives memory: 44K worker1 # [ 0.278679] ... bit width: 48 client # [ 0.281100] ... value mask: 0000ffffffffffff worker2 # [ 0.269633] pid_max: default: 32768 minimum: 301 lb # [ 0.272969] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.278974] ... generic counters: 6 client # [ 0.281962] ... max period: 00007fffffffffff worker2 # [ 0.270369] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.279652] ... generic bitmap: 000000000000003f client # [ 0.282785] ... global_ctrl mask: 000000000000003f worker2 # [ 0.270837] landlock: Up and running. worker1 # [ 0.280021] ... fixed-purpose counters: 0 worker2 # [ 0.271742] Yama: becoming mindful. lb # [ 0.275238] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.283210] signal: max sigframe size: 3376 worker1 # [ 0.280731] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.272927] LSM support for eBPF active client # [ 0.283987] rcu: Hierarchical SRCU implementation. worker1 # [ 0.280975] ... value mask: 0000ffffffffffff lb # [ 0.276484] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.284661] rcu: Max phase no-delay instances is 400. worker2 # [ 0.273695] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.276936] ... version: 2 worker1 # [ 0.281858] ... max period: 00007fffffffffff lb # [ 0.277654] ... bit width: 48 worker1 # [ 0.282657] ... global_ctrl mask: 000000000000003f worker2 # [ 0.274784] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.277929] ... generic counters: 6 worker1 # [ 0.283105] signal: max sigframe size: 3376 lb # [ 0.278677] ... generic bitmap: 000000000000003f worker1 # [ 0.283932] rcu: Hierarchical SRCU implementation. lb # [ 0.278929] ... fixed-purpose counters: 0 worker1 # [ 0.284541] rcu: Max phase no-delay instances is 400. worker2 # [ 0.277260] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.279643] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.289603] smp: Bringing up secondary CPUs ... lb # [ 0.279929] ... value mask: 0000ffffffffffff worker2 # [ 0.278305] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.290113] smp: Brought up 1 node, 1 CPU lb # [ 0.280821] ... max period: 00007fffffffffff worker2 # [ 0.278746] ... version: 2 client # [ 0.290762] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.281586] ... global_ctrl mask: 000000000000003f worker2 # [ 0.279459] ... bit width: 48 worker2 # [ 0.279744] ... generic counters: 6 lb # [ 0.282026] signal: max sigframe size: 3376 worker2 # [ 0.280439] ... generic bitmap: 000000000000003f lb # [ 0.282985] rcu: Hierarchical SRCU implementation. client # [ 0.291275] Memory: 1454604K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker1 # [ 0.289605] smp: Bringing up secondary CPUs ... worker2 # [ 0.280755] ... fixed-purpose counters: 0 lb # [ 0.283777] rcu: Max phase no-delay instances is 400. client # [ 0.292324] devtmpfs: initialized worker1 # [ 0.289988] smp: Brought up 1 node, 1 CPU worker2 # [ 0.281464] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.293141] x86/mm: Memory block size: 128MB worker1 # [ 0.290631] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.281743] ... value mask: 0000ffffffffffff worker2 # [ 0.282636] ... max period: 00007fffffffffff worker2 # [ 0.283443] ... global_ctrl mask: 000000000000003f client # [ 0.294941] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.291153] Memory: 1454608K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.283869] signal: max sigframe size: 3376 worker1 # [ 0.292231] devtmpfs: initialized client # [ 0.295932] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.284688] rcu: Hierarchical SRCU implementation. worker1 # [ 0.293019] x86/mm: Memory block size: 128MB lb # [ 0.289127] smp: Bringing up secondary CPUs ... client # [ 0.297188] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.285319] rcu: Max phase no-delay instances is 400. lb # [ 0.289885] smp: Brought up 1 node, 1 CPU client # [ 0.298267] PM: RTC time: 22:21:48, date: 2026-09-22 lb # [ 0.290434] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.294780] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.295933] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.291169] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) worker1 # [ 0.297063] pinctrl core: initialized pinctrl subsystem lb # [ 0.292175] devtmpfs: initialized client # [ 0.301783] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.298227] PM: RTC time: 22:21:48, date: 2026-09-22 worker2 # [ 0.290340] smp: Bringing up secondary CPUs ... lb # [ 0.293009] x86/mm: Memory block size: 128MB worker2 # [ 0.290757] smp: Brought up 1 node, 1 CPU client # [ 0.302608] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.291432] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.303123] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.294770] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.304370] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.301773] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.295859] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.291909] Memory: 1454612K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) client # [ 0.305109] audit: initializing netlink subsys (disabled) lb # [ 0.297000] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.292991] devtmpfs: initialized worker1 # [ 0.303205] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.293853] x86/mm: Memory block size: 128MB lb # [ 0.298112] PM: RTC time: 22:21:48, date: 2026-09-22 client # [ 0.306102] audit: type=2000 audit(1790115708.965:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.303998] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.307213] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.295658] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.307215] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.305253] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.308100] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.305984] audit: initializing netlink subsys (disabled) worker2 # [ 0.296612] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.301604] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.309000] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.297849] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.306976] audit: type=2000 audit(1790115708.969:1): state=initialized audit_enabled=0 res=1 client # [ 0.309823] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.302422] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.298929] PM: RTC time: 22:21:48, date: 2026-09-22 client # [ 0.310112] cpuidle: using governor menu worker1 # [ 0.308086] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.302951] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.308088] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.312291] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.308976] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.304204] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.313334] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.304939] audit: initializing netlink subsys (disabled) worker1 # [ 0.309976] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.302481] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.314102] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.310974] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.306077] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.311943] cpuidle: using governor menu client # [ 0.315111] PCI: Using configuration type 1 for base access worker2 # [ 0.303253] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.306080] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.306931] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.303768] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.313530] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.316189] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.307863] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.305024] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.314211] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.308648] audit: type=2000 audit(1790115708.977:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.305753] audit: initializing netlink subsys (disabled) worker1 # [ 0.314977] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.309932] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.306894] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.315987] PCI: Using configuration type 1 for base access lb # [ 0.309958] cpuidle: using governor menu worker2 # [ 0.306897] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.317091] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.312099] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.307745] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.308711] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.313206] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.323113] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.309479] audit: type=2000 audit(1790115708.982:1): state=initialized audit_enabled=0 res=1 lb # [ 0.313933] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.324100] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.310746] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.314942] PCI: Using configuration type 1 for base access worker2 # [ 0.310760] cpuidle: using governor menu lb # [ 0.316028] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.312996] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.323989] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.313995] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.329100] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.324975] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.314746] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.330100] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.315757] PCI: Using configuration type 1 for base access lb # [ 0.321169] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.316899] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.321931] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.329976] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.330975] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.321986] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.326931] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.322744] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.327929] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.341351] ACPI: Added _OSI(Module Device) client # [ 0.342101] ACPI: Added _OSI(Processor Device) client # [ 0.342890] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.327744] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.328743] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.341318] ACPI: Added _OSI(Module Device) worker1 # [ 0.341977] ACPI: Added _OSI(Processor Device) worker1 # [ 0.342744] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.338273] ACPI: Added _OSI(Module Device) client # [ 0.349631] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.338931] ACPI: Added _OSI(Processor Device) lb # [ 0.339654] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.353510] ACPI: Interpreter enabled client # [ 0.354114] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.339177] ACPI: Added _OSI(Module Device) client # [ 0.354835] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.339746] ACPI: Added _OSI(Processor Device) worker1 # [ 0.350538] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.340442] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.345815] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.357145] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.354346] ACPI: Interpreter enabled client # [ 0.358100] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.354990] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.355728] ACPI: Using IOAPIC for interrupt routing client # [ 0.361237] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.356053] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.352366] ACPI: Interpreter enabled worker1 # [ 0.356975] PCI: Using E820 reservations for host bridge windows lb # [ 0.352945] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.348091] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.353665] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.360127] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.353981] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.354930] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.352150] ACPI: Interpreter enabled worker2 # [ 0.352760] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.368107] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.353471] ACPI: Using IOAPIC for interrupt routing lb # [ 0.358067] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.369104] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.370190] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.371225] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.355809] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.356753] PCI: Using E820 reservations for host bridge windows client # [ 0.372470] PCI host bridge to bus 0000:00 worker1 # [ 0.368446] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.373104] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.368983] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.374099] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.359866] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.370054] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.375099] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.376099] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.371097] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.366762] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.372338] PCI host bridge to bus 0000:00 client # [ 0.377099] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.367700] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.372978] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.378100] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.373975] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.379100] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.369504] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.374974] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.380048] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.370052] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.375974] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.371261] PCI host bridge to bus 0000:00 client # [ 0.381531] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.367880] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.371935] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.376975] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.368750] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.372930] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.377975] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.378975] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.373930] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.369823] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.374929] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.370867] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.379883] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.372083] PCI host bridge to bus 0000:00 lb # [ 0.375930] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.381407] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.372747] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.376934] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.373744] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.377957] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.374744] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.379004] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.384228] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.375744] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.385112] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.380364] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.376744] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.386191] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.377744] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.387606] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.378744] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.384041] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.379766] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.384987] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.388818] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.385959] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.381197] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.386999] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.391137] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.391991] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.383017] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.392910] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.388927] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.383942] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.393932] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.384870] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.392013] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.395768] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.386104] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.392881] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.383861] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.393768] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.387659] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.384826] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.397148] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.394821] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.385762] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.398005] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.398852] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.390971] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.387093] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.396262] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.391815] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.399650] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.392704] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.388522] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.399011] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.393793] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.399883] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.390783] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.400779] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.395763] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.391592] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.402903] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.403765] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.392459] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.402498] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.392750] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.404121] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.397937] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.398780] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.405690] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.394287] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.399680] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.404984] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.407107] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.401320] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.395782] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.406643] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.407959] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.396611] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.406997] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.408819] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.397503] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.409105] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.408527] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.399193] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.403938] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.411188] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.405591] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.410012] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.405952] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.410919] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.412972] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.411684] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.413869] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.401781] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.407502] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.402750] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.411980] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.415515] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.403765] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.408966] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.413574] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.409783] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.417145] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.405317] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.410685] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.418104] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.414988] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.406751] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.410935] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.415960] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.407616] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.420111] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.412481] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.408472] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.417431] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.421899] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.408749] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.413942] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.422845] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.419017] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.414929] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.410822] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.423673] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.419996] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.416523] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.412617] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.425112] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.421545] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.413480] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.426071] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.417942] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.422987] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.414331] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.418906] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.423942] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.428014] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.415768] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.420517] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.425402] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.416732] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.430148] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.431106] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.421942] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.427018] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.432073] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.422897] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.418625] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.427997] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.420550] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.433469] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.424291] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.421450] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.429555] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.425952] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.422284] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.435116] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.431020] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.426914] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.436106] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.431905] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.423750] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.437060] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.428459] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.432727] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.424766] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.438499] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.433519] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.429976] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.439647] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.426755] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.430813] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.440308] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.431693] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.428798] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.436013] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.441766] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.429686] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.432463] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.436896] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.430474] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.437714] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.442315] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.431295] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.443642] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.438567] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.433946] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.435563] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.439639] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.435952] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.432775] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.440210] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.433750] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.437519] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.434728] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.441607] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.438669] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.436156] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.442193] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.439135] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.437283] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.443637] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.440537] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.437941] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.439271] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.441120] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.444347] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.442612] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.439949] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.446680] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.441771] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.447332] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.448390] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.449380] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.451041] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.444229] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.451748] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.446641] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.452414] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.447220] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.453661] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.443163] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.448269] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.445567] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.442904] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.449222] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.446236] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.445260] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.457175] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.451004] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.447225] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.446037] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.458232] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.451839] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.459197] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.448182] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.447029] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.453067] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.460196] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.448008] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.461207] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.449968] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.454646] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.450797] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.462204] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.449806] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.463200] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.451975] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.450717] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.464197] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.465137] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.453628] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.451806] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.466100] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.458515] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.453351] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.467065] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.459093] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.467999] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.460078] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.468865] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.461073] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.456925] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.469112] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.462070] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.458032] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.456788] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.470082] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.463070] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.459029] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.470938] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.457863] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.464074] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.460026] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.458846] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.465070] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.461029] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.472816] iommu: Default domain type: Translated worker2 # [ 0.459841] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.462029] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.466011] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.473108] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.460839] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.463028] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.466992] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.474295] ACPI: bus type USB registered worker2 # [ 0.461843] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.467986] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.475007] usbcore: registered new interface driver usbfs lb # [ 0.464043] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.462841] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.475731] usbcore: registered new interface driver hub worker1 # [ 0.468907] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.464966] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.476108] usbcore: registered new device driver usb worker2 # [ 0.463841] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.469672] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.465888] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.464781] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.469986] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.477753] NetLabel: Initializing lb # [ 0.466629] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.465732] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.478100] NetLabel: domain hash size = 128 worker1 # [ 0.470965] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.466943] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.466452] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.478788] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.471674] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.467916] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.479137] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.466758] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.468646] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.480041] PCI: Using ACPI for IRQ routing worker1 # [ 0.473042] iommu: Default domain type: Translated worker2 # [ 0.467757] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.468958] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.473850] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.468723] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.469903] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.474997] ACPI: bus type USB registered worker2 # [ 0.469458] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.475777] usbcore: registered new interface driver usbfs worker2 # [ 0.469756] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.471677] iommu: Default domain type: Translated worker1 # [ 0.476692] usbcore: registered new interface driver hub lb # [ 0.471942] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.476983] usbcore: registered new device driver usb worker2 # [ 0.471809] iommu: Default domain type: Translated lb # [ 0.473165] ACPI: bus type USB registered worker2 # [ 0.472600] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.473919] usbcore: registered new interface driver usbfs worker1 # [ 0.478699] NetLabel: Initializing lb # [ 0.474610] usbcore: registered new interface driver hub worker2 # [ 0.473807] ACPI: bus type USB registered worker1 # [ 0.478981] NetLabel: domain hash size = 128 lb # [ 0.474949] usbcore: registered new device driver usb worker1 # [ 0.479703] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.474575] usbcore: registered new interface driver usbfs worker2 # [ 0.475427] usbcore: registered new interface driver hub worker1 # [ 0.480012] NetLabel: unlabeled traffic allowed by default lb # [ 0.476588] NetLabel: Initializing worker1 # [ 0.480966] PCI: Using ACPI for IRQ routing worker2 # [ 0.475753] usbcore: registered new device driver usb lb # [ 0.476936] NetLabel: domain hash size = 128 lb # [ 0.477665] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.477454] NetLabel: Initializing lb # [ 0.477968] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.477750] NetLabel: domain hash size = 128 lb # [ 0.478929] PCI: Using ACPI for IRQ routing worker2 # [ 0.478509] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.478782] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.479755] PCI: Using ACPI for IRQ routing client # [ 0.523962] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.524095] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.524095] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.524105] vgaarb: loaded client # [ 0.524864] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.525100] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.524918] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.524971] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.524971] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.522493] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.532187] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.524980] vgaarb: loaded lb # [ 0.522926] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.525741] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.533818] VFS: Disk quotas dquot_6.6.0 lb # [ 0.522926] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.525975] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.522934] vgaarb: loaded worker2 # [ 0.524232] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.523655] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.524740] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.536259] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.523932] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.524740] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.537573] pnp: PnP ACPI init worker2 # [ 0.524749] vgaarb: loaded worker1 # [ 0.529061] clocksource: Switched to clocksource kvm-clock client # [ 0.538414] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.525489] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.525745] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.539372] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.540913] pnp: PnP ACPI: found 5 devices lb # [ 0.528010] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.532629] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.533357] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.529701] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.534749] pnp: PnP ACPI init worker1 # [ 0.535569] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.530828] clocksource: Switched to clocksource kvm-clock lb # [ 0.532292] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.536578] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.533606] pnp: PnP ACPI init worker1 # [ 0.538128] pnp: PnP ACPI: found 5 devices lb # [ 0.534418] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.534301] VFS: Disk quotas dquot_6.6.0 client # [ 0.548519] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.535386] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.549946] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.535015] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.536862] pnp: PnP ACPI: found 5 devices client # [ 0.550914] NET: Registered PF_INET protocol family worker2 # [ 0.536398] pnp: PnP ACPI init worker2 # [ 0.537219] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.552124] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.538236] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.539845] pnp: PnP ACPI: found 5 devices worker1 # [ 0.546049] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.547525] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.548575] NET: Registered PF_INET protocol family lb # [ 0.544426] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.545866] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.549794] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.546793] NET: Registered PF_INET protocol family lb # [ 0.548021] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.547457] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.548905] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.549938] NET: Registered PF_INET protocol family worker2 # [ 0.551177] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.568758] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.570360] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.571700] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.573090] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.574357] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.575508] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.566338] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.576774] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.567889] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.577870] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.564605] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.569194] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.579092] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.580013] NET: Registered PF_XDP protocol family lb # [ 0.566124] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.570523] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.580832] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.571777] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.567416] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.581821] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.572886] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.568722] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.567678] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.582834] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.569917] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.574139] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.583873] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.569181] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.575160] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.570970] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.584932] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.570512] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.576322] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.572146] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.585986] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.577218] NET: Registered PF_XDP protocol family worker2 # [ 0.571801] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.573177] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.587631] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.578048] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.574335] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.573012] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.579033] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.575261] NET: Registered PF_XDP protocol family worker2 # [ 0.574099] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.580037] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.589773] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.576070] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.575384] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.581112] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.577012] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.576459] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.582211] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.578033] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.592025] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.577656] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.583242] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.579054] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.578602] NET: Registered PF_XDP protocol family lb # [ 0.580110] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.593996] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.584891] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.579436] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.581156] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.580431] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.595694] PCI: CLS 0 bytes, default 64 lb # [ 0.582877] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.581444] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.587097] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.596596] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.582534] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.598289] Trying to unpack rootfs image as initramfs... lb # [ 0.585047] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.583613] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.589448] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.584661] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.591442] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.587297] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.586460] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.593109] PCI: CLS 0 bytes, default 64 lb # [ 0.589297] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.588804] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.594029] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.591037] PCI: CLS 0 bytes, default 64 worker1 # [ 0.595801] Trying to unpack rootfs image as initramfs... worker2 # [ 0.591079] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.591992] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.593737] Trying to unpack rootfs image as initramfs... worker2 # [ 0.593010] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.594782] PCI: CLS 0 bytes, default 64 worker2 # [ 0.595707] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.597487] Trying to unpack rootfs image as initramfs... client # [ 0.644087] Initialise system trusted keyrings client # [ 0.645090] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.639641] Initialise system trusted keyrings lb # [ 0.638233] Initialise system trusted keyrings worker1 # [ 0.642657] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.639202] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.642218] Initialise system trusted keyrings worker2 # [ 0.644431] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.668121] Key type asymmetric registered client # [ 0.668864] Asymmetric key parser 'x509' registered client # [ 0.669762] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.664252] Key type asymmetric registered client # [ 0.675173] io scheduler mq-deadline registered client # [ 0.675951] io scheduler kyber registered worker1 # [ 0.666622] Asymmetric key parser 'x509' registered lb # [ 0.662958] Key type asymmetric registered lb # [ 0.663685] Asymmetric key parser 'x509' registered worker1 # [ 0.667460] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.664534] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.678613] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.670718] io scheduler mq-deadline registered client # [ 0.679847] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.671479] io scheduler kyber registered worker2 # [ 0.666654] Key type asymmetric registered lb # [ 0.667985] io scheduler mq-deadline registered lb # [ 0.668730] io scheduler kyber registered worker1 # [ 0.674214] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.669382] Asymmetric key parser 'x509' registered client # [ 0.685213] Linux agpgart interface v0.103 worker1 # [ 0.675522] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.670274] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.685949] ACPI: bus type drm_connector registered lb # [ 0.672441] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.673736] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.673523] io scheduler mq-deadline registered worker2 # [ 0.674300] io scheduler kyber registered client # [ 0.689205] usbcore: registered new interface driver usbserial_generic client # [ 0.690283] usbserial: USB Serial support registered for generic worker1 # [ 0.681214] Linux agpgart interface v0.103 lb # [ 0.677608] Linux agpgart interface v0.103 worker1 # [ 0.681990] ACPI: bus type drm_connector registered lb # [ 0.678395] ACPI: bus type drm_connector registered worker2 # [ 0.677968] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.693084] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.679307] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.693084] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.685094] usbcore: registered new interface driver usbserial_generic lb # [ 0.681280] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.686165] usbserial: USB Serial support registered for generic client # [ 0.695358] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.682343] usbserial: USB Serial support registered for generic worker2 # [ 0.683176] Linux agpgart interface v0.103 client # [ 0.698200] drop_monitor: Initializing network drop monitor service worker1 # [ 0.688626] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.683941] ACPI: bus type drm_connector registered lb # [ 0.684855] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.688626] Please enable it if your BIOS has the CPPC option. client # [ 0.699335] NET: Registered PF_INET6 protocol family lb # [ 0.684855] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.690816] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.686951] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.688499] usbcore: registered new interface driver usbserial_generic client # [ 0.704371] Segment Routing with IPv6 worker1 # [ 0.694738] drop_monitor: Initializing network drop monitor service worker2 # [ 0.689605] usbserial: USB Serial support registered for generic client # [ 0.705069] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.695896] NET: Registered PF_INET6 protocol family lb # [ 0.691981] drop_monitor: Initializing network drop monitor service lb # [ 0.693105] NET: Registered PF_INET6 protocol family client # [ 0.707350] IPI shorthand broadcast: enabled worker2 # [ 0.692388] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.699082] Segment Routing with IPv6 worker2 # [ 0.692388] Please enable it if your BIOS has the CPPC option. lb # [ 0.696285] Segment Routing with IPv6 worker2 # [ 0.694660] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.701646] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.702768] IPI shorthand broadcast: enabled lb # [ 0.698865] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.697579] drop_monitor: Initializing network drop monitor service lb # [ 0.699927] IPI shorthand broadcast: enabled worker2 # [ 0.698721] NET: Registered PF_INET6 protocol family client # [ 0.715539] sched_clock: Marking stable (581015462, 134042979)->(785350403, -70291962) worker2 # [ 0.703678] Segment Routing with IPv6 worker2 # [ 0.704394] In-situ OAM (IOAM) with IPv6 client # [ 0.719165] registered taskstats version 1 client # [ 0.720150] Loading compiled-in X.509 certificates worker1 # [ 0.711154] sched_clock: Marking stable (576016011, 134584557)->(786036469, -75435901) worker2 # [ 0.706662] IPI shorthand broadcast: enabled lb # [ 0.708108] sched_clock: Marking stable (575013908, 132820176)->(780346398, -72512314) lb # [ 0.712064] registered taskstats version 1 worker1 # [ 0.716810] registered taskstats version 1 lb # [ 0.713024] Loading compiled-in X.509 certificates worker1 # [ 0.717828] Loading compiled-in X.509 certificates worker2 # [ 0.714875] sched_clock: Marking stable (581015187, 133349288)->(784098629, -69734154) worker2 # [ 0.720523] registered taskstats version 1 worker2 # [ 0.721524] Loading compiled-in X.509 certificates client # [ 0.738076] Demotion targets for Node 0: null client # [ 0.741103] Key type .fscrypt registered client # [ 0.741816] Key type fscrypt-provisioning registered client # [ 0.742799] ima: No TPM chip found, activating TPM-bypass! client # [ 0.745074] ima: Allocated hash algorithm: sha1 lb # [ 0.731849] Demotion targets for Node 0: null client # [ 0.745895] ima: No architecture policies found worker1 # [ 0.736608] Demotion targets for Node 0: null lb # [ 0.732723] Key type .fscrypt registered worker1 # [ 0.737504] Key type .fscrypt registered worker1 # [ 0.739610] Key type fscrypt-provisioning registered lb # [ 0.735841] Key type fscrypt-provisioning registered client # [ 0.750077] PM: Magic number: 10:829:401 worker1 # [ 0.740576] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.736768] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.741497] ima: Allocated hash algorithm: sha1 lb # [ 0.737659] ima: Allocated hash algorithm: sha1 client # [ 0.751699] RAS: Correctable Errors collector initialized. lb # [ 0.738487] ima: No architecture policies found worker2 # [ 0.738028] Demotion targets for Node 0: null worker1 # [ 0.743676] ima: No architecture policies found lb # [ 0.740847] PM: Magic number: 10:829:401 worker1 # [ 0.746621] PM: Magic number: 10:829:401 worker2 # [ 0.741408] Key type .fscrypt registered lb # [ 0.742539] RAS: Correctable Errors collector initialized. worker2 # [ 0.742090] Key type fscrypt-provisioning registered worker1 # [ 0.748240] RAS: Correctable Errors collector initialized. worker2 # [ 0.743089] ima: No TPM chip found, activating TPM-bypass! client # [ 0.759762] clk: Disabling unused clocks worker2 # [ 0.745376] ima: Allocated hash algorithm: sha1 worker2 # [ 0.746201] ima: No architecture policies found client # [ 0.764077] PM: genpd: Disabling unused power domains lb # [ 0.751565] clk: Disabling unused clocks worker2 # [ 0.750388] PM: Magic number: 10:829:401 worker1 # [ 0.757273] clk: Disabling unused clocks worker2 # [ 0.752018] RAS: Correctable Errors collector initialized. lb # [ 0.754872] PM: genpd: Disabling unused power domains worker1 # [ 0.759634] PM: genpd: Disabling unused power domains worker2 # [ 0.760069] clk: Disabling unused clocks worker2 # [ 0.764378] PM: genpd: Disabling unused power domains client # [ 0.918620] Freeing initrd memory: 29056K client # [ 0.921806] Freeing unused decrypted memory: 2028K client # [ 0.924507] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.925613] Write protecting the kernel read-only data: 32768k client # [ 0.927508] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.928993] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.917936] Freeing initrd memory: 29064K worker1 # [ 0.924944] Freeing initrd memory: 29056K worker2 # [ 0.919530] Freeing initrd memory: 29060K lb # [ 0.921129] Freeing unused decrypted memory: 2028K lb # [ 0.923740] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.928153] Freeing unused decrypted memory: 2028K worker2 # [ 0.922707] Freeing unused decrypted memory: 2028K lb # [ 0.924793] Write protecting the kernel read-only data: 32768k worker2 # [ 0.925275] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.930753] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.926689] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.926408] Write protecting the kernel read-only data: 32768k worker1 # [ 0.931838] Write protecting the kernel read-only data: 32768k lb # [ 0.928161] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.933679] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.928267] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.935171] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.929792] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.979731] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.980828] Run /init as init process client # [ 0.991341] systemd[1]: Inserted module 'autofs4' lb # [ 0.978922] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.979962] Run /init as init process worker1 # [ 0.986054] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.980697] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.987110] Run /init as init process worker2 # [ 0.981754] Run /init as init process lb # [ 0.990981] systemd[1]: Inserted module 'autofs4' worker1 # [ 0.997838] systemd[1]: Inserted module 'autofs4' worker2 # [ 0.992537] systemd[1]: Inserted module 'autofs4' client # [ 1.010961] fuse: init (API version 7.45) client # [ 1.018379] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.020755] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.023549] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.010683] fuse: init (API version 7.45) client # [ 1.025682] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.012398] fuse: init (API version 7.45) worker1 # [ 1.017906] fuse: init (API version 7.45) client # [ 1.031026] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.018103] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.032610] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.020443] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.019821] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.025308] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.023249] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.022198] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.027680] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.025172] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.039096] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.025107] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.030632] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.040569] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.032521] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.027412] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.043607] virtiofs virtio7: discovered new tag: xchg lb # [ 1.029910] virtiofs virtio5: discovered new tag: nix-store client # [ 1.045079] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.031761] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.037764] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.032501] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.039287] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.034032] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.037966] virtiofs virtio6: discovered new tag: shared lb # [ 1.039413] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.040620] virtiofs virtio6: discovered new tag: shared lb # [ 1.042566] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.042234] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.047138] virtiofs virtio6: discovered new tag: shared lb # [ 1.043986] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.049922] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.046901] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.053733] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.048570] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.055263] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.064826] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.063626] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.071468] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.079701] systemd[1]: Successfully made /usr/ read-only. client # [ 1.401427] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.413410] systemd[1]: Detected virtualization kvm. client # [ 1.415508] systemd[1]: Detected architecture x86-64. client # [ 1.417593] systemd[1]: Running in initrd. client # [ 1.420039] systemd[1]: Initializing machine ID from random generator. client # [ 1.422907] systemd[1]: Hostname set to . lb # [ 1.399866] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.411717] systemd[1]: Detected virtualization kvm. lb # [ 1.413894] systemd[1]: Detected architecture x86-64. lb # [ 1.415974] systemd[1]: Running in initrd. lb # [ 1.418434] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.408075] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.421268] systemd[1]: Hostname set to . worker2 # [ 1.420076] systemd[1]: Detected virtualization kvm. worker1 # [ 1.416345] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.422238] systemd[1]: Detected architecture x86-64. worker1 # [ 1.428364] systemd[1]: Detected virtualization kvm. worker2 # [ 1.424398] systemd[1]: Running in initrd. worker1 # [ 1.430515] systemd[1]: Detected architecture x86-64. worker1 # [ 1.432684] systemd[1]: Running in initrd. worker2 # [ 1.426944] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.429921] systemd[1]: Hostname set to . worker1 # [ 1.435254] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.438149] systemd[1]: Hostname set to . worker2 # [ 1.534526] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.573628] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.577687] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.578886] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.580330] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.581548] systemd[1]: Reached target Path Units. worker2 # [ 1.582480] systemd[1]: Reached target Slice Units. worker2 # [ 1.583400] systemd[1]: Reached target Swaps. worker2 # [ 1.584226] systemd[1]: Reached target Timer Units. worker2 # [ 1.585254] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.586546] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.587721] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.588719] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.589736] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.590686] systemd[1]: Reached target Socket Units. worker2 # [ 1.592604] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.596438] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.605551] systemd[1]: Starting Journal Service... client # [ 1.643257] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.631034] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.635500] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.642236] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.645431] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.659282] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.656560] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.659853] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.665023] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.673972] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.679847] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.695604] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.699347] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.700525] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.701988] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.703153] systemd[1]: Reached target Path Units. client # [ 1.704090] systemd[1]: Reached target Slice Units. client # [ 1.704973] systemd[1]: Reached target Swaps. client # [ 1.705783] systemd[1]: Reached target Timer Units. worker2 # [ 1.691456] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.706748] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.707956] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.695069] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.709155] systemd[1]: Listening on Journal Sockets. client # [ 1.710143] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.694685] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.711182] systemd[1]: Listening on udev Kernel Socket. client # [ 1.712162] systemd[1]: Reached target Socket Units. lb # [ 1.699080] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.713911] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.700247] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.701669] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.702795] systemd[1]: Reached target Path Units. lb # [ 1.703706] systemd[1]: Reached target Slice Units. client # [ 1.717849] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.704610] systemd[1]: Reached target Swaps. lb # [ 1.705480] systemd[1]: Reached target Timer Units. lb # [ 1.706464] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.707695] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.708897] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.712663] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.709887] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.708558] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.710916] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.711895] systemd[1]: Reached target Socket Units. worker1 # [ 1.715985] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.717208] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.713657] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.718658] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.719810] systemd[1]: Reached target Path Units. worker1 # [ 1.720764] systemd[1]: Reached target Slice Units. worker1 # [ 1.721690] systemd[1]: Reached target Swaps. lb # [ 1.717903] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.722508] systemd[1]: Reached target Timer Units. worker1 # [ 1.723502] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.724783] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.725995] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.727052] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.728129] systemd[1]: Listening on udev Kernel Socket. client # [ 1.726695] systemd[1]: Starting Journal Service... worker1 # [ 1.729136] systemd[1]: Reached target Socket Units. worker1 # [ 1.731066] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.735665] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.732466] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.750678] systemd[1]: Starting Load Kernel Modules... lb # [ 1.727480] systemd[1]: Starting Journal Service... client # [ 1.755184] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.742635] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.762123] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.751432] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.745296] systemd[1]: Starting Journal Service... worker2 # [ 1.754446] systemd[1]: Finished Load Kernel Modules. lb # [ 1.755958] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.775609] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.777296] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.763909] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.768842] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.765089] systemd[1]: Starting Apply Kernel Variables... client # [ 1.780658] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.775703] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.775920] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.790426] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.777437] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.784227] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.794502] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.645274] systemd-modules-load[67]: Inserted module 'dm_mod'[ 1.781112] systemd[1]: Started Journal Service. worker2 # worker2 # [ 1.649317] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.784429] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.652320] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.793398] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.790271] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.658065] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.808133] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.799670] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.797232] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.666146] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.804532] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.813785] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.667180] systemd[1]: Reached target Local File Systems. worker2 # [ 1.669611] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.811651] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.807897] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.675743] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.825226] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.818083] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.682703] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.818031] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.829860] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.825920] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.837916] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.848637] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.704921] systemd[1]: Finished Create System Files and Directories. client # [ 1.857272] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.849816] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.848395] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.869129] systemd[1]: Finished Load Kernel Modules. lb # [ 1.857018] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.729263] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 1.881224] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.868950] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.878260] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.876907] systemd[1]: Starting Apply Kernel Variables... client # [ 1.894614] systemd[1]: Started Journal Service. worker1 # [ 1.887933] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.761602] systemd-modules-load[67]: Inserted module 'dm_mod' client # [ 1.764571] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.752717] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.768339] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.899178] systemd[1]: Finished Load Kernel Modules. lb # [ 1.895145] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.764383] systemd-modules-load[67]: Inserted module 'dm_mod'[ 1.901064] systemd[1]: Started Journal Service. lb # client # [ 1.781149] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.769296] systemd-modules-load[67]: Inserted module 'virtio_balloon' client # [ 1.782134] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.770355] systemd-modules-load[67]: Inserted module 'virtio_gpu' client # [ 1.783131] systemd[1]: Reached target Local File Systems. worker1 # [ 1.909820] systemd[1]: Starting Apply Kernel Variables... client # [ 1.786891] systemd[1]: Starting Create System Files and Directories... lb # [ 1.780866] systemd[1]: Finished Apply Kernel Variables. client # [ 1.793136] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.918791] systemd[1]: Started Journal Service. lb # [ 1.784083] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.782659] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.785153] systemd[1]: Reached target Local File Systems. client # [ 1.797515] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.787990] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.789133] systemd-modules-load[67]: Inserted module 'virtio_gpu' lb # [ 1.788082] systemd[1]: Starting Create System Files and Directories... lb # [ 1.793102] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.800592] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.807104] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.818194] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.810055] systemd[1]: Reached target Local File Systems. worker2 # [ 1.808727] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.813108] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.810192] systemd[1]: Reached target System Initialization. worker2 # [ 1.811189] systemd[1]: Reached target Basic System. lb # [ 1.818373] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.821180] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.829630] systemd[1]: Finished Apply Kernel Variables. client # [ 1.842935] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 1.839302] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker1 # [ 1.851214] systemd[1]: Finished Create System Files and Directories. client # [ 1.868070] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.860506] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.873638] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 1.898070] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.919708] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.920583] systemd[1]: Reached target System Initialization. client # [ 1.921483] systemd[1]: Reached target Basic System. lb # [ 1.910719] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.911653] systemd[1]: Reached target System Initialization. lb # [ 1.912591] systemd[1]: Reached target Basic System. worker1 # [ 1.949776] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.950741] systemd[1]: Reached target System Initialization. worker1 # [ 1.951573] systemd[1]: Reached target Basic System. worker2 # [ 2.133812] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.143291] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.145867] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.152807] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.161043] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.161897] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.163671] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.169958] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.173383] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.174272] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.175756] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.177658] usb usb1: Product: EHCI Host Controller worker2 # [ 2.180448] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.181205] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.182232] hub 1-0:1.0: USB hub found worker2 # [ 2.183386] hub 1-0:1.0: 6 ports detected worker2 # [ 2.190530] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.191268] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.208069] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.233254] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.219802] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.218635] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.238889] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.227365] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.229603] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.248817] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.240390] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.254126] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.239546] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.254820] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.107732] systemd[1]: Starting Virtual Console Setup... lb # [ 2.242323] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.250147] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.250914] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.252591] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.267212] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.267943] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.120173] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.269695] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.261742] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.258484] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.259708] usb usb2: Product: UHCI Host Controller lb # [ 2.260860] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.261804] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.261851] SCSI subsystem initialized client # [ 2.276747] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.277735] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.264347] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.266304] usb usb1: Product: EHCI Host Controller worker2 # [ 2.131381] (udev-worker)[87]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.280825] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.267851] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.268630] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.134043] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.282843] usb usb1: Product: EHCI Host Controller client # [ 2.284066] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.284818] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.271456] hub 1-0:1.0: USB hub found lb # [ 2.272348] hub 1-0:1.0: 6 ports detected client # [ 2.287726] hub 1-0:1.0: USB hub found lb # [ 2.275203] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.289599] hub 1-0:1.0: 6 ports detected worker2 # [ 2.277680] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.280877] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.295582] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.281662] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.296312] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.150277] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.151820] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.295270] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.291393] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.293632] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.294452] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.299275] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.294849] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.298070] hub 2-0:1.0: USB hub found client # [ 2.312763] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.307126] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.301935] hub 2-0:1.0: 2 ports detected worker1 # [ 2.307951] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.309212] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.319197] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.309357] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.316618] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.317902] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.318934] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.329112] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.320086] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.330262] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.315884] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.316627] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.323727] usb usb1: Product: EHCI Host Controller worker1 # [ 2.324784] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.320457] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.325550] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.328127] hub 1-0:1.0: USB hub found worker1 # [ 2.329628] hub 1-0:1.0: 6 ports detected worker2 # [ 2.191039] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.192839] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.327072] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.195093] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.330939] usb usb2: Product: UHCI Host Controller lb # [ 2.331673] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.330561] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.345833] SCSI subsystem initialized lb # [ 2.200743] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.337865] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.348079] usb usb2: Product: UHCI Host Controller client # [ 2.348759] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.335789] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.336935] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.344310] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.346422] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.210917] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.349881] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.345377] usb usb3: Product: UHCI Host Controller lb # [ 2.212799] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.346061] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.226274] (udev-worker)[89]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.215051] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.229805] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.351127] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.352846] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.352814] hub 3-0:1.0: USB hub found worker2 # [ 2.353769] hub 3-0:1.0: 2 ports detected lb # [ 2.355615] hub 2-0:1.0: USB hub found client # [ 2.235077] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.359737] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.360895] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.358278] hub 2-0:1.0: 2 ports detected worker2 # [ 2.359779] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.374822] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.361598] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.367108] SCSI subsystem initialized worker2 # [ 2.366823] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.249145] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.236287] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.370860] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.386373] hub 2-0:1.0: USB hub found client # [ 2.388360] hub 2-0:1.0: 2 ports detected worker1 # [ 2.380619] usb usb2: Product: UHCI Host Controller worker2 # [ 2.241755] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.381292] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.251195] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.380482] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.382408] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.384419] usb usb4: Product: UHCI Host Controller lb # [ 2.386129] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.385166] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.388427] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.256163] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.390563] hub 4-0:1.0: USB hub found client # [ 2.404693] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.259324] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.392402] hub 4-0:1.0: 2 ports detected client # [ 2.272544] systemd-vconsole-setup[97]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.264072] systemd[1]: Starting Virtual Console Setup... client # [ 2.276036] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.402692] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.398719] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.271420] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.273461] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.412903] hub 2-0:1.0: USB hub found lb # [ 2.409485] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.415156] hub 2-0:1.0: 2 ports detected worker2 # [ 2.409580] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.416532] SCSI subsystem initialized client # [ 2.425999] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.426762] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.413293] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.282389] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.414569] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.283738] systemd[1]: Reached target Initrd Root Device. lb # [ 2.288070] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.436635] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.423551] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.307103] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.426431] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.308037] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.427741] scsi host0: ahci client # [ 2.309063] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.430409] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.445209] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.430830] scsi host1: ahci worker2 # [ 2.434148] scsi host2: ahci client # [ 2.450807] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.437194] scsi host3: ahci client # [ 2.452005] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.438865] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.439999] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.439702] scsi host4: ahci worker1 # [ 2.310179] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.455060] usb usb3: Product: UHCI Host Controller client # [ 2.455752] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.441323] scsi host5: ahci worker2 # [ 2.442125] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.313524] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.444210] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.450751] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.446655] usb usb3: Product: UHCI Host Controller worker2 # [ 2.445468] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.451522] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.447650] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.446650] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.448652] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.463073] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.447937] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.450423] hub 3-0:1.0: USB hub found worker2 # [ 2.449123] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.451899] hub 3-0:1.0: 2 ports detected client # [ 2.468331] hub 3-0:1.0: USB hub found client # [ 2.470219] hub 3-0:1.0: 2 ports detected worker1 # [ 2.461573] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.459801] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.329389] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.476171] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.476927] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.463877] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.480381] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.337723] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.335711] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.338796] systemd[1]: Reached target Initrd Root Device. client # [ 2.483365] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.475440] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.471324] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.485519] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.476904] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.474093] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.344334] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.476130] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.357471] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.478877] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.480865] usb usb4: Product: UHCI Host Controller worker1 # [ 2.485422] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.481621] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.483874] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.363404] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.500999] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.491640] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.503112] usb usb4: Product: UHCI Host Controller client # [ 2.503819] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.492528] hub 4-0:1.0: USB hub found client # [ 2.506678] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.497613] usb usb3: Product: UHCI Host Controller lb # [ 2.493773] hub 4-0:1.0: 2 ports detected worker1 # [ 2.498286] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.508866] hub 4-0:1.0: USB hub found worker1 # [ 2.500945] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.510772] hub 4-0:1.0: 2 ports detected worker1 # [ 2.506853] hub 3-0:1.0: USB hub found worker1 # [ 2.508085] hub 3-0:1.0: 2 ports detected worker1 # [ 2.513853] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.515935] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.513871] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.528644] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.521777] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.531109] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.389379] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.525124] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.539310] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.540320] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.530690] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.531870] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.528726] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.529909] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.399497] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.530726] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.537970] usb usb4: Product: UHCI Host Controller lb # [ 2.534915] scsi host0: ahci lb # [ 2.536622] scsi host1: ahci worker1 # [ 2.541687] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.538372] scsi host2: ahci worker1 # [ 2.542452] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.552968] scsi host0: ahci lb # [ 2.540346] scsi host3: ahci worker1 # [ 2.545054] hub 4-0:1.0: USB hub found client # [ 2.554485] scsi host1: ahci lb # [ 2.541749] scsi host4: ahci lb # [ 2.543516] scsi host5: ahci worker1 # [ 2.548451] hub 4-0:1.0: 2 ports detected client # [ 2.557982] scsi host2: ahci lb # [ 2.544599] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.546333] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.560641] scsi host3: ahci lb # [ 2.547505] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.562264] scsi host4: ahci lb # [ 2.548665] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.563974] scsi host5: ahci lb # [ 2.549836] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.550994] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.565400] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.566511] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.568190] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.569397] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.555630] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.570546] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.556848] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.571692] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.558230] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.558955] usb 1-1: Manufacturer: QEMU worker2 # [ 2.559588] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.570624] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.576079] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.573845] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.583449] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.585277] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.589485] scsi host0: ahci worker1 # [ 2.590489] scsi host1: ahci worker1 # [ 2.592641] scsi host2: ahci worker1 # [ 2.594199] scsi host3: ahci worker1 # [ 2.595990] scsi host4: ahci worker1 # [ 2.597666] scsi host5: ahci worker1 # [ 2.598235] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.600348] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.601657] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.602820] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.603977] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.605128] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.643899] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.645030] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.646396] usb 1-1: Product: QEMU USB Tablet lb # [ 2.647080] usb 1-1: Manufacturer: QEMU lb # [ 2.647627] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.661400] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.664287] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.667578] usb 1-1: Product: QEMU USB Tablet client # [ 2.669455] usb 1-1: Manufacturer: QEMU client # [ 2.671150] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.525364] systemd[1]: Mounting /sysroot... lb # [ 2.662325] hid: raw HID events driver (C) Jiri Kosina client # [ 2.698788] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.700658] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.702952] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.705508] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.707066] usb 1-1: Manufacturer: QEMU worker1 # [ 2.708342] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.739559] hid: raw HID events driver (C) Jiri Kosina client # [ 2.639142] systemd[1]: Mounting /sysroot... worker2 # [ 2.761908] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.762900] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.764015] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.764964] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.765934] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.766974] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.767839] ata3.00: applying bridge limits worker2 # [ 2.768574] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.769425] ata3.00: configured for UDMA/100 worker2 # [ 2.770426] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.642200] systemd[1]: Mounting /sysroot... worker1 # [ 2.659868] systemd[1]: Mounting /sysroot... worker2 # [ 2.835487] usbcore: registered new interface driver usbhid worker2 # [ 2.836272] usbhid: USB HID core driver worker2 # [ 2.858527] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.861007] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.864655] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.866379] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.868617] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.884294] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.871291] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.886457] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.873510] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.873757] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.889241] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.876094] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.891482] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.878292] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.894011] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.880960] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.896208] ata3.00: applying bridge limits worker2 # [ 2.881386] EXT4-fs (vda): mounted filesystem 239e6c9e-df98-4cbb-a903-433ce793521c r/w with ordered data mode. Quota mode: none. lb # [ 2.882872] ata3.00: applying bridge limits lb # [ 2.884775] ata3.00: configured for UDMA/100 client # [ 2.898181] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.900443] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.887156] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.902528] ata3.00: configured for UDMA/100 worker2 # [ 2.755632] systemd[1]: Mounted /sysroot. worker2 # [ 2.757490] systemd[1]: Reached target Initrd Root File System. client # [ 2.904978] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.760352] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.915132] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.777845] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.918040] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.781068] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.920041] ata3.00: applying bridge limits worker2 # [ 2.782589] systemd[1]: Reloading... worker1 # [ 2.922211] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.924694] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.927001] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.929360] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.931727] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.934018] ata3.00: configured for UDMA/100 worker1 # [ 2.936418] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.975584] usbcore: registered new interface driver usbhid lb # [ 2.966957] usbcore: registered new interface driver usbhid lb # [ 2.967746] usbhid: USB HID core driver client # [ 2.984061] usbhid: USB HID core driver lb # [ 2.981986] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.996003] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.987091] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 3.002735] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.991288] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.865092] systemd[1]: Reloading finished in 83 ms. lb # [ 2.999926] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.872254] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker2 # [ 2.875150] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker1 # [ 3.016731] usbcore: registered new interface driver usbhid worker1 # [ 3.017507] usbhid: USB HID core driver worker2 # [ 2.880754] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 2.882289] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 2.883318] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.022206] EXT4-fs (vda): mounted filesystem 949b70ce-620c-474d-8417-b0beaf0e3485 r/w with ordered data mode. Quota mode: none. client # [ 3.041314] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.895711] systemd[1]: Mounted /sysroot. lb # [ 2.897141] systemd[1]: Reached target Initrd Root File System. client # [ 3.046797] EXT4-fs (vda): mounted filesystem 759ca026-cf93-4c44-bd04-aab8640abc48 r/w with ordered data mode. Quota mode: none. lb # [ 2.902092] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.916349] systemd[1]: Mounted /sysroot. client # [ 3.051218] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.918670] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.043103] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.920922] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.044943] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.049752] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.918038] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.059313] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.922068] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.923534] systemd[1]: Reloading... client # [ 2.936374] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.942071] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.943529] systemd[1]: Reloading... worker1 # [ 3.068279] EXT4-fs (vda): mounted filesystem d80a9e16-2163-42f9-9de3-690e024b8368 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.939684] systemd[1]: Mounted /sysroot. worker1 # [ 2.941311] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.945076] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.960739] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.963533] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.965269] systemd[1]: Reloading... lb # [ 3.002210] systemd[1]: Reloading finished in 80 ms. lb # [ 3.011278] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... client # [ 3.027240] systemd[1]: Reloading finished in 86 ms. lb # [ 3.016154] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... lb # [ 3.020202] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.021930] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.022902] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.035488] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... client # [ 3.040168] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... client # [ 3.043126] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.044468] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.046141] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.048580] systemd[1]: Reloading finished in 82 ms. worker1 # [ 3.059303] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.064157] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker1 # [ 3.066995] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.068387] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.069493] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.525105] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.529763] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.531086] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.537138] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.539771] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.571408] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.574083] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.575608] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.576672] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.577647] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.581990] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.592490] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.594074] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.596133] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.617740] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.618861] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.620508] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.624136] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.641212] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.649165] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.641199] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.655167] systemd[1]: Mounting /sysroot/run... lb # [ 3.643186] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.648605] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.649691] systemd[1]: Reached target Initrd Default Target. lb # [ 3.651157] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.651502] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.666175] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.658290] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.662192] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.664548] systemd[1]: Stopped target Initrd Default Target. client # [ 3.678327] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.665825] systemd[1]: Stopped target Basic System. worker1 # [ 3.669167] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.666838] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.668103] systemd[1]: Stopped target Path Units. lb # [ 3.669173] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.668928] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.669929] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.671439] systemd[1]: Stopped target Slice Units. worker2 # [ 3.672354] systemd[1]: Stopped target Socket Units. worker1 # [ 3.677156] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.674121] systemd[1]: Stopped target System Initialization. worker2 # [ 3.674913] systemd[1]: Stopped target Swaps. worker2 # [ 3.675692] systemd[1]: Stopped target Timer Units. worker2 # [ 3.676397] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.677199] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.678594] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.678032] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.679240] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.680611] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.682149] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.683275] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.687184] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.684360] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.685563] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.687307] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.688609] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.689949] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.691233] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.692539] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.693600] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.695066] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.699633] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.697447] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.700610] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.701781] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.702750] systemd[1]: Stopped Virtual Console Setup. client # [ 3.722584] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.724161] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.724897] systemd[1]: Mounted /sysroot/run. client # [ 3.725522] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.711366] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.726248] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.715164] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.730838] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.717996] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.720626] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.721150] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.724147] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.722268] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.724898] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.723337] systemd[1]: Closed udev Control Socket. lb # [ 3.725567] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.725375] systemd[1]: Starting Cleanup udev Database... lb # [ 3.727294] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.726218] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 3.727361] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.741486] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.742957] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.729166] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.731244] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.731112] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.745417] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.732116] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.733100] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.733961] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.736605] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.741599] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.743072] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.743846] systemd[1]: Mounted /sysroot/run. lb # [ 3.741575] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.744525] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.743097] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.746325] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.745245] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.750085] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.751353] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.752906] systemd[1]: Finished Cleanup udev Database. client # [ 3.767095] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.754141] systemd[1]: Reached target Switch Root. client # [ 3.768238] systemd[1]: Reached target Initrd File Systems. client # [ 3.769950] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.755970] systemd[1]: Starting NixOS Activation... worker1 # [ 3.761372] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.772448] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.762830] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.765239] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.767083] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.768388] systemd[1]: Reached target Initrd File Systems. lb # [ 3.769922] systemd[1]: Starting Find NixOS closure... lb # [ 3.772517] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.791350] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 3.786787] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.787909] systemd[1]: Reached target Initrd File Systems. client # [ 3.798407] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.789541] systemd[1]: Starting Find NixOS closure... client # [ 3.799684] systemd[1]: Reached target Initrd Default Target. client # [ 3.801843] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.793139] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.793298] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.798861] systemd[1]: Finished Find NixOS closure. lb # [ 3.800172] systemd[1]: Reached target Initrd Default Target. lb # [ 3.801922] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.814458] systemd[1]: Stopped target Initrd Default Target. client # [ 3.815900] systemd[1]: Stopped target Basic System. client # [ 3.816838] systemd[1]: Stopped target Initrd Root Device. client # [ 3.817862] systemd[1]: Stopped target Path Units. client # [ 3.819110] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.809670] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.820202] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.821266] systemd[1]: Stopped target Slice Units. client # [ 3.822251] systemd[1]: Stopped target Socket Units. client # [ 3.823216] systemd[1]: Stopped target System Initialization. client # [ 3.824403] systemd[1]: Stopped target Swaps. client # [ 3.825350] systemd[1]: Stopped target Timer Units. client # [ 3.827137] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.814817] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.817720] systemd[1]: Finished Find NixOS closure. client # [ 3.827951] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.815895] systemd[1]: Stopped target Basic System. worker1 # [ 3.818790] systemd[1]: Reached target Initrd Default Target. client # [ 3.828874] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.816881] systemd[1]: Stopped target Initrd Root Device. client # [ 3.829889] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.815807] initrd-nixos-activation-start[191]: booting system configuration /nix/store/gvbzy0g4j2sf3am2wkwfga8lrrdci67y-nixos-system-worker2-test worker1 # [ 3.820630] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.830953] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.819152] systemd[1]: Stopped target Path Units. client # [ 3.832180] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.819858] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.833284] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.820892] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.821890] systemd[1]: Stopped target Slice Units. lb # [ 3.822619] systemd[1]: Stopped target Socket Units. client # [ 3.835289] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.823519] systemd[1]: Stopped target System Initialization. client # [ 3.836472] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.824298] systemd[1]: Stopped target Swaps. lb # [ 3.824944] systemd[1]: Stopped target Timer Units. client # [ 3.837583] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.825656] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.826493] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.838804] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.840150] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.827794] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.828807] systemd[1]: Stopped Find NixOS closure. client # [ 3.841439] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.830098] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.842572] systemd[1]: Stopped target Local File Systems. lb # [ 3.831295] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.844124] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.834599] systemd[1]: Stopped target Initrd Default Target. client # [ 3.845228] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.833129] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.835849] systemd[1]: Stopped target Basic System. lb # [ 3.833874] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.836699] systemd[1]: Stopped target Initrd Root Device. client # [ 3.847124] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.834837] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.837717] systemd[1]: Stopped target Path Units. client # [ 3.847887] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.835723] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.839051] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.849124] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.836752] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.840091] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.850591] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.838107] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.841187] systemd[1]: Stopped target Slice Units. lb # [ 3.839085] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.842093] systemd[1]: Stopped target Socket Units. worker1 # [ 3.843084] systemd[1]: Stopped target System Initialization. lb # [ 3.841102] systemd[1]: Stopped target Local File Systems. lb # [ 3.841897] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.845123] systemd[1]: Stopped target Swaps. lb # [ 3.843021] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.845804] systemd[1]: Stopped target Timer Units. worker1 # [ 3.846507] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.844168] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.842888] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 3.847436] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.845641] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.848245] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.849264] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.850608] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.848129] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.849174] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.852167] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.853310] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.863573] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.854351] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.855582] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.856589] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.867969] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.858164] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.859414] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.857983] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.870733] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.861241] systemd[1]: Stopped Create System Files and Directories. client # [ 3.871838] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.862395] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.863393] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.873477] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.864454] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.862133] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.874912] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.865703] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.876449] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.867527] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.877808] systemd[1]: Closed udev Control Socket. worker1 # [ 3.868588] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.879438] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.870545] systemd[1]: Stopped Virtual Console Setup. client # [ 3.880313] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.868232] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.881421] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.869322] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.883541] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.872078] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.884716] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.873100] systemd[1]: Closed udev Control Socket. client # [ 3.885703] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.874731] systemd[1]: Starting Cleanup udev Database... client # [ 3.887099] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.877582] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.876144] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.877222] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.878162] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.879228] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.881138] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.883780] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.882086] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.882955] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.887446] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.885111] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.889541] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.901729] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.893133] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.903442] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.894182] systemd[1]: Closed udev Control Socket. client # [ 3.905148] systemd[1]: Reached target Switch Root. worker1 # [ 3.895894] systemd[1]: Starting Cleanup udev Database... client # [ 3.906319] systemd[1]: Starting NixOS Activation... worker1 # [ 3.896762] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.898195] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.899199] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.901155] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.902194] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.903195] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.900942] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.904116] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.902615] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.906151] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.904134] systemd[1]: Reached target Switch Root. lb # [ 3.905545] systemd[1]: Starting NixOS Activation... worker1 # [ 3.921870] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.923616] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.925136] systemd[1]: Reached target Switch Root. worker1 # [ 3.926921] systemd[1]: Starting NixOS Activation... client # [ 3.980038] initrd-nixos-activation-start[192]: booting system configuration /nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test lb # [ 3.968147] initrd-nixos-activation-start[190]: booting system configuration /nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test worker1 # [ 3.992279] initrd-nixos-activation-start[191]: booting system configuration /nix/store/dyab6c8i372v5waficb63zp79vnsaxrg-nixos-system-worker1-test lb # [ 3.995580] initrd-nixos-activation-start[190]: running activation script... client # [ 4.008363] initrd-nixos-activation-start[192]: running activation script... worker1 # [ 4.018568] initrd-nixos-activation-start[191]: running activation script... worker2 # [ 4.046869] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 4.147848] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.150514] systemd[1]: Finished NixOS Activation. worker2 # [ 4.151540] systemd[1]: Starting Switch Root... worker2 # [ 4.164419] systemd[1]: Switching root. lb # [ 4.178406] initrd-nixos-activation-start[213]: setting up /etc... client # [ 4.217301] initrd-nixos-activation-start[215]: setting up /etc... worker1 # [ 4.218238] initrd-nixos-activation-start[214]: setting up /etc... lb # [ 4.274379] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.276099] systemd[1]: Finished NixOS Activation. lb # [ 4.277897] systemd[1]: Starting Switch Root... worker2 # [ 4.421791] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.290935] systemd[1]: Switching root. worker1 # [ 4.316786] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.327836] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.318419] systemd[1]: Finished NixOS Activation. client # [ 4.329498] systemd[1]: Finished NixOS Activation. worker1 # [ 4.320525] systemd[1]: Starting Switch Root... client # [ 4.331446] systemd[1]: Starting Switch Root... client # [ 4.343991] systemd[1]: Switching root. worker1 # [ 4.334535] systemd[1]: Switching root. worker2 # [ 4.521151] NET: Registered PF_VSOCK protocol family lb # [ 4.549782] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.607003] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.598853] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.625450] NET: Registered PF_VSOCK protocol family client # [ 4.674745] NET: Registered PF_VSOCK protocol family worker1 # [ 4.687923] NET: Registered PF_VSOCK protocol family worker2 # [ 4.879669] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 4.888557] systemd[1]: Detected virtualization kvm. worker2 # [ 4.890317] systemd[1]: Detected architecture x86-64. worker2 # [ 4.892238] systemd[1]: Detected first boot. worker2 # [ 4.896276] systemd[1]: Initializing machine ID from random generator. lb # [ 4.982063] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 4.991642] systemd[1]: Detected virtualization kvm. lb # [ 4.993455] systemd[1]: Detected architecture x86-64. lb # [ 4.995366] systemd[1]: Detected first boot. lb # [ 4.999164] systemd[1]: Initializing machine ID from random generator. client # [ 5.028990] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.038490] systemd[1]: Detected virtualization kvm. client # [ 5.040229] systemd[1]: Detected architecture x86-64. client # [ 5.042117] systemd[1]: Detected first boot. client # [ 5.045886] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.047472] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.057005] systemd[1]: Detected virtualization kvm. worker1 # [ 5.058735] systemd[1]: Detected architecture x86-64. worker1 # [ 5.060641] systemd[1]: Detected first boot. worker1 # [ 5.064438] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.124059] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.185749] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.230622] systemd[1]: Applying preset policy. lb # [ 5.242504] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.283494] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.275825] systemd[1]: Applying preset policy. lb # [ 5.361739] systemd[1]: Applying preset policy. client # [ 5.395911] systemd[1]: Applying preset policy. worker2 # [ 5.403118] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.446208] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.535601] systemd[1]: Populated /etc with preset unit settings. client # [ 5.556523] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.593997] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.595496] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.597739] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.599781] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.601096] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.602026] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.603237] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.604370] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.605067] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.605845] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.606651] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.607446] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.608228] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.609084] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.610115] systemd[1]: Reached target Path Units. worker2 # [ 5.610842] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.611610] systemd[1]: Reached target Slice Units. worker2 # [ 5.612293] systemd[1]: Reached target Swaps. worker2 # [ 5.614135] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.616576] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.618379] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.620220] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.632696] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.635646] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.641774] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.636888] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.643177] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.639703] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.645192] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.640805] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.647269] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.641950] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.648683] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.643264] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.649594] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.650785] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.651899] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.652666] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.647298] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.653413] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.648375] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.654238] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.649238] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.655018] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.655840] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.656711] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.651450] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.657739] systemd[1]: Reached target Path Units. worker1 # [ 5.658682] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.659478] systemd[1]: Reached target Slice Units. worker1 # [ 5.660213] systemd[1]: Reached target Swaps. worker2 # [ 5.654747] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.662105] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.664642] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.666422] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.661771] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.668422] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.668332] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.681031] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.676194] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.684010] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.685639] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.688397] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.689514] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.690677] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.692022] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.688272] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.696075] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.690524] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.697141] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.697993] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.700146] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.703817] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.699439] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.711924] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.706303] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.717644] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.723913] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.720803] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.724789] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 5.742639] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.733695] systemd[1]: Starting Load Kernel Module configfs... client # [ 5.743953] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.734521] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 5.746398] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 5.748375] systemd[1]: Created slice Slice /system/getty. client # [ 5.749673] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.739689] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.750576] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.736443] systemd[1]: Starting Journal Service... client # [ 5.751784] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.738929] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 5.752871] systemd[1]: Expecting device /dev/hvc0... client # [ 5.753583] systemd[1]: Expecting device /dev/ttyS0... lb # [ 5.740203] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.744051] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.754343] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.755153] systemd[1]: Stopped target initrd-fs.target. client # [ 5.755883] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.742218] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 5.756683] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.742429] systemd[1]: Starting Load Kernel Modules... client # [ 5.757517] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.744311] systemd[1]: Created slice Slice /system/getty. client # [ 5.758406] systemd[1]: Reached target Path Units. client # [ 5.759120] systemd[1]: Reached target Remote File Systems. lb # [ 5.745582] systemd[1]: Created slice User and Session Slice. client # [ 5.759903] systemd[1]: Reached target Slice Units. lb # [ 5.746522] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.760593] systemd[1]: Reached target Swaps. lb # [ 5.747710] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.748855] systemd[1]: Expecting device /dev/hvc0... client # [ 5.762384] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.749555] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.748875] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.750317] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.751148] systemd[1]: Stopped target initrd-fs.target. client # [ 5.764767] systemd[1]: Listening on Process Core Dump Socket. lb # [ 5.751900] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.752705] systemd[1]: Stopped target initrd-switch-root.target. client # [ 5.766567] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 5.753558] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.758169] systemd[1]: Mounting FUSE Control File System... lb # [ 5.754463] systemd[1]: Reached target Path Units. lb # [ 5.755141] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.754439] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.755919] systemd[1]: Reached target Slice Units. lb # [ 5.756620] systemd[1]: Reached target Swaps. worker2 # [ 5.756432] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.758414] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.760857] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.765399] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.764110] systemd[1]: Starting Coldplug All udev Devices... client # [ 5.768435] systemd[1]: Listening on Factory Reset Management. client # [ 5.780974] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.768228] systemd[1]: Listening on Journal Log Access Socket. client # [ 5.783665] systemd[1]: Starting Journal Log Access Socket... client # [ 5.785011] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.770566] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.772459] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 5.762594] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.787580] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.788743] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.774456] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.776097] systemd[1]: Listening on Factory Reset Management. lb # [ 5.777013] systemd[1]: Listening on Hostname Service Socket. client # [ 5.790262] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.791559] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.783748] systemd[1]: Starting Journal Service... worker2 # [ 5.778391] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.779673] systemd[1]: Starting Journal Log Access Socket... lb # [ 5.781091] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.780190] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.795618] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.796610] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.782177] systemd[1]: Mounted FUSE Control File System. client # [ 5.797469] systemd[1]: Listening on udev Varlink Socket. lb # [ 5.783713] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 5.784866] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 5.799548] systemd[1]: Mounting Huge Pages File System... lb # [ 5.785980] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.791309] systemd[1]: Starting Load Kernel Modules... lb # [ 5.787257] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 5.801737] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.787898] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.791339] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.792367] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.796788] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.793222] systemd[1]: Listening on udev Varlink Socket. client # [ 5.808449] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.795326] systemd[1]: Mounting Huge Pages File System... lb # [ 5.797554] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.802977] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.804983] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.816116] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.801694] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.803394] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.804899] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.812957] systemd[1]: Starting Coldplug All udev Devices... client # [ 5.824121] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.809750] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 5.817294] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.813220] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.819786] systemd[1]: Mounted Huge Pages File System. worker1 # [ 5.821905] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 5.820014] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.824803] systemd[1]: Mounted Kernel Debug File System. client # [ 5.834116] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.826000] systemd[1]: Mounted Kernel Trace File System. client # [ 5.834972] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.829286] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 5.831312] systemd[1]: Mounted FUSE Control File System. lb # [ 5.828848] systemd[1]: Starting Load Kernel Module configfs... lb # [ 5.829684] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.832525] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 5.838451] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.849760] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 5.844761] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.861514] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.852688] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 5.854195] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 5.859104] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.856552] EXT4-fs (vda): re-mounted 239e6c9e-df98-4cbb-a903-433ce793521c. client # [ 5.873753] systemd[1]: Mounting FUSE Control File System... lb # [ 5.861673] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.879233] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.866118] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.867314] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.870917] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.869438] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.871786] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.876444] systemd[1]: Starting Load/Save OS Random Seed... client # [ 5.891641] systemd[1]: Starting Journal Service... worker2 # [ 5.877302] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.886739] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.882872] systemd-journald[284]: Collecting audit messages is enabled. client # [ 5.898117] systemd[1]: Starting Load Kernel Modules... lb # [ 5.887198] systemd[1]: Starting Journal Service... worker2 # [ 5.892537] loop: module loaded client # [ 5.907985] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.895153] systemd[1]: Starting Load Kernel Modules... worker1 # [ 5.903908] EXT4-fs (vda): re-mounted d80a9e16-2163-42f9-9de3-690e024b8368. worker2 # [ 5.900994] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.904183] systemd[1]: Starting Firewall... lb # [ 5.905211] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 5.920113] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.907059] systemd[1]: Starting Apply Kernel Variables... client # [ 5.924134] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.915236] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 5.917045] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.913780] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.919409] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.918967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.924953] systemd-journald[284]: Collecting audit messages is enabled. worker1 # [ 5.928198] systemd[1]: Starting Load/Save OS Random Seed... client # [ 5.937826] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.929451] loop: module loaded worker1 # [ 5.930008] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.927531] systemd[1]: Starting Coldplug All udev Devices... client # [ 5.942939] systemd-journald[285]: Collecting audit messages is enabled. worker1 # [ 5.936464] systemd[1]: Finished Load Kernel Modules. client # [ 5.946304] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 5.939543] systemd[1]: Starting Firewall... client # [ 5.950303] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.937154] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 5.941122] systemd-journald[283]: Collecting audit messages is enabled. client # [ 5.955236] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 5.947243] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.808718] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.944199] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.947319] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.946470] systemd[1]: Started Journal Service. client # [ 5.962283] systemd[1]: Mounted Kernel Debug File System. client # [ 5.829619] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.817279] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.951952] systemd[1]: Mounted Huge Pages File System. client # [ 5.833345] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.955172] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.821206] systemd-modules-load[285]: Inserted module 'loop' lb # [ 5.959023] systemd[1]: Mounted Kernel Debug File System. client # [ 5.973355] systemd[1]: Started Journal Service. worker2 # [ 5.826728] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.843695] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.964908] systemd[1]: Mounted Kernel Trace File System. client # [ 5.848818] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.849726] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.973284] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.854175] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.842374] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.855060] systemd[1]: Mounted FUSE Control File System. lb # [ 5.844664] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.979488] systemd[1]: Started Journal Service. worker1 # [ 5.848285] systemd[1]: Queued start job for default target Multi-User System.[ 5.983883] systemd[1]: Started Journal Service. lb # [ 5.982050] loop: module loaded worker1 # lb # [ 5.850325] systemd-modules-load[284]: Inserted module 'loop' worker1 # [ 5.853656] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 5.999636] loop: module loaded worker2 # [ 5.853131] systemd[1]: Finished Load/Save OS Random Seed. client # [ 5.867237] systemd-modules-load[286]: Inserted module 'loop' worker2 # [ 5.855194] systemd[1]: Reached target First Boot Complete. lb # [ 5.857593] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 5.861736] systemd-modules-load[285]: Inserted module 'loop' lb # [ 5.860232] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.862114] systemd[1]: Mounted FUSE Control File System. client # [ 6.010069] EXT4-fs (vda): re-mounted 759ca026-cf93-4c44-bd04-aab8640abc48. worker1 # [ 5.867430] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.878487] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.869062] systemd[1]: Finished Load Kernel Modules. client # [ 5.883209] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 5.878213] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 5.889827] systemd[1]: Finished Load Kernel Modules. lb # [ 5.878123] systemd[1]: Mounting Kernel Configuration File System... client # [ 5.893240] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.883187] systemd[1]: Starting Firewall... client # [ 5.898366] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.890117] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 5.893313] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 5.889521] systemd-oomd[286]: No swap; memory pressure usage will be degraded client # [ 5.911068] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.911970] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.032887] EXT4-fs (vda): re-mounted 949b70ce-620c-474d-8417-b0beaf0e3485. worker1 # [ 5.905065] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 6.034113] systemd-journald[284]: Received client request to flush runtime journal. client # [ 5.915808] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 5.907237] systemd[1]: Reached target First Boot Complete. lb # [ 5.908100] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.926292] systemd-oomd[288]: No swap; memory pressure usage will be degraded lb # [ 5.914807] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 5.931330] systemd[1]: Starting Apply Kernel Variables... client # [ 5.932382] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.922451] systemd-oomd[286]: No swap; memory pressure usage will be degraded client # [ 5.937801] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 5.930208] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 5.939288] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 5.942638] systemd-oomd[286]: No swap; memory pressure usage will be degraded lb # [ 5.943372] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.080492] systemd-journald[284]: Received client request to flush runtime journal. lb # [ 5.944279] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.956372] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.957196] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.959203] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.109250] systemd-journald[285]: Received client request to flush runtime journal. worker2 # [ 5.985149] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.986410] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 5.999873] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.001186] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 6.005099] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.144744] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.013065] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.064333] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.067261] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.068247] systemd[1]: Reached target First Boot Complete. client # [ 6.070324] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.071419] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.077236] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.078594] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.079704] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.081820] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.097211] systemd[1]: Finished Apply Kernel Variables. client # [ 6.100169] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.103818] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.097191] systemd-udevd[319]: Using default interface naming scheme 'v261'. lb # [ 6.099289] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.100389] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.101228] systemd[1]: Reached target First Boot Complete. lb # [ 6.102024] systemd[1]: Finished Apply Kernel Variables. lb # [ 6.107413] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.142991] systemd-udevd[317]: Using default interface naming scheme 'v261'. lb # [ 6.150245] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.165791] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.156899] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.174495] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.175629] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.178117] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.171657] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.183485] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.209617] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker1 # [ 6.215155] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.218595] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.229991] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.243222] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.232116] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.233815] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 6.277666] systemd-udevd[327]: Using default interface naming scheme 'v261'. worker1 # [ 6.285361] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.301474] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.323408] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.324260] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 6.367858] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.375567] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.389419] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.388814] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.408094] (udev-worker)[327]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.412899] (udev-worker)[327]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.415117] (udev-worker)[328]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.406385] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 6.430585] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.436253] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.451668] (udev-worker)[359]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.456950] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 6.458827] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.464041] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.472944] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.483987] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.485196] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.486560] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.488745] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.490639] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.491874] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.502908] systemd[1]: Mounted /run/wrappers. lb # [ 6.507635] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 6.506367] systemd[1]: Reached target Local File Systems. worker1 # [ 6.511569] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.510075] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 6.516085] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.520471] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 6.521286] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.527770] (udev-worker)[361]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.525207] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.535352] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.533374] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.533153] systemd[1]: Starting Create System Files and Directories... client # [ 6.680998] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 6.538162] (udev-worker)[361]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.688172] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 6.564148] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.567126] systemd[1]: Reached target Local File Systems. lb # [ 6.564945] (udev-worker)[351]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.567340] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.570853] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.569251] (udev-worker)[357]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.574076] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.577455] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.579198] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.583065] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.588238] systemd[1]: Starting Create System Files and Directories... client # [ 6.613575] systemd[1]: Mounting /run/wrappers... lb # [ 6.611350] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.615112] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.620160] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.656261] systemd[1]: Mounted /run/wrappers. client # [ 6.657890] systemd[1]: Reached target Local File Systems. client # [ 6.661073] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.650989] systemd[1]: Mounted /run/wrappers. client # [ 6.664071] systemd[1]: Starting register-nix-paths.service... lb # [ 6.651875] systemd[1]: Reached target Local File Systems. client # [ 6.668068] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.656277] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.668871] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.659663] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.661958] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.666764] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.664979] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.665841] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.666538] systemd[1]: Finished Create System Files and Directories. lb # [ 6.668719] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.681868] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.669160] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.672527] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.687432] systemd[1]: Starting Create System Files and Directories... lb # [ 6.675898] systemd[1]: Starting Create System Files and Directories... client # [ 6.715724] ACPI: button: Power Button [PWRF] lb # [ 6.725738] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 6.727905] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.731261] systemd[1]: Finished Create System Files and Directories. lb # [ 6.729312] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.730504] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.734170] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.732415] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.723140] mousedev: PS/2 mouse device common for all mice client # [ 6.746191] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 6.765178] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 6.737517] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.737138] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.738994] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.760809] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.749272] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.766412] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.779404] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.785335] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.803560] systemd[1]: Finished Create System Files and Directories. client # [ 6.809100] systemd[1]: Starting Rebuild Journal Catalog... client # [ 6.765244] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T22:21:55 UTC (1790115715) client # [ 6.765314] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 6.772881] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 6.800244] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.815647] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 6.804961] systemd[1]: Starting Update is Completed... worker1 # [ 6.812840] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 6.818174] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 6.819817] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.823229] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.824710] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.828547] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.832320] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.830536] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.833187] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.842528] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.846447] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.868090] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 6.870561] systemd[1]: Starting Update is Completed... client # [ 6.883340] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.799003] parport_pc 00:02: reported by Plug and Play ACPI client # [ 6.799108] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 6.807779] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 6.904727] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.909748] systemd[1]: Starting Update is Completed... worker2 # [ 6.909220] systemd[1]: Finished Update is Completed. client # [ 6.861829] Console: switching to colour dummy device 80x25 lb # [ 6.928447] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.080001] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.080441] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 6.954987] systemd[1]: Finished Update is Completed. worker1 # [ 6.946440] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.076790] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 6.948209] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.951401] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.955264] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.957287] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.958783] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.961239] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.963371] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.111365] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 6.968373] systemd[1]: Finished Update is Completed. worker2 # [ 7.097064] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 lb # [ 6.968178] systemd[1]: Starting Update is Completed... client # [ 7.117477] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.118189] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.127613] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.114250] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.149835] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.152735] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.139512] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 7.020412] systemd[1]: Finished Update is Completed. client # [ 7.073124] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.070278] systemd[1]: Finished Firewall. worker1 # [ 7.111592] systemd[1]: Finished Firewall. worker1 # [ 7.258483] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.271946] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.161980] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.164934] systemd[1]: Stopped Virtual Console Setup. client # [ 7.301067] Console: switching to colour frame buffer device 160x50 client # [ 7.170746] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.159955] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.161630] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.342195] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 7.180083] ACPI: button: Power Button [PWRF] worker1 # [ 7.218152] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.219409] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.231607] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.248915] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.159889] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 client # [ 7.378385] ppdev: user-space parallel port driver worker2 # [ 7.163196] ACPI: button: Power Button [PWRF] worker2 # [ 7.323088] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.272902] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.272968] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T22:21:55 UTC (1790115715) worker2 # [ 7.329586] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.340729] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.273038] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.274058] systemd-journald[283]: Time jumped backwards, rotating. client # [ 7.439452] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 7.340797] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T22:21:55 UTC (1790115715) worker2 # [ 7.340875] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.299190] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.458536] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.336048] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.339499] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 7.320688] ACPI: button: Power Button [PWRF] worker1 # [ 7.337380] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.411463] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.344451] systemd[1]: Starting Virtual Console Setup... lb # [ 7.291256] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 7.291341] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.312966] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.347085] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.342212] systemd-journald[284]: Time jumped backwards, rotating. worker2 # [ 7.345782] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.355232] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.349137] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 7.444470] Console: switching to colour dummy device 80x25 worker1 # [ 7.446936] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.356788] Console: switching to colour dummy device 80x25 worker2 # [ 7.374759] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.447005] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T22:21:56 UTC (1790115716) worker1 # [ 7.447079] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.463960] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.483572] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.483677] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.344315] Console: switching to colour dummy device 80x25 lb # [ 7.350467] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.516300] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.516302] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.526118] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.526859] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.528768] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.528771] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.401800] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.533828] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.464044] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.404345] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 7.475203] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.546944] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.555490] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.555492] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.558254] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.426634] systemd[1]: Finished Firewall. client # [ 7.575501] kvm_amd: TSC scaling supported client # [ 7.576010] kvm_amd: Nested Virtualization enabled client # [ 7.576806] kvm_amd: Nested Paging enabled client # [ 7.577836] kvm_amd: LBR virtualization supported client # [ 7.578768] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.579469] kvm_amd: Virtual GIF supported worker2 # [ 7.564246] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.579894] kvm_amd: Virtual NMI enabled worker2 # [ 7.565663] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 7.575594] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.587874] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.588547] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.467223] systemd[1]: Finished register-nix-paths.service. lb # [ 7.468361] systemd[1]: Reached target System Initialization. client # [ 7.617185] EDAC MC: Ver: 3.0.0 lb # [ 7.471078] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.472160] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.472985] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.473910] systemd[1]: Reached target Timer Units. lb # [ 7.475252] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 7.479673] systemd[1]: Listening on niks3 server socket. lb # [ 7.480453] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.481274] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.482565] systemd[1]: Reached target Socket Units. lb # [ 7.483650] systemd[1]: Reached target Basic System. lb # [ 7.485807] systemd[1]: Started backdoor.service. lb # [ 7.488155] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.489218] systemd[1]: Starting Virtual Console Setup... lb # [ 7.499282] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.498443] systemd[1]: Finished register-nix-paths.service. lb # [ 7.504096] systemd[1]: Starting Post-Boot Actions... lb # [ 7.512330] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.519713] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.520761] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 7.525737] systemd[1]: Finished register-nix-paths.service. worker1 # [ 7.528137] systemd[1]: Reached target System Initialization. worker2 # [ 7.524558] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.529241] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 7.530470] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.530206] systemd[1]: Starting resolvconf update... worker1 # [ 7.533142] systemd[1]: Reached target Timer Units. worker1 # [ 7.533861] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.534767] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.568254] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.568367] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.571705] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.546061] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 7.546915] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 7.548064] systemd[1]: Reached target Socket Units. lb # [ 7.546161] systemd[1]: Started rustfs.service. worker1 # [ 7.548728] systemd[1]: Reached target Basic System. worker1 # [ 7.552176] systemd[1]: Started backdoor.service. worker1 # [ 7.556461] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 7.559204] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.565351] systemd[1]: Starting Post-Boot Actions... lb # [ 7.563542] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 7.696718] Console: switching to colour frame buffer device 160x50 worker1 # [ 7.571179] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.577433] systemd[1]: Starting resolvconf update... worker2 # [ 7.711282] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 7.585482] systemd[1]: Starting D-Bus System Message Bus... lb # connecting to host... worker2 # [ 7.734255] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 7.740257] ppdev: user-space parallel port driver lb # [ 7.614416] systemd[1]: Finished Post-Boot Actions. worker2 # [ 7.760963] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.642818] systemd[1]: Finished register-nix-paths.service. lb # [ 7.635463] nsncd[522]: Sep 22 22:21:55.994 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.651687] systemd-vconsole-setup[418]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 7.655085] systemd[1]: Finished Virtual Console Setup. client # [ 7.656550] systemd[1]: Reached target System Initialization. lb # [ 7.645401] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.657883] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.659258] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 7.660803] systemd[1]: Reached target Timer Units. client # [ 7.661532] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.662515] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.663314] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.572002] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 7.665149] systemd[1]: Reached target Socket Units. client # [ 7.665885] systemd[1]: Reached target Basic System. client # [ 7.667162] systemd[1]: Started backdoor.service. lb # [ 7.655699] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.656577] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.670106] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 7.662594] systemd[1]: Finished Post-Boot Actions. client # [ 7.675497] systemd[1]: Starting nftables firewall... lb # [ 7.664659] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.678573] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.666347] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.668264] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 7.672773] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.672955] systemd[1]: Starting Virtual Console Setup... lb # [ 7.678087] systemd[1]: Starting User Login Management... client # [ 7.693664] systemd[1]: Starting Post-Boot Actions... lb # [ 7.598609] Console: switching to colour frame buffer device 160x50 lb # [ 7.821618] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 7.701299] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.694726] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.699474] nsncd[514]: Sep 22 22:21:56.881 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # connecting to host... client # [ 7.713039] systemd[1]: Starting resolvconf update... worker1 # [ 7.707925] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.710227] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.712774] systemd[1]: Starting User Login Management... lb # [ 7.720311] systemd[1]: Finished Import lastlog data into lastlog2 database. client # connecting to host... worker1 # [ 7.732234] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 7.758438] systemd[1]: Starting D-Bus System Message Bus... lb # [ 7.747081] systemd[1]: Starting Virtual Console Setup... client # [ 7.759492] nsncd[427]: Sep 22 22:21:56.626 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.761303] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.891294] kvm_amd: TSC scaling supported worker2 # [ 7.892073] kvm_amd: Nested Virtualization enabled worker2 # [ 7.892710] kvm_amd: Nested Paging enabled worker2 # [ 7.893085] kvm_amd: LBR virtualization supported worker2 # [ 7.894312] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 7.895082] kvm_amd: Virtual GIF supported worker2 # [ 7.895697] kvm_amd: Virtual NMI enabled client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 7.785444] systemd[1]: Finished Post-Boot Actions. client # [ 7.790398] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.791705] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.929023] EDAC MC: Ver: 3.0.0 client # [ 7.805669] systemd[1]: Starting User Login Management... lb # [ 7.798667] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.676538] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 7.799703] systemd[1]: Stopped Virtual Console Setup. client # [ 7.810544] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 7.814693] systemd[1]: Starting Virtual Console Setup... client: connected to guest root shell client: (connecting took 8.49 seconds) client: (finished: waiting for the VM to finish booting, in 8.49 seconds) worker2 # [ 7.851695] systemd-vconsole-setup[520]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 7.856176] systemd[1]: Finished Virtual Console Setup. worker2 # [ 7.856912] systemd[1]: Reached target System Initialization. worker1 # [ 7.676811] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.857963] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.859147] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.861152] systemd[1]: Reached target Timer Units. worker2 # [ 7.861877] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.862816] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.865449] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 7.866526] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.867680] systemd[1]: Reached target Socket Units. worker2 # [ 7.868451] systemd[1]: Reached target Basic System. worker2 # [ 7.870626] systemd[1]: Started backdoor.service. worker2 # [ 7.875073] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.877131] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.857444] Console: switching to colour frame buffer device 160x50 worker2 # [ 7.883391] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.887341] systemd[1]: Started Reset console on configuration changes. client # [ 7.901410] dbus-broker-launch[440]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.892215] systemd[1]: Starting resolvconf update... client # [ 7.909370] dbus-broker-launch[440]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.034504] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.896832] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.911389] dbus-broker-launch[440]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 7.767837] dbus-broker-launch[519]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.904318] dbus-broker-launch[519]: NSS returned no entry for 'systemd-timesync' worker1 # [ 7.905311] dbus-broker-launch[519]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 7.924269] systemd-logind[457]: New seat seat0. lb # [ 8.046017] ppdev: user-space parallel port driver worker1 # [ 7.916303] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 7.919818] dbus-broker-launch[519]: Ready client # [ 7.930806] systemd-logind[457]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 7.921709] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 7.925422] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 7.923959] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 7.937080] systemd-logind[457]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 7.925603] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 7.928355] systemd[1]: Stopped target User and Group Name Lookups. client # [ 7.938305] systemd-logind[457]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 7.929239] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 7.930039] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 7.928196] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.930832] systemd[1]: nscd.service: Deactivated successfully. client # [ 7.942458] systemd[1]: Started User Login Management. lb # [ 7.930740] systemd[1]: Stopping User and Group Name Lookups... lb # [ 7.931847] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 7.935133] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 7.935943] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.937376] systemd-logind[539]: New seat seat0. worker1 # [ 7.940945] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 7.938739] systemd[1]: nscd.service: Deactivated successfully. client # [ 7.951983] systemd[1]: Starting linger-users.service... lb # [ 7.939797] dbus-broker-launch[551]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.943140] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 7.943840] systemd[1]: Starting Virtual Console Setup... lb # [ 7.943250] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 7.947096] systemd-logind[539]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 7.946767] systemd-logind[552]: New seat seat0. worker1 # [ 7.949632] systemd[1]: Started User Login Management. worker1 # [ 7.950403] systemd[1]: Starting linger-users.service... worker1 # [ 7.951174] systemd-logind[539]: Watching system buttons on /dev/input/event3 (Power Button) worker1 # [ 7.960600] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 7.958413] systemd-logind[552]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 7.961642] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.959856] systemd-logind[552]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 7.963598] systemd[1]: Reached target User and Group Name Lookups. lb # [ 7.962141] dbus-broker-launch[551]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.962137] systemd[1]: Finished Post-Boot Actions. worker1 # [ 7.965292] nsncd[586]: Sep 22 22:21:57.145 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.963164] dbus-broker-launch[551]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.968173] systemd[1]: Started User Login Management. client # [ 7.990761] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 7.983226] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.989081] systemd[1]: Finished resolvconf update. worker2 # [ 7.985259] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.989775] systemd[1]: Reached target Preparation for Network. client # [ 8.001048] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 7.986310] nsncd[527]: Sep 22 22:21:56.274 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.001927] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.003369] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.995114] systemd[1]: Starting DHCP Client... client # [ 8.005132] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.005961] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 7.992800] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.997183] systemd[1]: Starting Address configuration of eth1... worker2 # [ 7.994479] systemd[1]: Starting User Login Management... lb # [ 7.997070] systemd[1]: Starting linger-users.service... worker2 # connecting to host... worker1 # [ 8.001073] systemd[1]: Starting Extra networking commands.... lb # [ 8.000528] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.013138] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.014814] dbus-broker-launch[440]: Ready client # [ 8.017162] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.013873] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.015273] systemd[1]: Finished linger-users.service. client # [ 8.029371] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.032436] systemd[1]: Finished linger-users.service. worker2 # [ 8.019604] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.022355] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.037368] dbus-broker-launch[531]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.054581] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.047430] dbus-broker-launch[531]: NSS returned no entry for 'systemd-timesync' worker2 # [ 8.048837] dbus-broker-launch[531]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.058283] dbus-broker-launch[551]: Ready worker2 # [ 8.059097] systemd[1]: Started D-Bus System Message Bus. client # [ 8.088728] systemd[1]: Finished resolvconf update. client # [ 8.092154] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.212981] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.093653] nsncd[525]: Sep 22 22:21:56.962 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.096590] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.083634] dbus-broker-launch[531]: Ready client # [ 8.098030] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.224537] ppdev: user-space parallel port driver client # [ 8.101756] systemd[1]: Starting DHCP Client... lb # [ 8.094291] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.096669] systemd[1]: Finished linger-users.service. lb # [ 8.105904] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.107836] nsncd[617]: Sep 22 22:21:56.466 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.107224] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 8.109393] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 8.110899] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 8.112939] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.115543] systemd[1]: Finished resolvconf update. worker2 # [ 8.116030] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 8.119602] systemd[1]: Reached target Preparation for Network. lb # [ 8.120445] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.121280] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.119116] systemd-logind[550]: New seat seat0. worker2 # [ 8.120892] systemd[1]: nscd.service: Deactivated successfully. lb # [ 8.124067] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.127652] network-addresses-eth1-start[617]: adding address 192.168.1.3/24... done worker2 # [ 8.126148] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.127032] systemd-logind[550]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 8.128175] systemd-logind[550]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.131356] systemd[1]: Starting DHCP Client... worker2 # [ 8.130894] systemd-logind[550]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 8.132168] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.136166] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.137454] systemd[1]: Started User Login Management. lb # [ 8.140579] systemd[1]: Starting Extra networking commands.... worker2 # [ 8.140444] systemd[1]: Starting linger-users.service... worker1 # [ 8.146237] network-addresses-eth1-start[617]: adding address 2001:db8:1::3/64... done worker1 # [ 8.151288] systemd-logind[539]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) lb # [ 8.284894] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.154561] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.159223] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.172300] systemd[1]: Finished Address configuration of eth1. client # [ 8.194154] dhcpcd[553]: dhcpcd-10.3.2 starting client # [ 8.199607] dhcpcd[561]: dev: loaded udev worker2 # [ 8.187079] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.189867] systemd[1]: Finished linger-users.service. client # [ 8.341769] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.194356] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.195312] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.196991] nsncd[598]: Sep 22 22:21:56.487 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.199243] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.205087] systemd[1]: Finished resolvconf update. worker2 # [ 8.206496] systemd[1]: Reached target Preparation for Network. lb # [ 8.208658] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.210111] systemd[1]: Starting DHCP Client... worker2 # [ 8.213933] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.215884] systemd[1]: Starting Extra networking commands.... client # [ 8.251178] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.244416] systemd-vconsole-setup[599]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.248644] systemd[1]: Finished Virtual Console Setup. worker1 # [ 8.390340] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.415720] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.277196] dhcpcd[627]: dhcpcd-10.3.2 starting worker1 # [ 8.284330] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.286832] systemd[1]: Reached target Network. worker1 # [ 8.288297] dhcpcd[686]: dev: loaded udev client # [ 8.434271] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.286398] network-addresses-eth1-start[627]: adding address 192.168.1.4/24... done client # [ 8.434948] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.291856] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.294493] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.439073] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.439889] cfg80211: failed to load regulatory.db worker1 # [ 8.296152] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.296824] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 8.298199] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.296742] network-addresses-eth1-start[627]: adding address 2001:db8:1::4/64... done worker1 # [ 8.449242] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 8.449702] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.315754] systemd[1]: Finished Address configuration of eth1. client # [ 8.334479] systemd[1]: Finished nftables firewall. client # [ 8.337287] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.464270] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.340549] systemd[1]: Starting Address configuration of eth1... client # [ 8.344714] systemd[1]: Starting Extra networking commands.... client # [ 8.481452] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.349504] dhcpcd[561]: eth0: waiting for carrier client # [ 8.350519] dhcpcd[561]: eth0: carrier acquired client # [ 8.362534] dhcpcd[561]: DUID 00:01:00:01:32:45:bc:05:52:54:00:12:34:56 client # [ 8.363476] dhcpcd[561]: eth0: IAID 00:12:34:56 client # [ 8.364622] dhcpcd[561]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.360319] network-addresses-eth1-start[644]: adding address 192.168.1.2/24... done worker2 # [ 8.359563] dhcpcd[636]: dhcpcd-10.3.2 starting worker2 # [ 8.365762] dhcpcd[690]: dev: loaded udev worker1 # [ 8.371471] systemd[1]: Finished Permit User Sessions. worker2 # [ 8.371822] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.373493] systemd[1]: Reached target Network. worker2 # [ 8.376187] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.381080] systemd[1]: Started Getty on tty1. client # [ 8.525111] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.381743] systemd[1]: Reached target Login Prompts. worker2 # [ 8.517147] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.517595] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 8.400377] network-addresses-eth1-start[583]: adding address 192.168.1.1/24... done lb # [ 8.395790] network-addresses-eth1-start[644]: adding address 2001:db8:1::2/64... done client # [ 8.412650] network-addresses-eth1-start[583]: adding address 2001:db8:1::1/64... done worker1 # [ 8.408068] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 8.424179] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.426208] systemd[1]: Finished Permit User Sessions. worker2 # [ 8.430358] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 8.445263] systemd[1]: Finished Extra networking commands.. client # [ 8.446806] systemd[1]: Reached target Network. worker2 # [ 8.433814] systemd[1]: Started Getty on tty1. lb # [ 8.569704] kvm_amd: TSC scaling supported client # [ 8.449350] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.435312] systemd[1]: Reached target Login Prompts. lb # [ 8.573266] kvm_amd: Nested Virtualization enabled lb # [ 8.573735] kvm_amd: Nested Paging enabled lb # [ 8.445079] systemd[1]: Finished Address configuration of eth1. lb # [ 8.578958] kvm_amd: LBR virtualization supported lb # [ 8.579434] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 8.583451] kvm_amd: Virtual GIF supported lb # [ 8.583875] kvm_amd: Virtual NMI enabled client # [ 8.463977] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.588626] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 8.467062] systemd[1]: Started Getty on tty1. client # [ 8.468439] systemd[1]: Reached target Login Prompts. worker2 # [ 8.604010] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.478099] dhcpcd[661]: dhcpcd-10.3.2 starting worker2 # [ 8.614607] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.615307] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.617030] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.617899] cfg80211: failed to load regulatory.db lb # [ 8.487653] dhcpcd[710]: dev: loaded udev worker1 # [ 8.641856] kvm_amd: TSC scaling supported worker1 # [ 8.642271] kvm_amd: Nested Virtualization enabled worker1 # [ 8.643384] kvm_amd: Nested Paging enabled worker1 # [ 8.644033] kvm_amd: LBR virtualization supported worker1 # [ 8.644499] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.645189] kvm_amd: Virtual GIF supported worker1 # [ 8.645785] kvm_amd: Virtual NMI enabled worker2 # [ 8.643492] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.645573] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.511395] dhcpcd[690]: eth0: waiting for carrier lb # [ 8.646037] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.512253] dhcpcd[690]: eth0: carrier acquired worker1 # [ 8.654651] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.655284] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.516819] dhcpcd[690]: DUID 00:01:00:01:32:45:bc:04:52:54:00:12:34:56 worker2 # [ 8.517877] dhcpcd[690]: eth0: IAID 00:12:34:56 worker2 # [ 8.518622] dhcpcd[690]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.658239] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 8.659084] cfg80211: failed to load regulatory.db lb # [ 8.657678] EDAC MC: Ver: 3.0.0 lb # [ 8.531282] systemd[1]: Finished Extra networking commands.. lb # [ 8.536277] systemd[1]: Reached target Network. lb # [ 8.540579] systemd[1]: Starting PostgreSQL Server... lb # [ 8.548520] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.695175] EDAC MC: Ver: 3.0.0 worker1 # [ 8.704826] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.572262] dhcpcd[686]: eth0: waiting for carrier worker1 # [ 8.573480] dhcpcd[686]: eth0: carrier acquired worker1 # [ 8.578919] dhcpcd[686]: DUID 00:01:00:01:32:45:bc:05:52:54:00:12:34:56 worker1 # [ 8.580159] dhcpcd[686]: eth0: IAID 00:12:34:56 worker1 # [ 8.580871] dhcpcd[686]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.580191] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.620431] systemd-vconsole-setup[690]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.623818] systemd[1]: Finished Virtual Console Setup. lb # [ 8.636398] systemd[1]: Finished Permit User Sessions. lb # [ 8.646184] systemd[1]: Started Getty on tty1. lb # [ 8.646868] systemd[1]: Reached target Login Prompts. lb # [ 8.824931] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.863331] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 8.864022] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 8.866812] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 8.867633] cfg80211: failed to load regulatory.db lb # [ 8.941498] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.809837] dhcpcd[710]: eth0: waiting for carrier lb # [ 8.811251] dhcpcd[710]: libudev: received NULL device lb # [ 8.812245] dhcpcd[710]: libudev: received NULL device lb # [ 8.813688] dhcpcd[710]: eth0: carrier acquired lb # [ 8.823479] dhcpcd[710]: DUID 00:01:00:01:32:45:bc:05:52:54:00:12:34:56 lb # [ 8.824632] dhcpcd[710]: eth0: IAID 00:12:34:56 lb # [ 8.825270] dhcpcd[710]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.846992] postgresql-pre-start[734]: The files belonging to this database system will be owned by user "postgres". lb # [ 8.850209] postgresql-pre-start[734]: This user must also own the server process. lb # [ 8.859378] postgresql-pre-start[734]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 8.860533] postgresql-pre-start[734]: The default database encoding has accordingly been set to "UTF8". lb # [ 8.861687] postgresql-pre-start[734]: The default text search configuration will be set to "english". lb # [ 8.862806] postgresql-pre-start[734]: Data page checksums are enabled. lb # [ 8.863741] postgresql-pre-start[734]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 8.864923] postgresql-pre-start[734]: creating subdirectories ... ok lb # [ 8.865762] postgresql-pre-start[734]: selecting dynamic shared memory implementation ... posix client # [ 8.883502] dhcpcd[561]: eth0: soliciting a DHCP lease client # [ 9.034983] NET: Registered PF_PACKET protocol family client # [ 8.907726] dhcpcd[561]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 8.910328] dhcpcd[561]: eth0: probing address 10.0.2.15/24 lb # [ 8.953942] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.959474] systemd[1]: Finished Virtual Console Setup. lb # [ 8.962853] postgresql-pre-start[734]: selecting default "max_connections" ... 100 lb # [ 9.017866] postgresql-pre-start[734]: selecting default "shared_buffers" ... 128MB client: (finished: waiting for unit network-addresses-eth1.service, in 9.75 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1 # [ 9.308342] dhcpcd[686]: eth0: soliciting a DHCP lease worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.452747] NET: Registered PF_PACKET protocol family worker1 # [ 9.323157] dhcpcd[686]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 9.325217] dhcpcd[686]: eth0: probing address 10.0.2.15/24 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 9.365386] dhcpcd[710]: eth0: soliciting a DHCP lease lb # [ 9.506975] NET: Registered PF_PACKET protocol family lb # [ 9.378431] dhcpcd[710]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 9.381157] dhcpcd[710]: eth0: probing address 10.0.2.15/24 worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service lb # [ 9.663541] postgresql-pre-start[734]: selecting default time zone ... UTC lb # [ 9.666100] postgresql-pre-start[734]: creating configuration files ... ok worker2 # [ 9.820403] dhcpcd[690]: eth0: soliciting a DHCP lease lb # [ 9.825238] postgresql-pre-start[734]: running bootstrap script ... ok worker2 # [ 9.971519] NET: Registered PF_PACKET protocol family worker2 # [ 9.845826] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.848343] dhcpcd[690]: eth0: probing address 10.0.2.15/24 worker2 # [ 9.873739] dhcpcd[690]: eth0: soliciting an IPv6 router worker2 # [ 9.876134] dhcpcd[690]: eth0: Router Advertisement from fe80::2 worker2 # [ 9.878573] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 9.880699] dhcpcd[690]: eth0: adding route to fec0::/64 worker2 # [ 9.882692] dhcpcd[690]: eth0: adding default route via fe80::2 client # [ 10.171391] dhcpcd[561]: eth0: soliciting an IPv6 router client # [ 10.174333] dhcpcd[561]: eth0: Router Advertisement from fe80::2 client # [ 10.176466] dhcpcd[561]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.178634] dhcpcd[561]: eth0: adding route to fec0::/64 client # [ 10.180498] dhcpcd[561]: eth0: adding default route via fe80::2 lb # [ 10.193932] postgresql-pre-start[734]: performing post-bootstrap initialization ... ok lb # [ 10.320482] postgresql-pre-start[734]: syncing data to disk ... ok lb # [ 10.321406] postgresql-pre-start[734]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.322594] postgresql-pre-start[734]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.324436] postgresql-pre-start[734]: Success. You can now start the database server using: lb # [ 10.325465] postgresql-pre-start[734]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker1 # [ 10.355878] dhcpcd[686]: eth0: soliciting an IPv6 router worker1 # [ 10.358422] dhcpcd[686]: eth0: Router Advertisement from fe80::2 worker1 # [ 10.360474] dhcpcd[686]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.362671] dhcpcd[686]: eth0: adding route to fec0::/64 worker1 # [ 10.364580] dhcpcd[686]: eth0: adding default route via fe80::2 lb # [ 10.396553] postgres[778]: [778] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.399246] postgres[778]: [778] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.400355] postgres[778]: [778] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.403466] postgres[778]: [778] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 10.414404] postgres[787]: [787] LOG: database system was shut down at 2026-09-22 22:21:58 GMT lb # [ 10.420676] postgres[778]: [778] LOG: database system is ready to accept connections lb # [ 10.425354] systemd[1]: Started PostgreSQL Server. lb # [ 10.431318] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 10.575639] postgresql-setup-start[802]: CREATE DATABASE lb # [ 10.602869] postgresql-setup-start[812]: CREATE ROLE lb # [ 10.614984] postgresql-setup-start[814]: ALTER DATABASE lb # [ 10.619217] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.620921] systemd[1]: Reached target PostgreSQL. lb # [ 11.154854] dhcpcd[710]: eth0: soliciting an IPv6 router lb # [ 11.156152] dhcpcd[710]: eth0: Router Advertisement from fe80::2 lb # [ 11.157085] dhcpcd[710]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.157942] dhcpcd[710]: eth0: adding route to fec0::/64 lb # [ 11.158675] dhcpcd[710]: eth0: adding default route via fe80::2 client # [ 13.987597] dhcpcd[561]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 13.989733] dhcpcd[561]: eth0: adding route to 10.0.2.0/24 client # [ 13.993073] dhcpcd[561]: eth0: adding default route via 10.0.2.2 client # [ 14.075327] systemd[1]: Started DHCP Client. client # [ 14.077604] systemd[1]: Reached target Multi-User System. client # [ 14.078627] systemd[1]: Startup finished in 850ms (kernel) + 3.668s (initrd) + 9.559s (userspace) = 14.078s. worker2 # [ 14.293712] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 14.296819] dhcpcd[690]: eth0: adding route to 10.0.2.0/24 worker2 # [ 14.299529] dhcpcd[690]: eth0: adding default route via 10.0.2.2 lb # [ 14.349954] dhcpcd[710]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 14.352637] dhcpcd[710]: eth0: adding route to 10.0.2.0/24 lb # [ 14.354901] dhcpcd[710]: eth0: adding default route via 10.0.2.2 worker2 # [ 14.387435] systemd[1]: Started DHCP Client. worker2 # [ 14.389549] systemd[1]: Reached target Multi-User System. worker2 # [ 14.390384] systemd[1]: Startup finished in 851ms (kernel) + 3.514s (initrd) + 10.023s (userspace) = 14.389s. lb # [ 14.437840] systemd[1]: Started DHCP Client. lb # [ 14.440385] systemd[1]: Reached target Network is Online. lb # [ 14.443598] systemd[1]: Started Envoy reverse proxy. lb # [ 14.447785] systemd[1]: Started mock-oidc.service. lb # [ 14.541091] mock-oidc-server[905]: Mock OIDC Server running lb # [ 14.541941] mock-oidc-server[905]: OIDC Address: 192.168.1.2:8080 lb # [ 14.543339] mock-oidc-server[905]: Issue Address: 0.0.0.0:8081 lb # [ 14.544827] mock-oidc-server[905]: Issuer: http://192.168.1.2:8080/oidc lb # [ 14.545745] mock-oidc-server[905]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 14.546776] mock-oidc-server[905]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 14.547962] mock-oidc-server[905]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 14.773363] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 14.776868] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 14.778276] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 14.780690] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 14.784569] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 14.787055] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 14.788731] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 14.790281] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 14.792120] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 14.795247] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 14.799458] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 14.801536] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 14.804086] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 14.806259] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 14.808334] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 14.811348] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 14.814992] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 14.816892] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 14.819153] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 14.821361] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 14.824055] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 14.826140] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 14.828244] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 14.830353] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 14.844088] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 14.846240] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 14.849426] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 14.852361] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 14.854664] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 14.857213] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 14.862076] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 14.863795] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 14.866702] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 14.868408] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 14.871046] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 14.879973] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 14.884373] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 14.885901] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 14.887326] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 14.891665] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 14.897758] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 14.902934] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 14.905239] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 14.908832] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 14.910325] envoy[904]: [2026-09-22 22:22:03.132][904][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 14.912052] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 14.937393] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 14.941064] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 14.943280] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 14.945637] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default worker1 # [ 14.948773] dhcpcd[686]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 14.950757] dhcpcd[686]: eth0: adding route to 10.0.2.0/24 worker1 # [ 14.953254] dhcpcd[686]: eth0: adding default route via 10.0.2.2 lb # [ 14.947276] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 14.953483] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 14.955127] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 14.960154] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 14.962482] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 14.964213] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 14.966894] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 14.969655] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 14.971296] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 14.972843] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 14.974659] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 14.976298] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 14.979636] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 14.985640] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 14.988596] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 14.994034] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 14.996307] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 14.999044] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 15.001424] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 15.004062] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 15.006044] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 15.009973] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 15.011478] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 15.014347] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 15.016455] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config worker1 # [ 15.022821] systemd[1]: Started DHCP Client. lb # [ 15.020179] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 worker1 # [ 15.024290] systemd[1]: Reached target Multi-User System. worker1 # [ 15.025161] systemd[1]: Startup finished in 855ms (kernel) + 3.675s (initrd) + 10.492s (userspace) = 15.023s. lb # [ 15.022341] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 15.025326] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 15.027214] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 15.031111] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 15.032807] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 15.035937] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.037826] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 15.039990] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 15.042384] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 15.044883] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 15.047082] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 15.048981] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 15.053797] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 15.055448] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 15.057382] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 15.064117] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 15.066330] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 15.068025] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 15.073977] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 15.075800] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 15.078811] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 15.080430] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 15.081936] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 15.092809] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 15.094660] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 15.098095] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 15.099875] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 15.102818] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 15.105126] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 15.106687] envoy[904]: [2026-09-22 22:22:03.136][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 15.108117] envoy[904]: [2026-09-22 22:22:03.197][904][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 15.109430] envoy[904]: [2026-09-22 22:22:03.198][904][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 15.123548] envoy[904]: [2026-09-22 22:22:03.198][904][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 15.124916] envoy[904]: [2026-09-22 22:22:03.198][904][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 15.132480] envoy[904]: [2026-09-22 22:22:03.198][904][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 15.136877] envoy[904]: [2026-09-22 22:22:03.496][904][info][main] [source/server/server.cc:968] runtime: {} lb # [ 15.139573] envoy[904]: [2026-09-22 22:22:03.499][904][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 15.141292] envoy[904]: [2026-09-22 22:22:03.499][904][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 15.143209] envoy[904]: [2026-09-22 22:22:03.502][904][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 15.146195] envoy[904]: [2026-09-22 22:22:03.505][904][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 15.147774] envoy[904]: [2026-09-22 22:22:03.505][904][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 15.149511] envoy[904]: [2026-09-22 22:22:03.505][904][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 15.175816] envoy[904]: [2026-09-22 22:22:03.535][904][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 15.178111] systemd[1]: Reached target Network is Online. lb # [ 15.182063] envoy[904]: [2026-09-22 22:22:03.541][904][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker1 # [ 15.184813] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 15.184698] envoy[904]: [2026-09-22 22:22:03.544][904][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker2 # [ 15.185165] systemd[1]: Starting scheduler-token.service... lb # [ 15.187843] envoy[904]: [2026-09-22 22:22:03.544][904][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 15.248578] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 15.252314] systemd[1]: Finished scheduler-token.service. worker2 # [ 15.254617] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 66ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 15.258697] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 15.311206] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 15.322592] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 15.324734] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 15.338365] nix-grpc-daemon[780]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 15.339885] nix-grpc-daemon[780]: E0000 00:00:1790115724.525460 780 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.346038] nix-grpc-daemon[780]: E0000 00:00:1790115724.533330 780 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.349055] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 15.352459] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 15.350407] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 15.360934] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 15.367074] nix-grpc-daemon[780]: E0000 00:00:1790115724.554132 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.363707] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 15.375368] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 15.377214] nix-grpc-daemon[784]: E0000 00:00:1790115723.667822 784 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 15.378921] envoy[904]: [2026-09-22 22:22:03.738][904][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 15.385619] nix-grpc-daemon[780]: E0000 00:00:1790115724.573047 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 15.383143] envoy[904]: [2026-09-22 22:22:03.742][904][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 15.383367] nix-grpc-daemon[784]: E0000 00:00:1790115723.675670 784 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.389134] nix-grpc-daemon[780]: E0000 00:00:1790115724.575283 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.386319] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 15.387481] envoy[904]: [2026-09-22 22:22:03.742][904][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 15.393370] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 15.393720] envoy[904]: [2026-09-22 22:22:03.753][904][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 15.400882] nix-grpc-daemon[780]: E0000 00:00:1790115724.588322 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.402891] nix-grpc-daemon[784]: E0000 00:00:1790115723.694526 827 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.416652] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.420117] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.421061] nix-grpc-daemon[784]: E0000 00:00:1790115723.713453 827 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.425057] nix-grpc-daemon[784]: E0000 00:00:1790115723.715815 827 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.436794] nix-grpc-daemon[784]: E0000 00:00:1790115723.729110 827 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.448576] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.450287] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.621551] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.625843] nix-grpc-daemon[780]: ts=2026-09-22T22:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.651830] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.655899] nix-grpc-daemon[784]: ts=2026-09-22T22:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.826692] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.830885] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.856934] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.860819] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.031953] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.035840] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.061696] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.065551] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.236651] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.240738] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.266897] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.270840] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.442371] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.446087] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.472922] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.476353] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.647219] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.651268] nix-grpc-daemon[780]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.674367] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.678310] nix-grpc-daemon[784]: ts=2026-09-22T22:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.851957] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.856220] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.879302] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.883218] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.057131] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.061241] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.084415] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.088364] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.262274] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.266304] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.289427] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.293215] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.467922] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.471660] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.495568] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.499126] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.672486] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.676441] nix-grpc-daemon[780]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.700252] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.704146] nix-grpc-daemon[784]: ts=2026-09-22T22:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.877386] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.881368] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.905231] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.909172] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.082325] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.087355] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.110899] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.115523] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.287329] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.291877] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.316568] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.320600] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.493741] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.497649] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.522630] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.526235] nix-grpc-daemon[784]: ts=2026-09-22T22:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.698616] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.702581] nix-grpc-daemon[780]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.727847] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.731691] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 18.740991] rustfs-bucket-start[959]: mb s3://farm lb # [ 18.750252] systemd[1]: Finished rustfs-bucket.service. lb # [ 18.758899] systemd[1]: Starting niks3 server... lb # [ 18.877522] postgres[971]: [971] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 18.878923] postgres[971]: [971] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 18.901219] niks3-server[966]: 2026/09/22 22:22:07 OK 20241026095416_initial_model.sql (13.04ms) worker1 # [ 18.903538] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 lb # [ 18.905305] niks3-server[966]: 2026/09/22 22:22:07 OK 20251210153512_drop_unused_gin_index.sql (4.33ms) worker1 # [ 18.907554] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 18.910367] niks3-server[966]: 2026/09/22 22:22:07 OK 20251218171726_add_pins.sql (5.13ms) lb # [ 18.914682] niks3-server[966]: 2026/09/22 22:22:07 OK 20260628120000_add_object_size_and_stats.sql (3.12ms) lb # [ 18.919321] niks3-server[966]: 2026/09/22 22:22:07 OK 20260905000000_add_claims.sql (4.61ms) lb # [ 18.923520] niks3-server[966]: 2026/09/22 22:22:07 OK 20260920000000_drop_claims.sql (4.08ms) lb # [ 18.924717] niks3-server[966]: 2026/09/22 22:22:07 goose: successfully migrated database to version: 20260920000000 lb # [ 18.928890] niks3-server[966]: 2026/09/22 22:22:07 OK 1_commit_pending_closure.sql (5.38ms) lb # [ 18.931684] niks3-server[966]: 2026/09/22 22:22:07 OK 2_object_stats_trigger.sql (2.84ms) lb # [ 18.932951] niks3-server[966]: 2026/09/22 22:22:07 goose: up to current file version: 2 worker2 # [ 18.932816] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 lb # [ 18.936637] niks3-server[966]: 2026/09/22 22:22:07 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key worker2 # [ 18.936662] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 18.965450] niks3-server[966]: 2026/09/22 22:22:07 INFO Read proxy enabled — serving cache objects from S3 lb # [ 18.967184] niks3-server[966]: 2026/09/22 22:22:07 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 18.970099] systemd[1]: Started niks3 server. lb # [ 18.970787] niks3-server[966]: 2026/09/22 22:22:07 INFO systemd watchdog enabled interval=15s lb # [ 18.971898] systemd[1]: Reached target Multi-User System. lb # [ 18.973980] systemd[1]: Startup finished in 850ms (kernel) + 3.624s (initrd) + 14.498s (userspace) = 18.973s. lb # [ 18.976144] niks3-server[966]: 2026/09/22 22:22:07 INFO Starting HTTP server address=0.0.0.0:5751 worker1 # [ 19.108409] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.112395] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.137233] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.139048] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.313254] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.317195] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.340253] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.344170] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 10.08 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds) lb: waiting for unit envoy.service worker1 # [ 19.519228] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.522368] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! worker2 # [ 19.546844] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_connected addr=lb:50051 lb # [ 19.550242] envoy[904]: conn peer=[::1]:51288 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker2 # [ 19.549970] nix-grpc-daemon[784]: ts=2026-09-22T22:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.656473] systemd[1]: Starting scheduler-token.service... worker2 # [ 19.702682] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 19.704384] systemd[1]: Finished scheduler-token.service. worker2 # [ 19.707161] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 48ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 19.719947] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.723993] nix-grpc-daemon[780]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.746972] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.749283] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 19.924569] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.928583] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.950768] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.954689] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.129513] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.133576] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.155879] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.159796] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.334357] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.338327] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.360742] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.364663] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.540472] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.543773] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.567279] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.570448] nix-grpc-daemon[784]: ts=2026-09-22T22:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.744677] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.748741] nix-grpc-daemon[780]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.768967] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.773118] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 20.949584] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.953739] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.974323] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.978194] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.154571] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.158647] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.179513] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.183380] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.359310] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.363232] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.384297] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.388301] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.564755] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.568660] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.590878] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.594078] nix-grpc-daemon[784]: ts=2026-09-22T22:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.769669] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.773736] nix-grpc-daemon[780]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.791902] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.795883] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 21.974566] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.978486] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.997150] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.001071] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.179345] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.183290] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.202327] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.206163] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.383934] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.387986] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.407267] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.411127] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.589533] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.593383] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.613767] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.616909] nix-grpc-daemon[784]: ts=2026-09-22T22:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.794470] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.798548] nix-grpc-daemon[780]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.815060] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.818911] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 22.999559] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.003693] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.020142] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.024130] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.204746] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.208782] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.225360] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.229243] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.409406] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.413355] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.430143] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.436274] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.615774] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.619167] nix-grpc-daemon[780]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.638858] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.642184] nix-grpc-daemon[784]: ts=2026-09-22T22:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.819828] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.823845] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.840146] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.843991] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 24.024763] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.028812] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.045295] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.049292] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.229829] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.233822] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.250466] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.254307] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.434609] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.438603] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.455162] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.458980] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.640385] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.644287] nix-grpc-daemon[780]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.661589] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.664687] nix-grpc-daemon[784]: ts=2026-09-22T22:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.845211] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.849207] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.862967] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.866928] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 25.050181] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.054233] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.068158] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.072087] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.255301] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.259289] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.273218] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.277183] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.460109] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.464066] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.478394] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.482420] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.665624] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.669394] nix-grpc-daemon[780]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.685350] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.688460] nix-grpc-daemon[784]: ts=2026-09-22T22:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.870493] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.874531] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.886300] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.890224] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 26.075572] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.079583] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.091560] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.095464] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.280099] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.281957] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.296479] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.300467] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.482420] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.484317] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.501476] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.505353] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.686154] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.689840] nix-grpc-daemon[780]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.707883] nix-grpc-daemon[784]: ts=2026-09-22T22:22:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.710986] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.890749] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.894654] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.909211] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.912994] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 27.095694] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.099952] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 27.114251] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.118161] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.300886] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.305094] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.319421] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.323238] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.506185] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.510115] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.524287] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.528122] nix-grpc-daemon[784]: ts=2026-09-22T22:22:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.711837] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.717315] nix-grpc-daemon[780]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.729611] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.733677] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.917411] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.921388] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.931841] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.935688] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 28.122320] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.126195] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.137062] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.140887] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 28.326882] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.330823] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.341991] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.345902] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.531678] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.536194] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.547199] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.551322] nix-grpc-daemon[784]: ts=2026-09-22T22:22:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.738212] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.742612] nix-grpc-daemon[780]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.754146] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.757306] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.943795] nix-grpc-daemon[780]: ts=2026-09-22T22:22:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.948330] nix-grpc-daemon[780]: ts=2026-09-22T22:22:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.955388] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.959308] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.979715] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_take_over lb # [ 28.982228] niks3-server[966]: 2026/09/22 22:22:17 INFO lead: acquired remote=192.168.1.4:53366 worker1 # [ 29.149089] nix-grpc-daemon[780]: ts=2026-09-22T22:22:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.153560] nix-grpc-daemon[780]: ts=2026-09-22T22:22:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 29.160374] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.164268] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 29.354414] nix-grpc-daemon[780]: ts=2026-09-22T22:22:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.359492] nix-grpc-daemon[780]: ts=2026-09-22T22:22:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.365638] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.369488] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.560451] nix-grpc-daemon[780]: ts=2026-09-22T22:22:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.562401] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48414 worker2 # [ 29.566907] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 29.573355] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.584533] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 29.587436] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48414 worker2 # [ 29.591598] nix-grpc-daemon[784]: ts=2026-09-22T22:22:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.91 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 30.892675] nix-grpc-daemon[784]: ts=2026-09-22T22:22:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 30.905467] systemd[1]: Started Nix Daemon. worker2 # [ 31.041806] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 31.057453] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5) worker2 # [ 31.135362] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 2/5) worker2 # [ 31.324656] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 322 ms (attempt 3/5) worker2 # [ 31.648906] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 4/5) worker2 # [ 31.808202] nix-grpc-daemon[784]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 31.817689] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 31.849143] nix-grpc-daemon[784]: ts=2026-09-22T22:22:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 31.860696] nix-grpc-daemon[784]: ts=2026-09-22T22:22:20Z level=debug event=path_info_miss path=g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test error="error: path '/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 31.882750] nix-grpc-daemon[780]: ts=2026-09-22T22:22:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 31.890699] systemd[1]: Started Nix Daemon. worker1 # [ 32.005649] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 32.021659] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5) worker1 # [ 32.102838] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 2/5) worker1 # [ 32.264537] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 314 ms (attempt 3/5) worker1 # [ 32.580516] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 671 ms (attempt 4/5) worker1 # [ 33.255811] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 33.264950] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 33.278162] nix-grpc-daemon[780]: ts=2026-09-22T22:22:22Z level=debug event=path_info_miss path=g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test error="error: path '/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.06 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 33.510273] nix-grpc-daemon[780]: ts=2026-09-22T22:22:22Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 33.514419] nix-grpc-daemon[780]: ts=2026-09-22T22:22:22Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:34180 worker1 # [ 33.527876] nix-grpc-daemon[780]: ts=2026-09-22T22:22:22Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:34180 worker1 # [ 33.537583] nix-grpc-daemon[780]: ts=2026-09-22T22:22:22Z level=debug event=path_info_miss path=g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test error="error: path '/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 33.540503] nix-grpc-daemon[784]: ts=2026-09-22T22:22:21Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48426 worker2 # [ 33.550345] nix-grpc-daemon[784]: ts=2026-09-22T22:22:21Z level=debug event=path_info_miss path=g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test error="error: path '/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker1 # [ 33.696170] nix-grpc-daemon[780]: ts=2026-09-22T22:22:22Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 33.821772] nix-grpc-daemon[784]: ts=2026-09-22T22:22:22Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.16 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 33.993803] nix-grpc-daemon[784]: ts=2026-09-22T22:22:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48426 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 34.007811] nix-grpc-daemon[780]: ts=2026-09-22T22:22:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 34.031160] nix-grpc-daemon[784]: ts=2026-09-22T22:22:22Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 34.035152] nix-grpc-daemon[784]: ts=2026-09-22T22:22:22Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 34.094700] nix-grpc-daemon[780]: ts=2026-09-22T22:22:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 34.112073] nix-grpc-daemon[780]: ts=2026-09-22T22:22:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 client # copying 1 paths to 'lb:50051'... worker1 # [ 34.127209] nix-grpc-daemon[780]: ts=2026-09-22T22:22:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 34.149496] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 34.174252] nix-grpc-daemon[780]: ts=2026-09-22T22:22:23Z level=info event=niks3_push_started pid=858 worker1 # [ 34.323416] nix-grpc-daemon[858]: time=2026-09-22T22:22:23.510Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 34.418095] nix-daemon[846]: accepted connection from pid 872, user nix-grpc-daemon (trusted) worker1 # [ 34.432355] nix-daemon[846]: reaped child process 875, status = succeeded lb # [ 34.438747] niks3-server[966]: 2026/09/22 22:22:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 34.453174] nix-grpc-daemon[858]: time=2026-09-22T22:22:23.640Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 34.454932] nix-grpc-daemon[858]: time=2026-09-22T22:22:23.642Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 34.481535] niks3-server[966]: 2026/09/22 22:22:22 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 34.485096] niks3-server[966]: 2026/09/22 22:22:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 34.491721] niks3-server[966]: 2026/09/22 22:22:22 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 34.500245] niks3-server[966]: 2026/09/22 22:22:22 INFO Signed narinfos id=1 count=1 worker1 # [ 34.504840] nix-grpc-daemon[858]: time=2026-09-22T22:22:23.691Z level=INFO msg="Uploading 1 narinfos" lb # [ 34.506867] niks3-server[966]: 2026/09/22 22:22:22 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 34.518115] niks3-server[966]: 2026/09/22 22:22:22 INFO Completed upload id=1 worker1 # [ 34.520829] nix-grpc-daemon[858]: time=2026-09-22T22:22:23.708Z level=INFO msg="Upload complete. (192ms)" worker1 # [ 34.523276] nix-grpc-daemon[780]: ts=2026-09-22T22:22:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 34.524052] niks3-server[966]: 2026/09/22 22:22:22 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker1 # [ 34.526848] nix-grpc-daemon[780]: ts=2026-09-22T22:22:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 34.532793] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 34.539128] nix-daemon[846]: reaped child process 856, status = succeeded worker1 # [ 34.542236] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 35.156248] nix-daemon[846]: reaped child process 879, status = succeeded lb # [ 35.180579] envoy[904]: conn peer=[2001:db8:1::1]:50678 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=2410 lb # [ 35.184321] envoy[904]: conn peer=[2001:db8:1::1]:58420 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=61 lb # [ 35.187640] envoy[904]: conn peer=[2001:db8:1::1]:58436 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=7 lb # [ 35.191466] envoy[904]: conn peer=[2001:db8:1::1]:58440 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 worker1 # [ 35.233272] nix-daemon[846]: accepted connection from pid 895, user nix-grpc-daemon (trusted) worker1 # [ 35.245388] nix-daemon[846]: reaped child process 898, status = succeeded lb # [ 35.249613] niks3-server[966]: 2026/09/22 22:22:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.263580] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.451Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 35.265287] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.452Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 35.296727] niks3-server[966]: 2026/09/22 22:22:23 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 35.301586] niks3-server[966]: 2026/09/22 22:22:23 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 35.308980] niks3-server[966]: 2026/09/22 22:22:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 35.315098] niks3-server[966]: 2026/09/22 22:22:23 INFO Signed narinfos id=2 count=1 worker1 # [ 35.317795] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.318910] niks3-server[966]: 2026/09/22 22:22:23 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 35.325143] niks3-server[966]: 2026/09/22 22:22:23 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 35.333439] niks3-server[966]: 2026/09/22 22:22:23 INFO Completed upload id=2 worker1 # [ 35.336792] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.523Z level=INFO msg="Upload complete. (187ms)" lb # [ 35.335604] niks3-server[966]: 2026/09/22 22:22:23 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker1 # [ 35.342758] nix-grpc-daemon[780]: ts=2026-09-22T22:22:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker2 # [ 35.349831] nix-grpc-daemon[784]: ts=2026-09-22T22:22:23Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker1 # [ 35.356234] nix-daemon[846]: reaped child process 877, status = succeeded worker2 # [ 35.354184] nix-grpc-daemon[784]: ts=2026-09-22T22:22:23Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 35.397633] nix-grpc-daemon[780]: ts=2026-09-22T22:22:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 35.411368] nix-grpc-daemon[780]: ts=2026-09-22T22:22:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 35.426365] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.613Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 35.435732] nix-grpc-daemon[780]: ts=2026-09-22T22:22:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 35.455100] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 35.554538] nix-daemon[846]: accepted connection from pid 902, user nix-grpc-daemon (trusted) worker1 # [ 35.569103] nix-daemon[846]: reaped child process 905, status = succeeded lb # [ 35.576460] niks3-server[966]: 2026/09/22 22:22:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.585683] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.773Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 35.587331] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.774Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 35.607400] niks3-server[966]: 2026/09/22 22:22:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 35.613331] niks3-server[966]: 2026/09/22 22:22:23 INFO Signed narinfos id=3 count=1 worker1 # [ 35.619268] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.806Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.622558] niks3-server[966]: 2026/09/22 22:22:23 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 35.629880] niks3-server[966]: 2026/09/22 22:22:23 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 35.640349] niks3-server[966]: 2026/09/22 22:22:23 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 35.646592] niks3-server[966]: 2026/09/22 22:22:24 INFO Completed upload id=3 worker1 # [ 35.651649] nix-grpc-daemon[858]: time=2026-09-22T22:22:24.839Z level=INFO msg="Upload complete. (183ms)" lb # [ 35.651764] niks3-server[966]: 2026/09/22 22:22:24 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 35.656981] nix-grpc-daemon[780]: ts=2026-09-22T22:22:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 35.664373] nix-grpc-daemon[780]: ts=2026-09-22T22:22:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 35.676107] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 35.681807] nix-daemon[846]: reaped child process 900, status = succeeded worker1 # [ 35.686854] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 37.123541] nix-daemon[846]: reaped child process 909, status = succeeded worker1 # [ 37.209784] nix-daemon[846]: accepted connection from pid 925, user nix-grpc-daemon (trusted) worker1 # [ 37.223127] nix-daemon[846]: reaped child process 928, status = succeeded lb # [ 37.228637] niks3-server[966]: 2026/09/22 22:22:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.240184] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.427Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 37.241861] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.429Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 37.267933] niks3-server[966]: 2026/09/22 22:22:25 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 37.277627] niks3-server[966]: 2026/09/22 22:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 37.285855] niks3-server[966]: 2026/09/22 22:22:25 INFO Signed narinfos id=4 count=1 worker1 # [ 37.291374] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.478Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.294111] niks3-server[966]: 2026/09/22 22:22:25 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 37.298513] niks3-server[966]: 2026/09/22 22:22:25 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 37.308095] niks3-server[966]: 2026/09/22 22:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 37.314280] niks3-server[966]: 2026/09/22 22:22:25 INFO Completed upload id=4 lb # [ 37.315829] niks3-server[966]: 2026/09/22 22:22:25 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 37.318522] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.505Z level=INFO msg="Upload complete. (221ms)" worker1 # [ 37.321747] nix-grpc-daemon[780]: ts=2026-09-22T22:22:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 37.333389] nix-daemon[846]: reaped child process 907, status = succeeded worker2 # [ 37.327278] nix-grpc-daemon[784]: ts=2026-09-22T22:22:25Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 37.331395] nix-grpc-daemon[784]: ts=2026-09-22T22:22:25Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 37.373998] nix-grpc-daemon[780]: ts=2026-09-22T22:22:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 37.383816] nix-grpc-daemon[780]: ts=2026-09-22T22:22:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 37.435395] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.622Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 37.444709] nix-grpc-daemon[780]: ts=2026-09-22T22:22:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 37.468858] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 37.572359] nix-daemon[846]: accepted connection from pid 933, user nix-grpc-daemon (trusted) worker1 # [ 37.586042] nix-daemon[846]: reaped child process 936, status = succeeded lb # [ 37.589826] niks3-server[966]: 2026/09/22 22:22:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.601821] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.789Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 37.603309] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.790Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 37.615852] niks3-server[966]: 2026/09/22 22:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 37.618566] niks3-server[966]: 2026/09/22 22:22:25 INFO Signed narinfos id=5 count=1 worker1 # [ 37.623258] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.810Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.626140] niks3-server[966]: 2026/09/22 22:22:25 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 37.628912] niks3-server[966]: 2026/09/22 22:22:25 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 37.633849] niks3-server[966]: 2026/09/22 22:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 37.637706] niks3-server[966]: 2026/09/22 22:22:25 INFO Completed upload id=5 worker1 # [ 37.640326] nix-grpc-daemon[858]: time=2026-09-22T22:22:26.827Z level=INFO msg="Upload complete. (157ms)" lb # [ 37.639152] niks3-server[966]: 2026/09/22 22:22:25 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 37.642521] nix-grpc-daemon[780]: ts=2026-09-22T22:22:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 37.647060] nix-grpc-daemon[780]: ts=2026-09-22T22:22:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 37.652285] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 37.654714] nix-daemon[846]: reaped child process 931, status = succeeded worker1 # [ 37.659703] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 38.696672] nix-daemon[846]: reaped child process 940, status = succeeded worker1 # [ 38.781465] nix-daemon[846]: accepted connection from pid 956, user nix-grpc-daemon (trusted) worker1 # [ 38.794233] nix-daemon[846]: reaped child process 959, status = succeeded lb # [ 38.800548] niks3-server[966]: 2026/09/22 22:22:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.813450] nix-grpc-daemon[858]: time=2026-09-22T22:22:28.000Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 38.815234] nix-grpc-daemon[858]: time=2026-09-22T22:22:28.002Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 38.846234] niks3-server[966]: 2026/09/22 22:22:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 38.862485] nix-grpc-daemon[858]: time=2026-09-22T22:22:28.049Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.859481] niks3-server[966]: 2026/09/22 22:22:27 INFO Signed narinfos id=6 count=1 lb # [ 38.864090] niks3-server[966]: 2026/09/22 22:22:27 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 38.874348] niks3-server[966]: 2026/09/22 22:22:27 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 38.884396] niks3-server[966]: 2026/09/22 22:22:27 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 38.888814] niks3-server[966]: 2026/09/22 22:22:27 INFO Completed upload id=6 lb # [ 38.891614] niks3-server[966]: 2026/09/22 22:22:27 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 38.893637] nix-grpc-daemon[858]: time=2026-09-22T22:22:28.081Z level=INFO msg="Upload complete. (226ms)" lb # [ 38.894423] niks3-server[966]: 2026/09/22 22:22:27 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst worker1 # [ 38.899807] nix-grpc-daemon[780]: ts=2026-09-22T22:22:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 38.914921] nix-daemon[846]: reaped child process 938, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.09 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 5.43 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 39.755109] nix-grpc-daemon[780]: ts=2026-09-22T22:22:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 39.771935] nix-grpc-daemon[780]: ts=2026-09-22T22:22:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 39.783980] nix-grpc-daemon[858]: time=2026-09-22T22:22:28.971Z level=INFO msg="All 2 paths already cached" worker2 # [ 39.796928] nix-grpc-daemon[784]: ts=2026-09-22T22:22:28Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.21 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.82 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 40.371236] nix-grpc-daemon[780]: ts=2026-09-22T22:22:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 40.371560] nix-grpc-daemon[784]: ts=2026-09-22T22:22:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 40.396651] nix-grpc-daemon[784]: ts=2026-09-22T22:22:28Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker1 # [ 40.403732] nix-grpc-daemon[780]: ts=2026-09-22T22:22:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 40.401643] nix-grpc-daemon[784]: ts=2026-09-22T22:22:28Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 40.415190] nix-grpc-daemon[780]: ts=2026-09-22T22:22:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 40.428547] nix-grpc-daemon[858]: time=2026-09-22T22:22:29.615Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 40.437283] nix-grpc-daemon[780]: ts=2026-09-22T22:22:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 40.447944] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 40.574990] nix-daemon[846]: accepted connection from pid 976, user nix-grpc-daemon (trusted) worker1 # [ 40.594599] nix-daemon[846]: reaped child process 979, status = succeeded lb # [ 40.599955] niks3-server[966]: 2026/09/22 22:22:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.613860] nix-grpc-daemon[858]: time=2026-09-22T22:22:29.801Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.615266] nix-grpc-daemon[858]: time=2026-09-22T22:22:29.801Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 40.641046] niks3-server[966]: 2026/09/22 22:22:29 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 40.648685] niks3-server[966]: 2026/09/22 22:22:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 40.657498] nix-grpc-daemon[858]: time=2026-09-22T22:22:29.844Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.655874] niks3-server[966]: 2026/09/22 22:22:29 INFO Signed narinfos id=7 count=1 lb # [ 40.660547] niks3-server[966]: 2026/09/22 22:22:29 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 40.667895] niks3-server[966]: 2026/09/22 22:22:29 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 40.675896] niks3-server[966]: 2026/09/22 22:22:29 INFO Completed upload id=7 worker1 # [ 40.678703] nix-grpc-daemon[858]: time=2026-09-22T22:22:29.866Z level=INFO msg="Upload complete. (216ms)" lb # [ 40.678349] niks3-server[966]: 2026/09/22 22:22:29 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 40.682708] nix-grpc-daemon[780]: ts=2026-09-22T22:22:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 40.687902] nix-grpc-daemon[780]: ts=2026-09-22T22:22:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 40.696458] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 40.707096] nix-daemon[846]: reaped child process 974, status = succeeded worker1 # [ 40.709983] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 41.726221] nix-daemon[846]: reaped child process 984, status = succeeded worker1 # [ 41.802122] nix-daemon[846]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker1 # [ 41.815786] nix-daemon[846]: reaped child process 1003, status = succeeded lb # [ 41.820147] niks3-server[966]: 2026/09/22 22:22:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.830353] nix-grpc-daemon[858]: time=2026-09-22T22:22:31.017Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 41.835051] nix-grpc-daemon[858]: time=2026-09-22T22:22:31.019Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 41.859657] niks3-server[966]: 2026/09/22 22:22:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 41.874423] nix-grpc-daemon[858]: time=2026-09-22T22:22:31.061Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.872146] niks3-server[966]: 2026/09/22 22:22:30 INFO Signed narinfos id=8 count=1 lb # [ 41.874656] niks3-server[966]: 2026/09/22 22:22:30 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 41.881623] niks3-server[966]: 2026/09/22 22:22:30 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 41.886433] niks3-server[966]: 2026/09/22 22:22:30 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 41.897516] niks3-server[966]: 2026/09/22 22:22:30 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 41.903733] niks3-server[966]: 2026/09/22 22:22:30 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo lb # [ 41.906120] niks3-server[966]: 2026/09/22 22:22:30 INFO Completed upload id=8 worker1 # [ 41.910332] nix-grpc-daemon[858]: time=2026-09-22T22:22:31.097Z level=INFO msg="Upload complete. (192ms)" worker1 # [ 41.916653] nix-grpc-daemon[780]: ts=2026-09-22T22:22:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 41.931294] nix-daemon[846]: reaped child process 982, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.75 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.07 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 42.297277] nix-grpc-daemon[780]: ts=2026-09-22T22:22:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 42.299303] nix-grpc-daemon[784]: ts=2026-09-22T22:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 42.318833] nix-grpc-daemon[784]: ts=2026-09-22T22:22:30Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 42.325148] nix-grpc-daemon[784]: ts=2026-09-22T22:22:30Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 42.329861] nix-grpc-daemon[784]: ts=2026-09-22T22:22:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 42.340982] nix-grpc-daemon[784]: ts=2026-09-22T22:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker2 # [ 42.353101] nix-grpc-daemon[784]: ts=2026-09-22T22:22:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 42.364794] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 42.384957] nix-grpc-daemon[784]: ts=2026-09-22T22:22:30Z level=info event=niks3_push_started pid=923 worker2 # [ 42.513644] nix-grpc-daemon[923]: time=2026-09-22T22:22:30.805Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 42.605409] nix-daemon[869]: accepted connection from pid 936, user nix-grpc-daemon (trusted) worker2 # [ 42.618462] nix-daemon[869]: reaped child process 939, status = succeeded lb # [ 42.626855] niks3-server[966]: 2026/09/22 22:22:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.633464] nix-grpc-daemon[923]: time=2026-09-22T22:22:30.925Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 42.634931] nix-grpc-daemon[923]: time=2026-09-22T22:22:30.927Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 42.662385] niks3-server[966]: 2026/09/22 22:22:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 42.668276] niks3-server[966]: 2026/09/22 22:22:31 INFO Signed narinfos id=9 count=1 worker2 # [ 42.670853] nix-grpc-daemon[923]: time=2026-09-22T22:22:30.962Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.678546] niks3-server[966]: 2026/09/22 22:22:31 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 42.684854] niks3-server[966]: 2026/09/22 22:22:31 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 42.698482] niks3-server[966]: 2026/09/22 22:22:31 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 42.707066] niks3-server[966]: 2026/09/22 22:22:31 INFO Completed upload id=9 worker2 # [ 42.705382] nix-grpc-daemon[923]: time=2026-09-22T22:22:30.997Z level=INFO msg="Upload complete. (187ms)" lb # [ 42.710683] niks3-server[966]: 2026/09/22 22:22:31 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker2 # [ 42.709667] nix-grpc-daemon[784]: ts=2026-09-22T22:22:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 42.715676] nix-grpc-daemon[784]: ts=2026-09-22T22:22:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 42.724592] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 42.731691] nix-daemon[869]: reaped child process 921, status = succeeded worker2 # [ 42.734535] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker2 # [ 43.953244] nix-daemon[869]: reaped child process 943, status = succeeded worker2 # [ 44.023291] nix-daemon[869]: accepted connection from pid 959, user nix-grpc-daemon (trusted) worker2 # [ 44.035842] nix-daemon[869]: reaped child process 962, status = succeeded lb # [ 44.045416] niks3-server[966]: 2026/09/22 22:22:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.052782] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.345Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 44.054505] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.346Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 44.090345] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 44.099097] niks3-server[966]: 2026/09/22 22:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 44.103092] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls worker2 # [ 44.109800] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.401Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.111867] niks3-server[966]: 2026/09/22 22:22:32 INFO Signed narinfos id=10 count=1 lb # [ 44.114457] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 44.125626] niks3-server[966]: 2026/09/22 22:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 44.129444] niks3-server[966]: 2026/09/22 22:22:32 INFO Completed upload id=10 worker2 # [ 44.128131] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.420Z level=INFO msg="Upload complete. (186ms)" lb # [ 44.133616] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 44.135612] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 44.146380] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker2 # [ 44.150669] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 44.161120] nix-daemon[869]: reaped child process 941, status = succeeded worker2 # [ 44.194338] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 44.207426] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 44.219867] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.512Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker2 # [ 44.228632] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 44.236729] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 44.335069] nix-daemon[869]: accepted connection from pid 968, user nix-grpc-daemon (trusted) worker2 # [ 44.350189] nix-daemon[869]: reaped child process 971, status = succeeded lb # [ 44.356828] niks3-server[966]: 2026/09/22 22:22:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.363187] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.655Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 44.364848] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.657Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 44.388545] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 44.396078] niks3-server[966]: 2026/09/22 22:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 44.400366] niks3-server[966]: 2026/09/22 22:22:32 INFO Signed narinfos id=11 count=1 worker2 # [ 44.401848] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.694Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.411488] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 44.419794] niks3-server[966]: 2026/09/22 22:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 44.425656] niks3-server[966]: 2026/09/22 22:22:32 INFO Completed upload id=11 worker2 # [ 44.424281] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.716Z level=INFO msg="Upload complete. (174ms)" worker2 # [ 44.428235] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 44.433679] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 44.434092] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 44.443488] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 44.450115] nix-daemon[869]: reaped child process 966, status = succeeded worker2 # [ 44.453250] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 45.180888] envoy[904]: conn peer=[2001:db8:1::1]:58456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9464 tx=4327 ms=4924 lb # [ 45.184735] envoy[904]: conn peer=[2001:db8:1::1]:58462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=59 lb # [ 45.188216] envoy[904]: conn peer=[2001:db8:1::1]:58468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4135 tx=1881 ms=1557 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker2 # [ 45.869518] nix-daemon[869]: reaped child process 975, status = succeeded worker2 # [ 45.943516] nix-daemon[869]: accepted connection from pid 991, user nix-grpc-daemon (trusted) worker2 # [ 45.956751] nix-daemon[869]: reaped child process 994, status = succeeded lb # [ 45.965769] niks3-server[966]: 2026/09/22 22:22:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.973677] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.265Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 45.975674] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.267Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 46.003123] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 46.009809] niks3-server[966]: 2026/09/22 22:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker2 # [ 46.016282] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.308Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.018122] niks3-server[966]: 2026/09/22 22:22:34 INFO Signed narinfos id=12 count=1 lb # [ 46.020247] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 46.026304] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 46.034477] niks3-server[966]: 2026/09/22 22:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 46.038693] niks3-server[966]: 2026/09/22 22:22:34 INFO Completed upload id=12 worker2 # [ 46.037257] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.329Z level=INFO msg="Upload complete. (176ms)" lb # [ 46.040509] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 46.043094] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 46.052619] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker2 # [ 46.056677] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.064348] nix-daemon[869]: reaped child process 973, status = succeeded worker2 # [ 46.097413] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 46.109578] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 46.122891] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.415Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker2 # [ 46.131930] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 46.140334] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 46.236081] nix-daemon[869]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker2 # [ 46.249753] nix-daemon[869]: reaped child process 1003, status = succeeded lb # [ 46.257293] niks3-server[966]: 2026/09/22 22:22:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.263594] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.556Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 46.265042] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.557Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 46.290305] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 46.296382] niks3-server[966]: 2026/09/22 22:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 46.301359] niks3-server[966]: 2026/09/22 22:22:34 INFO Signed narinfos id=13 count=1 worker2 # [ 46.302904] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.595Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.316938] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 46.323884] niks3-server[966]: 2026/09/22 22:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 46.328220] niks3-server[966]: 2026/09/22 22:22:34 INFO Completed upload id=13 worker2 # [ 46.328319] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.620Z level=INFO msg="Upload complete. (176ms)" lb # [ 46.331253] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 46.332491] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 46.337331] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 46.347891] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 46.353132] nix-daemon[869]: reaped child process 998, status = succeeded worker2 # [ 46.358092] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker2 # [ 47.773522] nix-daemon[869]: reaped child process 1007, status = succeeded worker2 # [ 47.848829] nix-daemon[869]: accepted connection from pid 1023, user nix-grpc-daemon (trusted) worker2 # [ 47.863591] nix-daemon[869]: reaped child process 1026, status = succeeded lb # [ 47.872702] niks3-server[966]: 2026/09/22 22:22:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.878072] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.170Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.881055] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.172Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 47.910565] niks3-server[966]: 2026/09/22 22:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 47.917933] niks3-server[966]: 2026/09/22 22:22:36 INFO Signed narinfos id=14 count=1 worker2 # [ 47.919735] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.212Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.924314] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 47.929415] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 47.943335] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 47.946910] niks3-server[966]: 2026/09/22 22:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 47.950990] niks3-server[966]: 2026/09/22 22:22:36 INFO Completed upload id=14 worker2 # [ 47.949573] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.242Z level=INFO msg="Upload complete. (184ms)" lb # [ 47.953202] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker2 # [ 47.955242] nix-grpc-daemon[784]: ts=2026-09-22T22:22:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker2 # [ 47.967555] nix-daemon[869]: reaped child process 1005, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.83 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 48.216892] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:55794 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 48.242981] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:55794 worker1 # [ 48.249976] nix-grpc-daemon[780]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 48.264320] nix-grpc-daemon[780]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 48.275983] nix-grpc-daemon[780]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.20 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 48.420941] nix-grpc-daemon[784]: ts=2026-09-22T22:22:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:56810 worker2 # [ 48.427643] nix-grpc-daemon[784]: ts=2026-09-22T22:22:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:56810 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.18 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/856" client # removing stale temporary roots file "/nix/var/nix/temproots/878" client # removing stale temporary roots file "/nix/var/nix/temproots/901" client # removing stale temporary roots file "/nix/var/nix/temproots/864" client # removing stale temporary roots file "/nix/var/nix/temproots/806" client # removing stale temporary roots file "/nix/var/nix/temproots/886" client # removing stale temporary roots file "/nix/var/nix/temproots/844" client # removing stale temporary roots file "/nix/var/nix/temproots/823" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker1 # [ 48.732361] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 48.739915] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 48.750749] nix-grpc-daemon[858]: time=2026-09-22T22:22:37.936Z level=INFO msg="All 1 paths already cached" worker1 # [ 48.755269] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 48.754294] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48426 worker1 # [ 48.766113] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 client # copying 3 paths... worker2 # [ 48.771537] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48426 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 48.791844] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 48.797351] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 48.794281] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 48.799870] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 48.806147] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 48.809747] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.41 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 6.73 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 48.937307] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: ae6abc0dc4134ad7a0ba5f78b2891d92 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 49.065067] nix[954]: don't know how to build these paths: client # [ 49.065955] nix[954]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 49.053770] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 49.059938] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 49.066127] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 49.064402] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.077985] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 client # [ 49.098080] nix[954]: copying 1 paths to 'lb:50051'... client # [ 49.099248] nix[954]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 49.089571] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 49.100297] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 49.204228] nix-daemon[846]: accepted connection from pid 1010, user nix-grpc-daemon (trusted) worker1 # [ 49.217560] nix-daemon[846]: reaped child process 1013, status = succeeded lb # [ 49.222391] niks3-server[966]: 2026/09/22 22:22:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.234105] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.421Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 49.235616] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.423Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 49.255349] niks3-server[966]: 2026/09/22 22:22:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 49.261970] niks3-server[966]: 2026/09/22 22:22:37 INFO Signed narinfos id=15 count=1 worker1 # [ 49.268028] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.455Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.272211] niks3-server[966]: 2026/09/22 22:22:37 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 49.284119] niks3-server[966]: 2026/09/22 22:22:37 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 49.290354] niks3-server[966]: 2026/09/22 22:22:37 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 49.297162] niks3-server[966]: 2026/09/22 22:22:37 INFO Completed upload id=15 worker1 # [ 49.299785] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.487Z level=INFO msg="Upload complete. (187ms)" worker1 # [ 49.306300] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 49.305991] niks3-server[966]: 2026/09/22 22:22:37 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 49.312866] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 49.324237] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 49.331195] nix-daemon[846]: reaped child process 1008, status = succeeded worker1 # [ 49.336724] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # [ 49.346597] nix[954]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 49.991973] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 2b3ac724bc9a46d78484ed69d951d18b client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds) client: must succeed: sleep 2 client # [ 50.164313] nix[970]: don't know how to build these paths: worker2 # [ 50.147419] nix-grpc-daemon[784]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48426 client # [ 50.165179] nix[970]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 50.160408] nix-grpc-daemon[784]: ts=2026-09-22T22:22:38Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 50.167076] nix-grpc-daemon[780]: ts=2026-09-22T22:22:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 client # [ 50.179757] nix[970]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: (finished: must succeed: sleep 2, in 2.05 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 52.357492] nix-daemon[846]: reaped child process 1017, status = succeeded worker1 # [ 52.440361] nix-daemon[846]: accepted connection from pid 1043, user nix-grpc-daemon (trusted) worker1 # [ 52.455653] nix-daemon[846]: reaped child process 1046, status = succeeded lb # [ 52.464421] niks3-server[966]: 2026/09/22 22:22:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.474146] nix-grpc-daemon[858]: time=2026-09-22T22:22:41.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.475625] nix-grpc-daemon[858]: time=2026-09-22T22:22:41.663Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 52.510388] niks3-server[966]: 2026/09/22 22:22:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 52.518118] niks3-server[966]: 2026/09/22 22:22:40 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 52.527288] nix-grpc-daemon[858]: time=2026-09-22T22:22:41.714Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.524365] niks3-server[966]: 2026/09/22 22:22:40 INFO Signed narinfos id=16 count=1 lb # [ 52.535088] niks3-server[966]: 2026/09/22 22:22:40 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 52.559562] niks3-server[966]: 2026/09/22 22:22:40 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 52.578833] niks3-server[966]: 2026/09/22 22:22:40 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst worker1 # [ 52.859398] nix-grpc-daemon[858]: time=2026-09-22T22:22:42.046Z level=INFO msg="Upload complete. (513ms)" lb # [ 52.856621] niks3-server[966]: 2026/09/22 22:22:41 INFO Completed upload id=16 worker1 # [ 52.864183] nix-grpc-daemon[780]: ts=2026-09-22T22:22:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 52.866920] nix-grpc-daemon[780]: ts=2026-09-22T22:22:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=2 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 52.873974] nix-daemon[846]: reaped child process 1015, status = succeeded lb # [ 52.869604] niks3-server[966]: 2026/09/22 22:22:41 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo client # [ 52.909386] systemd[1]: dedup1.service: Deactivated successfully. client # [ 52.913363] systemd[1]: dedup1.service: Consumed 114ms CPU time over 3.975s wall clock time, 41.5M memory peak, 7.2K incoming IP traffic, 8.5K outgoing IP traffic. client # [ 52.948394] systemd[1]: dedup2.service: Deactivated successfully. client # [ 52.950534] systemd[1]: dedup2.service: Consumed 135ms CPU time over 2.956s wall clock time, 35.4M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 4.66 seconds) subtest: --timeout and --max-silent-time reach the builder worker1 # [ 53.711553] nix-grpc-daemon[780]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 53.723975] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 53.730220] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 53.734695] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 53.746222] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 53.757480] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 53.768659] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 53.866664] nix-daemon[869]: accepted connection from pid 1053, user nix-grpc-daemon (trusted) worker2 # [ 53.880599] nix-daemon[869]: reaped child process 1056, status = succeeded lb # [ 53.889347] niks3-server[966]: 2026/09/22 22:22:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 53.895790] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.188Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 53.897702] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.189Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 53.919812] niks3-server[966]: 2026/09/22 22:22:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 53.926630] niks3-server[966]: 2026/09/22 22:22:42 INFO Signed narinfos id=17 count=1 worker2 # [ 53.928843] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.221Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.932320] niks3-server[966]: 2026/09/22 22:22:42 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 53.947086] niks3-server[966]: 2026/09/22 22:22:42 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 53.953140] niks3-server[966]: 2026/09/22 22:22:42 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 53.959435] niks3-server[966]: 2026/09/22 22:22:42 INFO Completed upload id=17 worker2 # [ 53.958092] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.250Z level=INFO msg="Upload complete. (177ms)" lb # [ 53.962438] niks3-server[966]: 2026/09/22 22:22:42 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 53.962693] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 53.967231] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 53.977586] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 53.984997] nix-daemon[869]: reaped child process 1051, status = succeeded worker2 # [ 53.987860] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) lb # [ 55.182345] envoy[904]: conn peer=[2001:db8:1::1]:58478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9537 tx=4372 ms=5678 lb # [ 55.186105] envoy[904]: conn peer=[2001:db8:1::1]:58790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1108 tx=2930 ms=149 lb # [ 55.189603] envoy[904]: conn peer=[2001:db8:1::1]:58802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=75 lb # [ 55.192945] envoy[904]: conn peer=[2001:db8:1::1]:58798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=89 lb # [ 55.196379] envoy[904]: conn peer=[2001:db8:1::1]:58800 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=84 lb # [ 55.200293] envoy[904]: conn peer=[2001:db8:1::1]:58810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3011 tx=1536 ms=3825 lb # [ 55.203744] envoy[904]: conn peer=[2001:db8:1::1]:58822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=2778 worker2 # [ 59.599233] nix-grpc-daemon[784]: ts=2026-09-22T22:22:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=5 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker2 # [ 59.615798] nix-daemon[869]: reaped child process 1060, status = succeeded worker2 # [ 59.616988] nix-daemon[869]: reaped child process 1058, status = succeeded worker1 # [ 59.805775] nix-grpc-daemon[780]: ts=2026-09-22T22:22:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 59.809910] nix-grpc-daemon[784]: ts=2026-09-22T22:22:48Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker1 # [ 59.816428] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 59.814549] nix-grpc-daemon[784]: ts=2026-09-22T22:22:48Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 59.828775] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 59.839622] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 59.851445] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 59.965572] nix-daemon[846]: accepted connection from pid 1059, user nix-grpc-daemon (trusted) worker1 # [ 59.982407] nix-daemon[846]: reaped child process 1062, status = succeeded lb # [ 59.987393] niks3-server[966]: 2026/09/22 22:22:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.998210] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.185Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.000240] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.187Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 60.019261] niks3-server[966]: 2026/09/22 22:22:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker1 # [ 60.027706] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.215Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.024811] niks3-server[966]: 2026/09/22 22:22:48 INFO Signed narinfos id=18 count=1 lb # [ 60.042802] niks3-server[966]: 2026/09/22 22:22:48 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 60.047654] niks3-server[966]: 2026/09/22 22:22:48 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 60.059053] niks3-server[966]: 2026/09/22 22:22:48 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 60.062312] niks3-server[966]: 2026/09/22 22:22:48 INFO Completed upload id=18 worker1 # [ 60.066695] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.254Z level=INFO msg="Upload complete. (203ms)" lb # [ 60.066665] niks3-server[966]: 2026/09/22 22:22:48 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 60.071472] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 60.077524] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 60.091113] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 60.099161] nix-daemon[846]: reaped child process 1057, status = succeeded worker1 # [ 60.104260] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) lb # [ 65.182333] envoy[904]: conn peer=[2001:db8:1::1]:45076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=959 ms=5945 worker1 # [ 65.917839] nix-grpc-daemon[780]: ts=2026-09-22T22:22:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker1 # [ 65.930748] nix-daemon[846]: reaped child process 1064, status = succeeded worker1 # [ 65.932092] nix-daemon[846]: reaped child process 1066, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 12.52 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 66.139951] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: fd1b6042b5b941639a7460bf036ff451 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 66.280587] nix[1043]: don't know how to build these paths: client # [ 66.281497] nix[1043]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 66.265141] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 66.275483] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 66.282543] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 66.287305] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 66.295191] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 client # [ 66.320072] nix[1043]: copying 1 paths to 'lb:50051'... client # [ 66.320840] nix[1043]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 66.306171] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 66.317945] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 66.413939] nix-daemon[869]: accepted connection from pid 1087, user nix-grpc-daemon (trusted) worker2 # [ 66.426704] nix-daemon[869]: reaped child process 1090, status = succeeded lb # [ 66.436378] niks3-server[966]: 2026/09/22 22:22:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 66.443578] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.735Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 66.444960] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.735Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 66.472241] niks3-server[966]: 2026/09/22 22:22:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 66.478886] niks3-server[966]: 2026/09/22 22:22:54 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls worker2 # [ 66.482472] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.774Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.484379] niks3-server[966]: 2026/09/22 22:22:54 INFO Signed narinfos id=19 count=1 lb # [ 66.498731] niks3-server[966]: 2026/09/22 22:22:54 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 66.505528] niks3-server[966]: 2026/09/22 22:22:54 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 66.512227] niks3-server[966]: 2026/09/22 22:22:54 INFO Completed upload id=19 worker2 # [ 66.510771] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.803Z level=INFO msg="Upload complete. (181ms)" lb # [ 66.514676] niks3-server[966]: 2026/09/22 22:22:54 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 66.514850] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 66.519990] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 66.529898] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 66.540899] nix-daemon[869]: reaped child process 1085, status = succeeded worker2 # [ 66.543817] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # [ 66.557678] nix[1043]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 67.205684] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 0b36b5fe61a248ed81e05fce6b957dd2 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 67.362420] nix[1059]: don't know how to build these paths: client # [ 67.363362] nix[1059]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 67.352196] nix-grpc-daemon[780]: ts=2026-09-22T22:22:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 67.354243] nix-grpc-daemon[784]: ts=2026-09-22T22:22:55Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 67.356628] nix-grpc-daemon[784]: ts=2026-09-22T22:22:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 client # [ 67.373165] nix[1059]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 69.364318] systemd[1]: share1.service: Sent signal SIGINT to main process 1043 (nix) on client request. client # [ 69.371705] nix[1043]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 69.378477] nix[1043]: error: interrupted by the user client # [ 69.419360] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 69.421220] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 69.422942] systemd[1]: share1.service: Consumed 114ms CPU time over 3.282s wall clock time, 43.5M memory peak, 6.1K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 70.783902] nix-daemon[869]: reaped child process 1094, status = succeeded worker2 # [ 70.864053] nix-daemon[869]: accepted connection from pid 1126, user nix-grpc-daemon (trusted) worker2 # [ 70.876411] nix-daemon[869]: reaped child process 1129, status = succeeded lb # [ 70.884736] niks3-server[966]: 2026/09/22 22:22:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.894393] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.186Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 70.896360] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.188Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 70.929718] niks3-server[966]: 2026/09/22 22:22:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 70.937904] niks3-server[966]: 2026/09/22 22:22:59 INFO Signed narinfos id=20 count=1 worker2 # [ 70.939336] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.231Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.945666] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 70.952258] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 70.956743] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 70.966826] niks3-server[966]: 2026/09/22 22:22:59 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 70.973685] niks3-server[966]: 2026/09/22 22:22:59 INFO Completed upload id=20 worker2 # [ 70.972412] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.264Z level=INFO msg="Upload complete. (216ms)" lb # [ 70.975885] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 70.978852] nix-grpc-daemon[784]: ts=2026-09-22T22:22:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 70.987283] nix-grpc-daemon[784]: ts=2026-09-22T22:22:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 71.000667] nix-daemon[869]: reaped child process 1092, status = succeeded client # [ 71.065252] systemd[1]: share2.service: Deactivated successfully. client # [ 71.069453] systemd[1]: share2.service: Consumed 120ms CPU time over 3.862s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.04 seconds) (finished: subtest: the first client leaving does not fail the second, in 5.65 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 71.839831] systemd[1]: Started Nix Daemon. client # [ 71.925448] nix-daemon[1110]: accepted connection from pid 1107, user root (trusted) worker1 # [ 72.027751] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 72.034365] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 72.039878] nix-grpc-daemon[784]: ts=2026-09-22T22:23:00Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 72.044715] nix-grpc-daemon[784]: ts=2026-09-22T22:23:00Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 72.051202] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 72.064179] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 72.076743] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 72.088385] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 72.197679] nix-daemon[846]: accepted connection from pid 1101, user nix-grpc-daemon (trusted) worker1 # [ 72.212846] nix-daemon[846]: reaped child process 1104, status = succeeded lb # [ 72.218182] niks3-server[966]: 2026/09/22 22:23:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 72.266031] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.452Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 72.267551] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.452Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 72.282114] niks3-server[966]: 2026/09/22 22:23:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 72.290513] niks3-server[966]: 2026/09/22 22:23:00 INFO Signed narinfos id=21 count=1 worker1 # [ 72.293170] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.480Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.294955] niks3-server[966]: 2026/09/22 22:23:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 72.300696] niks3-server[966]: 2026/09/22 22:23:00 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 72.310621] niks3-server[966]: 2026/09/22 22:23:00 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 72.314289] niks3-server[966]: 2026/09/22 22:23:00 INFO Completed upload id=21 lb # [ 72.316257] niks3-server[966]: 2026/09/22 22:23:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 72.317413] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.504Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 72.323174] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 72.329877] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 72.341181] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 72.354255] nix-daemon[846]: reaped child process 1099, status = succeeded worker1 # [ 72.357244] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 73.176140] nix-daemon[846]: reaped child process 1108, status = succeeded worker1 # [ 73.259921] nix-daemon[846]: accepted connection from pid 1124, user nix-grpc-daemon (trusted) worker1 # [ 73.274312] nix-daemon[846]: reaped child process 1127, status = succeeded lb # [ 73.281344] niks3-server[966]: 2026/09/22 22:23:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.292058] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.479Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 73.293560] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.481Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 73.326563] niks3-server[966]: 2026/09/22 22:23:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 73.337525] niks3-server[966]: 2026/09/22 22:23:01 INFO Signed narinfos id=22 count=1 worker1 # [ 73.343477] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.530Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.344761] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 73.350250] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 73.355245] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 73.369115] niks3-server[966]: 2026/09/22 22:23:01 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 73.374094] niks3-server[966]: 2026/09/22 22:23:01 INFO Completed upload id=22 worker1 # [ 73.379544] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.566Z level=INFO msg="Upload complete. (215ms)" lb # [ 73.379298] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 73.386719] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker1 # [ 73.394343] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 73.407428] nix-daemon[846]: reaped child process 1106, status = succeeded worker2 # [ 73.409441] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 73.418328] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 73.432746] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 73.634654] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48426 worker1 # [ 73.642197] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 73.652698] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.839Z level=INFO msg="All 1 paths already cached" worker2 # [ 73.663790] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 73.670423] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker2 # [ 73.668243] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 73.682619] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 73.694735] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.882Z level=INFO msg="All 1 paths already cached" worker1 # [ 73.702355] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 73.713087] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 73.824912] nix-daemon[846]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker1 # [ 73.840743] nix-daemon[846]: reaped child process 1134, status = succeeded lb # [ 73.845656] niks3-server[966]: 2026/09/22 22:23:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.856312] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.043Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 73.857857] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.045Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 73.880122] niks3-server[966]: 2026/09/22 22:23:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker1 # [ 73.890027] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.077Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.887619] niks3-server[966]: 2026/09/22 22:23:02 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 73.892106] niks3-server[966]: 2026/09/22 22:23:02 INFO Signed narinfos id=23 count=1 lb # [ 73.895768] niks3-server[966]: 2026/09/22 22:23:02 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 73.909802] niks3-server[966]: 2026/09/22 22:23:02 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker1 # [ 73.919640] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.107Z level=INFO msg="Upload complete. (193ms)" lb # [ 73.916920] niks3-server[966]: 2026/09/22 22:23:02 INFO Completed upload id=23 lb # [ 73.920082] niks3-server[966]: 2026/09/22 22:23:02 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 73.922694] nix-grpc-daemon[780]: ts=2026-09-22T22:23:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 73.929122] nix-grpc-daemon[780]: ts=2026-09-22T22:23:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 73.940629] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 73.946101] nix-daemon[846]: reaped child process 1129, status = succeeded worker1 # [ 73.949757] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 74.766803] nix-daemon[846]: reaped child process 1138, status = succeeded worker1 # [ 74.853986] nix-daemon[846]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) worker1 # [ 74.869625] nix-daemon[846]: reaped child process 1158, status = succeeded lb # [ 74.875659] niks3-server[966]: 2026/09/22 22:23:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.889216] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.076Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 74.890776] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.078Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 74.918294] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 74.932578] niks3-server[966]: 2026/09/22 22:23:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 74.938578] niks3-server[966]: 2026/09/22 22:23:03 INFO Signed narinfos id=24 count=1 worker1 # [ 74.944325] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.131Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.946113] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 74.950526] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 74.959627] niks3-server[966]: 2026/09/22 22:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 74.965104] niks3-server[966]: 2026/09/22 22:23:03 INFO Completed upload id=24 lb # [ 74.966789] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 74.967762] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.155Z level=INFO msg="Upload complete. (211ms)" worker1 # [ 74.975143] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker1 # [ 74.982815] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 74.994947] nix-daemon[846]: reaped child process 1136, status = succeeded worker2 # [ 74.997202] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 75.002814] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 75.016586] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=176 lb # [ 75.182751] envoy[904]: conn peer=[2001:db8:1::1]:45088 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=933 ms=6167 lb # [ 75.186386] envoy[904]: conn peer=[2001:db8:1::1]:42690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=772 ms=3113 lb # [ 75.189836] envoy[904]: conn peer=[2001:db8:1::1]:42702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1194 ms=3685 lb # [ 75.193337] envoy[904]: conn peer=[2001:db8:1::1]:42706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3429 tx=1939 ms=1464 lb # [ 75.196879] envoy[904]: conn peer=[2001:db8:1::1]:51512 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=77 lb # [ 75.200429] envoy[904]: conn peer=[2001:db8:1::1]:51522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=2163 ms=1435 lb # [ 75.203910] envoy[904]: conn peer=[2001:db8:1::1]:51538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=73 worker2 # [ 75.219728] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48426 worker1 # [ 75.232075] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 75.242315] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.429Z level=INFO msg="All 2 paths already cached" worker2 # [ 75.254149] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 75.258611] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.265267] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 75.278062] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 75.291493] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.478Z level=INFO msg="All 2 paths already cached" worker1 # [ 75.299890] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 75.308492] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 75.419626] nix-daemon[846]: accepted connection from pid 1162, user nix-grpc-daemon (trusted) worker1 # [ 75.434286] nix-daemon[846]: reaped child process 1165, status = succeeded lb # [ 75.441127] niks3-server[966]: 2026/09/22 22:23:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.452748] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.640Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 75.454287] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.641Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 75.475441] niks3-server[966]: 2026/09/22 22:23:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 75.480080] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst worker1 # [ 75.490756] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.487927] niks3-server[966]: 2026/09/22 22:23:03 INFO Signed narinfos id=25 count=1 lb # [ 75.496211] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 75.509404] niks3-server[966]: 2026/09/22 22:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete worker1 # [ 75.517736] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.705Z level=INFO msg="Upload complete. (194ms)" lb # [ 75.516315] niks3-server[966]: 2026/09/22 22:23:03 INFO Completed upload id=25 lb # [ 75.518524] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 75.521183] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 75.526481] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 75.538064] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 75.544131] nix-daemon[846]: reaped child process 1160, status = succeeded worker1 # [ 75.547491] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 76.188889] nix-daemon[846]: reaped child process 1169, status = succeeded worker1 # [ 76.264307] nix-daemon[846]: accepted connection from pid 1185, user nix-grpc-daemon (trusted) worker1 # [ 76.277297] nix-daemon[846]: reaped child process 1188, status = succeeded lb # [ 76.282458] niks3-server[966]: 2026/09/22 22:23:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.293637] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.480Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 76.295230] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.482Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 76.325375] niks3-server[966]: 2026/09/22 22:23:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 76.331622] niks3-server[966]: 2026/09/22 22:23:04 INFO Signed narinfos id=26 count=1 worker1 # [ 76.337782] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.525Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.339855] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 76.344695] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 76.357076] niks3-server[966]: 2026/09/22 22:23:04 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 76.360099] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 76.362922] niks3-server[966]: 2026/09/22 22:23:04 INFO Completed upload id=26 worker1 # [ 76.365791] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.553Z level=INFO msg="Upload complete. (211ms)" lb # [ 76.367322] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 76.373201] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker1 # [ 76.380255] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 76.391824] nix-daemon[846]: reaped child process 1167, status = succeeded worker1 # [ 76.395786] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 76.399920] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=232 client # [ 76.521392] nix-daemon[1110]: reaped child process 1112, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 4.78 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 4.84 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.12 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 77.172309] nix-daemon[1110]: accepted connection from pid 1193, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 77.278186] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48426 worker1 # [ 77.285164] nix-grpc-daemon[780]: ts=2026-09-22T22:23:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 77.394107] nix-daemon[846]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker1 # [ 77.405912] nix-daemon[846]: reaped child process 1198, status = succeeded lb # [ 77.410678] niks3-server[966]: 2026/09/22 22:23:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 77.421952] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.609Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 77.423829] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.610Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 77.444832] niks3-server[966]: 2026/09/22 22:23:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 77.451831] niks3-server[966]: 2026/09/22 22:23:05 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls worker1 # [ 77.458923] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.646Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.456689] niks3-server[966]: 2026/09/22 22:23:05 INFO Signed narinfos id=27 count=1 lb # [ 77.463768] niks3-server[966]: 2026/09/22 22:23:05 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 77.475253] niks3-server[966]: 2026/09/22 22:23:05 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker1 # [ 77.484066] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.671Z level=INFO msg="Upload complete. (194ms)" lb # [ 77.481352] niks3-server[966]: 2026/09/22 22:23:05 INFO Completed upload id=27 lb # [ 77.486864] niks3-server[966]: 2026/09/22 22:23:05 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 77.497816] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 77.503525] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 77.542758] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 77.556860] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 77.571214] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 77.589108] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 77.697510] nix-daemon[869]: accepted connection from pid 1146, user nix-grpc-daemon (trusted) worker2 # [ 77.712653] nix-daemon[869]: reaped child process 1149, status = succeeded lb # [ 77.719531] niks3-server[966]: 2026/09/22 22:23:06 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 77.727962] niks3-server[966]: 2026/09/22 22:23:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 77.736329] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.028Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 77.739892] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.030Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker2 # [ 77.741642] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.030Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 77.772367] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 77.778082] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 77.780380] niks3-server[966]: 2026/09/22 22:23:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 77.782836] niks3-server[966]: 2026/09/22 22:23:06 INFO Signed narinfos id=28 count=1 lb # [ 77.785278] niks3-server[966]: 2026/09/22 22:23:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 77.787133] niks3-server[966]: 2026/09/22 22:23:06 INFO Signed narinfos id=29 count=2 lb # [ 77.789070] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst worker2 # [ 77.787796] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.079Z level=INFO msg="Uploading 3 narinfos" lb # [ 77.792269] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 77.804199] niks3-server[966]: 2026/09/22 22:23:06 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 77.810160] niks3-server[966]: 2026/09/22 22:23:06 INFO Completed upload id=28 lb # [ 77.811623] niks3-server[966]: 2026/09/22 22:23:06 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 77.814485] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 77.817129] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 77.818880] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 77.821652] niks3-server[966]: 2026/09/22 22:23:06 INFO Completed upload id=29 worker2 # [ 77.820483] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.112Z level=INFO msg="Upload complete. (218ms)" worker2 # [ 77.825832] nix-grpc-daemon[784]: ts=2026-09-22T22:23:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 77.831385] nix-grpc-daemon[784]: ts=2026-09-22T22:23:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 77.843139] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 77.855526] nix-daemon[869]: reaped child process 1144, status = succeeded worker2 # [ 77.859972] nix-grpc-daemon[784]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 77.866916] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 78.902673] nix-daemon[869]: reaped child process 1154, status = succeeded worker2 # [ 78.985509] nix-daemon[869]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2 # [ 78.999157] nix-daemon[869]: reaped child process 1173, status = succeeded lb # [ 79.006166] niks3-server[966]: 2026/09/22 22:23:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 79.012637] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.304Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 79.037490] niks3-server[966]: 2026/09/22 22:23:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 79.043268] niks3-server[966]: 2026/09/22 22:23:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls worker2 # [ 79.047236] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.339Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.049212] niks3-server[966]: 2026/09/22 22:23:07 INFO Signed narinfos id=30 count=1 lb # [ 79.055440] niks3-server[966]: 2026/09/22 22:23:07 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 79.068839] niks3-server[966]: 2026/09/22 22:23:07 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete worker2 # [ 79.072357] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.364Z level=INFO msg="Upload complete. (195ms)" lb # [ 79.074228] niks3-server[966]: 2026/09/22 22:23:07 INFO Completed upload id=30 lb # [ 79.077845] niks3-server[966]: 2026/09/22 22:23:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 79.077692] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 client # copying 1 paths... worker2 # [ 79.086545] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48426 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 79.094686] nix-daemon[869]: reaped child process 1151, status = succeeded worker1 # [ 79.112365] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 79.124466] nix-grpc-daemon[780]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... worker1 # [ 79.137549] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=120 client # [ 79.216576] nix-daemon[1110]: reaped child process 1196, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.16 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 79.320892] nix-daemon[1110]: accepted connection from pid 1215, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 79.428708] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34180 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 79.432349] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 79.444198] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.736Z level=INFO msg="All 1 paths already cached" worker2 # [ 79.458518] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 79.462982] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 79.508245] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 79.521542] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 79.541253] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 79.553192] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 79.569660] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5) worker1 # [ 79.621330] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5) worker1 # [ 79.628490] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 114 ms (attempt 3/5) worker1 # [ 79.750199] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 772 ms (attempt 4/5) worker1 # [ 80.524879] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 80.528990] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 80.535713] nix-grpc-daemon[780]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 80.659575] nix-daemon[846]: accepted connection from pid 1208, user nix-grpc-daemon (trusted) worker1 # [ 80.675469] nix-daemon[846]: reaped child process 1211, status = succeeded lb # [ 80.677610] niks3-server[966]: 2026/09/22 22:23:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 80.688322] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.875Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 80.690329] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.877Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 80.709274] niks3-server[966]: 2026/09/22 22:23:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 80.712714] niks3-server[966]: 2026/09/22 22:23:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 80.718204] niks3-server[966]: 2026/09/22 22:23:09 INFO Signed narinfos id=31 count=1 worker1 # [ 80.724561] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.911Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.728376] niks3-server[966]: 2026/09/22 22:23:09 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 80.740201] niks3-server[966]: 2026/09/22 22:23:09 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker1 # [ 80.749419] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.936Z level=INFO msg="Upload complete. (195ms)" lb # [ 80.747126] niks3-server[966]: 2026/09/22 22:23:09 INFO Completed upload id=31 lb # [ 80.749723] niks3-server[966]: 2026/09/22 22:23:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 80.752889] nix-grpc-daemon[780]: ts=2026-09-22T22:23:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 paths=1 nar_bytes_in=560 worker1 # [ 80.759230] nix-grpc-daemon[780]: ts=2026-09-22T22:23:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 80.769108] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 80.773900] nix-daemon[846]: reaped child process 1201, status = succeeded worker1 # [ 80.778943] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 81.794415] nix-daemon[846]: reaped child process 1215, status = succeeded worker1 # [ 81.868295] nix-daemon[846]: accepted connection from pid 1231, user nix-grpc-daemon (trusted) worker1 # [ 81.880770] nix-daemon[846]: reaped child process 1234, status = succeeded lb # [ 81.886745] niks3-server[966]: 2026/09/22 22:23:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 81.897615] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.084Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 81.919583] niks3-server[966]: 2026/09/22 22:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 81.924592] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 81.933125] niks3-server[966]: 2026/09/22 22:23:10 INFO Signed narinfos id=32 count=1 worker1 # [ 81.938574] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.126Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.942193] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 81.955582] niks3-server[966]: 2026/09/22 22:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 81.961269] niks3-server[966]: 2026/09/22 22:23:10 INFO Completed upload id=32 worker1 # [ 81.964089] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.151Z level=INFO msg="Upload complete. (178ms)" lb # [ 81.963725] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo client # copying 1 paths... worker1 # [ 81.969839] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 worker1 # [ 81.977431] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 81.987812] nix-daemon[846]: reaped child process 1213, status = succeeded worker2 # [ 81.993194] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 82.002072] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 82.014870] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=120 client # [ 82.139811] nix-daemon[1110]: reaped child process 1218, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.92 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 82.242081] nix-daemon[1110]: accepted connection from pid 1237, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 82.351339] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34180 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 82.358768] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 82.367390] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.554Z level=INFO msg="All 1 paths already cached" worker2 # [ 82.377905] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 82.383616] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 82.389506] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 82.401279] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 82.415617] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.707Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 82.424701] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 82.435451] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 82.533150] nix-daemon[869]: accepted connection from pid 1182, user nix-grpc-daemon (trusted) worker2 # [ 82.547724] nix-daemon[869]: reaped child process 1185, status = succeeded lb # [ 82.555722] niks3-server[966]: 2026/09/22 22:23:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 82.564909] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.857Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 82.566843] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.858Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 82.590708] niks3-server[966]: 2026/09/22 22:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 82.598143] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.890Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.599678] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 82.604949] niks3-server[966]: 2026/09/22 22:23:10 INFO Signed narinfos id=33 count=1 lb # [ 82.612643] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 82.621446] niks3-server[966]: 2026/09/22 22:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 82.625795] niks3-server[966]: 2026/09/22 22:23:10 INFO Completed upload id=33 worker2 # [ 82.624432] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.916Z level=INFO msg="Upload complete. (177ms)" worker2 # [ 82.629129] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 82.634087] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 82.634243] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 worker2 # [ 82.645105] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 82.649423] nix-daemon[869]: reaped child process 1180, status = succeeded worker2 # [ 82.654424] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 83.275306] nix-daemon[869]: reaped child process 1189, status = succeeded worker2 # [ 83.357571] nix-daemon[869]: accepted connection from pid 1205, user nix-grpc-daemon (trusted) worker2 # [ 83.371202] nix-daemon[869]: reaped child process 1208, status = succeeded lb # [ 83.379579] niks3-server[966]: 2026/09/22 22:23:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 83.387485] nix-grpc-daemon[923]: time=2026-09-22T22:23:11.679Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 83.412849] niks3-server[966]: 2026/09/22 22:23:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 83.420324] niks3-server[966]: 2026/09/22 22:23:11 INFO Signed narinfos id=34 count=1 worker2 # [ 83.421587] nix-grpc-daemon[923]: time=2026-09-22T22:23:11.713Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.424645] niks3-server[966]: 2026/09/22 22:23:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 83.427053] niks3-server[966]: 2026/09/22 22:23:11 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 83.433431] niks3-server[966]: 2026/09/22 22:23:11 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 83.436563] niks3-server[966]: 2026/09/22 22:23:11 INFO Completed upload id=34 worker2 # [ 83.435283] nix-grpc-daemon[923]: time=2026-09-22T22:23:11.727Z level=INFO msg="Upload complete. (173ms)" lb # [ 83.439114] niks3-server[966]: 2026/09/22 22:23:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 83.440877] nix-grpc-daemon[784]: ts=2026-09-22T22:23:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 client # copying 1 paths... worker2 # [ 83.451516] nix-daemon[869]: reaped child process 1187, status = succeeded worker1 # [ 83.456109] nix-grpc-daemon[780]: ts=2026-09-22T22:23:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 83.464543] nix-grpc-daemon[780]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 83.489844] nix-grpc-daemon[780]: ts=2026-09-22T22:23:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 worker1 # [ 83.495242] nix-grpc-daemon[780]: ts=2026-09-22T22:23:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=120 client # [ 83.615567] nix-daemon[1110]: reaped child process 1240, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.48 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.03 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.25 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds) worker2 # [ 84.374584] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 84.420139] nix-grpc-daemon[784]: ts=2026-09-22T22:23:12Z level=info event=signal_exit lb # [ 84.984794] niks3-server[966]: 2026/09/22 22:23:13 INFO lead: released remote=192.168.1.4:53366 lb # [ 85.183325] envoy[904]: conn peer=[2001:db8:1::1]:51540 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4312 tx=2370 ms=1228 lb # [ 85.187380] envoy[904]: conn peer=[2001:db8:1::1]:51556 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=55 lb # [ 85.190766] envoy[904]: conn peer=[2001:db8:1::1]:51568 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=38 lb # [ 85.194184] envoy[904]: conn peer=[2001:db8:1::1]:51558 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3868 tx=2068 ms=1868 lb # [ 85.197646] envoy[904]: conn peer=[2001:db8:1::1]:51582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3745 tx=2121 ms=2643 lb # [ 85.201127] envoy[904]: conn peer=[2001:db8:1::1]:51588 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=74 lb # [ 85.204550] envoy[904]: conn peer=[2001:db8:1::1]:51598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3730 tx=2082 ms=1195 lb # [ 85.207965] envoy[904]: conn peer=[2001:db8:1::1]:37582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=57 worker1 # [ 85.990949] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 85.988444] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=scheduler_restarting worker2 # [ 85.991976] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48414 worker2 # [ 85.997610] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 86.000859] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 86.004207] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48414 worker2 # [ 86.007817] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 86.028953] nix-daemon[869]: reaped child process 872, status = succeeded worker1 # [ 86.191366] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.195592] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.199613] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 86.396569] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.400579] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.566264] nix-grpc-daemon[784]: E0000 00:00:1790115794.858404 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 86.572110] nix-grpc-daemon[784]: E0000 00:00:1790115794.859010 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 86.601429] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.605493] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.806483] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.810483] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.012243] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.016153] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.217428] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.221375] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.422137] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.426190] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.620986] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 87.627061] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.624955] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 87.631122] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.628990] systemd[1]: nix-grpc-daemon.service: Consumed 1.928s CPU time over 1min 12.361s wall clock time, 63.8M memory peak, 87.5K incoming IP traffic, 236.6K outgoing IP traffic. worker2 # [ 87.642449] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 87.646923] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 87.650670] systemd[1]: nix-grpc-daemon.socket: Consumed 291us CPU time over 1min 19.784s wall clock time, 256K memory peak, 104.7K incoming IP traffic, 87K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 87.831939] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.836175] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.855832] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34180 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 87.860923] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34180 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.17 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 87.939346] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 87.996145] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 88.037649] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.041415] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.242411] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.246505] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.384718] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=signal_exit worker1 # [ 88.447282] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.451198] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.616178] systemd[1]: Starting scheduler-token.service... worker1 # [ 88.651946] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.655850] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.676154] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 88.679308] systemd[1]: Finished scheduler-token.service. worker2 # [ 88.682114] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 62ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 88.692102] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 88.769352] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 88.771342] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 88.774434] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 88.778651] nix-grpc-daemon[1232]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 88.779982] nix-grpc-daemon[1232]: E0000 00:00:1790115797.070898 1232 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 88.785504] nix-grpc-daemon[1232]: E0000 00:00:1790115797.076168 1232 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 88.789986] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 88.791683] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 88.797070] nix-grpc-daemon[1232]: E0000 00:00:1790115797.089123 1274 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 88.801541] niks3-server[966]: 2026/09/22 22:23:17 INFO lead: acquired remote=192.168.1.4:43228 worker2 # [ 88.802055] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=scheduler_take_over worker2 # [ 88.812052] nix-grpc-daemon[1232]: E0000 00:00:1790115797.104451 1274 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 88.816052] nix-grpc-daemon[1232]: E0000 00:00:1790115797.106741 1274 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 88.826193] nix-grpc-daemon[1232]: E0000 00:00:1790115797.118627 1274 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 88.835385] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.842062] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 88.843534] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54754 worker2 # [ 88.845181] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 88.853379] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54754 worker1 # [ 88.856722] nix-grpc-daemon[780]: ts=2026-09-22T22:23:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.854882] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 89.988954] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54754 worker2 # [ 89.992650] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:18Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 89.994576] nix-grpc-daemon[780]: ts=2026-09-22T22:23:19Z level=info event=scheduler_restarting worker1 # [ 90.009871] nix-grpc-daemon[780]: ts=2026-09-22T22:23:19Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 90.030224] nix-daemon[846]: reaped child process 848, status = succeeded worker1 # [ 90.556351] nix-grpc-daemon[780]: E0000 00:00:1790115799.743473 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker1 # [ 90.562463] nix-grpc-daemon[780]: E0000 00:00:1790115799.749545 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 91.583934] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 91.587442] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 91.592187] systemd[1]: nix-grpc-daemon.service: Consumed 2.527s CPU time over 1min 16.398s wall clock time, 65.8M memory peak, 107.2K incoming IP traffic, 199.9K outgoing IP traffic. worker1 # [ 91.604431] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 91.609190] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 91.612975] systemd[1]: nix-grpc-daemon.socket: Consumed 316us CPU time over 1min 24.081s wall clock time, 256K memory peak, 100.6K incoming IP traffic, 87.1K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 91.814461] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 91.826066] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 91.842459] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 1/5) worker2 # [ 91.863605] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 2/5) worker2 # [ 91.953235] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 3/5) worker2 # [ 92.111625] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 4/5) worker2 # [ 92.174670] nix-grpc-daemon[1232]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 92.178254] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 92.200146] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 92.212164] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 92.235394] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=info event=niks3_push_started pid=1293 worker2 # [ 92.336765] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.628Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 92.422219] nix-daemon[869]: accepted connection from pid 1306, user nix-grpc-daemon (trusted) worker2 # [ 92.436622] nix-daemon[869]: reaped child process 1309, status = succeeded lb # [ 92.444345] niks3-server[966]: 2026/09/22 22:23:20 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 92.454732] niks3-server[966]: 2026/09/22 22:23:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 92.461034] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.753Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 92.462585] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.755Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 92.464431] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.756Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 92.500052] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 92.522863] niks3-server[966]: 2026/09/22 22:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 92.530839] niks3-server[966]: 2026/09/22 22:23:20 INFO Signed narinfos id=35 count=1 lb # [ 92.532854] niks3-server[966]: 2026/09/22 22:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 92.534765] niks3-server[966]: 2026/09/22 22:23:20 INFO Signed narinfos id=36 count=2 lb # [ 92.536415] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst worker2 # [ 92.534136] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.825Z level=INFO msg="Uploading 3 narinfos" lb # [ 92.542969] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 92.546254] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 92.554841] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 92.558876] niks3-server[966]: 2026/09/22 22:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 92.565726] niks3-server[966]: 2026/09/22 22:23:20 INFO Completed upload id=35 lb # [ 92.567269] niks3-server[966]: 2026/09/22 22:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 92.570536] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 92.575369] niks3-server[966]: 2026/09/22 22:23:20 INFO Completed upload id=36 worker2 # [ 92.573130] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.865Z level=INFO msg="Upload complete. (232ms)" lb # [ 92.580183] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo worker2 # [ 92.578862] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 92.592794] nix-daemon[869]: reaped child process 1291, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 0.94 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 92.685711] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 92.694421] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 92.777223] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 92.779505] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 92.783444] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 92.788148] nix-grpc-daemon[1258]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 92.789685] nix-grpc-daemon[1258]: E0000 00:00:1790115801.974765 1258 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 92.796891] nix-grpc-daemon[1258]: E0000 00:00:1790115801.980594 1258 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 92.801382] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 92.805620] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 92.807157] nix-grpc-daemon[1258]: E0000 00:00:1790115801.991431 1301 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 92.820099] nix-grpc-daemon[1258]: E0000 00:00:1790115802.006341 1301 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 92.824133] nix-grpc-daemon[1258]: E0000 00:00:1790115802.006648 1301 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 92.834428] nix-grpc-daemon[1258]: E0000 00:00:1790115802.021930 1301 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 92.847950] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.846701] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54754 worker2 # [ 92.850437] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.31 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 93.998336] systemd[1]: Stopping niks3 server... lb # [ 94.000368] niks3-server[966]: 2026/09/22 22:23:22 INFO Shutdown signal received, draining in-flight requests timeout=10s worker1 # [ 94.004219] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:23Z level=info event=scheduler_lock_lost status=200 lb # [ 94.004438] niks3-server[966]: 2026/09/22 22:23:22 INFO lead: released remote=192.168.1.4:43228 worker2 # [ 94.004137] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:22Z level=info event=scheduler_lock_lost status=200 lb # [ 94.018714] systemd[1]: niks3.service: Deactivated successfully. lb # [ 94.020250] systemd[1]: Stopped niks3 server. lb # [ 94.021203] systemd[1]: niks3.service: Consumed 753ms CPU time over 1min 15.260s wall clock time, 28.9M memory peak, 97.6K incoming IP traffic, 140.2K outgoing IP traffic. lb # [ 94.028252] systemd[1]: Starting niks3 server... lb # [ 94.076352] niks3-server[1108]: 2026/09/22 22:23:22 goose: no migrations to run. current version: 20260920000000 lb # [ 94.082778] niks3-server[1108]: 2026/09/22 22:23:22 OK 1_commit_pending_closure.sql (4.52ms) lb # [ 94.086463] niks3-server[1108]: 2026/09/22 22:23:22 OK 2_object_stats_trigger.sql (3.3ms) lb # [ 94.087543] niks3-server[1108]: 2026/09/22 22:23:22 goose: up to current file version: 2 lb # [ 94.088845] niks3-server[1108]: 2026/09/22 22:23:22 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 94.099404] niks3-server[1108]: 2026/09/22 22:23:22 INFO Read proxy enabled — serving cache objects from S3 lb # [ 94.101198] niks3-server[1108]: 2026/09/22 22:23:22 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 94.103407] systemd[1]: Started niks3 server. lb # [ 94.104137] niks3-server[1108]: 2026/09/22 22:23:22 INFO systemd watchdog enabled interval=15s lb # [ 94.105312] niks3-server[1108]: 2026/09/22 22:23:22 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 94.432488] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54758 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 94.449939] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 94.462671] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 94.479142] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5) worker1 # [ 94.570872] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 2/5) worker1 # [ 94.613787] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 119 ms (attempt 3/5) worker1 # [ 94.735193] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 401 ms (attempt 4/5) lb # [ 95.010277] niks3-server[1108]: 2026/09/22 22:23:23 INFO lead: acquired remote=192.168.1.4:57710 worker1 # [ 95.139956] nix-grpc-daemon[1258]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 95.144085] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 95.179949] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 lb # [ 95.184061] envoy[904]: conn peer=[2001:db8:1::4]:34632 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=59481 tx=3132 ms=70746 worker2 # [ 95.184083] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 lb # [ 95.187901] envoy[904]: conn peer=[2001:db8:1::1]:37598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=14 lb # [ 95.191469] envoy[904]: conn peer=[2001:db8:1::3]:39502 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=19017 tx=3803 ms=74586 lb # [ 95.195194] envoy[904]: conn peer=[2001:db8:1::1]:37614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1009 tx=282 ms=781 worker2 # [ 95.223205] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 95.237399] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54758 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 95.250613] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 95.261850] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 95.365848] nix-daemon[869]: accepted connection from pid 1328, user nix-grpc-daemon (trusted) worker2 # [ 95.379349] nix-daemon[869]: reaped child process 1331, status = succeeded lb # [ 95.387648] niks3-server[1108]: 2026/09/22 22:23:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.401213] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 95.403371] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.695Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 95.427308] niks3-server[1108]: 2026/09/22 22:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 95.452870] niks3-server[1108]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 95.460021] niks3-server[1108]: 2026/09/22 22:23:23 INFO Signed narinfos id=37 count=1 worker2 # [ 95.462271] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.753Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.468530] niks3-server[1108]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 95.473158] niks3-server[1108]: 2026/09/22 22:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 95.480187] niks3-server[1108]: 2026/09/22 22:23:23 INFO Completed upload id=37 worker2 # [ 95.478872] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.771Z level=INFO msg="Upload complete. (205ms)" lb # [ 95.483648] niks3-server[1108]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker2 # [ 95.483740] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 95.490986] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 95.503115] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 95.513220] nix-daemon[869]: reaped child process 1326, status = succeeded worker2 # [ 95.517944] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 96.130533] nix-daemon[869]: reaped child process 1335, status = succeeded worker2 # [ 96.209480] nix-daemon[869]: accepted connection from pid 1351, user nix-grpc-daemon (trusted) worker2 # [ 96.222694] nix-daemon[869]: reaped child process 1354, status = succeeded lb # [ 96.231628] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.243068] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.534Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 96.244529] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.534Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 96.271342] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker2 # [ 96.276977] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.569Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.279161] niks3-server[1108]: 2026/09/22 22:23:24 INFO Signed narinfos id=38 count=1 lb # [ 96.293982] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 96.300109] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 96.306252] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 96.310330] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 96.317904] niks3-server[1108]: 2026/09/22 22:23:24 INFO Completed upload id=38 lb # [ 96.319187] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 96.316648] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.609Z level=INFO msg="Upload complete. (192ms)" worker2 # [ 96.323692] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 96.337623] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 96.342564] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 96.350480] nix-daemon[869]: reaped child process 1333, status = succeeded worker2 # [ 96.382813] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 96.395242] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 96.409684] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.701Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 96.418880] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 96.429181] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 96.527253] nix-daemon[869]: accepted connection from pid 1360, user nix-grpc-daemon (trusted) worker2 # [ 96.540899] nix-daemon[869]: reaped child process 1363, status = succeeded lb # [ 96.550761] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.559618] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.852Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 96.561138] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.853Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 96.584991] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 96.593917] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 96.598821] niks3-server[1108]: 2026/09/22 22:23:24 INFO Signed narinfos id=39 count=1 worker2 # [ 96.600284] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.892Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.610492] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 96.619301] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 96.626281] niks3-server[1108]: 2026/09/22 22:23:24 INFO Completed upload id=39 worker2 # [ 96.625057] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.917Z level=INFO msg="Upload complete. (185ms)" lb # [ 96.629069] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 96.629674] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 96.635896] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 96.649110] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 96.655913] nix-daemon[869]: reaped child process 1358, status = succeeded worker2 # [ 96.660411] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 97.703968] nix-daemon[869]: reaped child process 1367, status = succeeded worker2 # [ 97.782347] nix-daemon[869]: accepted connection from pid 1383, user nix-grpc-daemon (trusted) worker2 # [ 97.796223] nix-daemon[869]: reaped child process 1386, status = succeeded lb # [ 97.805877] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.813301] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.105Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 97.814795] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.107Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 97.850182] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 97.853629] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 97.858522] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.150Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.859901] niks3-server[1108]: 2026/09/22 22:23:26 INFO Signed narinfos id=40 count=1 lb # [ 97.869535] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 97.878209] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 97.881938] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 97.889372] niks3-server[1108]: 2026/09/22 22:23:26 INFO Completed upload id=40 worker2 # [ 97.888158] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.180Z level=INFO msg="Upload complete. (220ms)" lb # [ 97.892791] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 97.894600] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 97.904569] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 97.908208] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 97.917618] nix-daemon[869]: reaped child process 1365, status = succeeded worker2 # [ 97.949185] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 97.961400] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 97.975233] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.267Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 97.984681] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 97.995137] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 98.091839] nix-daemon[869]: accepted connection from pid 1392, user nix-grpc-daemon (trusted) worker2 # [ 98.104953] nix-daemon[869]: reaped child process 1395, status = succeeded lb # [ 98.114775] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.121339] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.413Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 98.122809] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.415Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 98.147265] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 98.154453] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 98.159240] niks3-server[1108]: 2026/09/22 22:23:26 INFO Signed narinfos id=41 count=1 worker2 # [ 98.160436] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.169385] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 98.180561] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 98.183324] niks3-server[1108]: 2026/09/22 22:23:26 INFO Completed upload id=41 worker2 # [ 98.181755] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.474Z level=INFO msg="Upload complete. (175ms)" lb # [ 98.186052] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 98.185809] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 98.190543] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 worker2 # [ 98.200483] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 98.205519] nix-daemon[869]: reaped child process 1390, status = succeeded worker2 # [ 98.210347] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 98.849278] nix-daemon[869]: reaped child process 1399, status = succeeded worker2 # [ 98.929609] nix-daemon[869]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) worker2 # [ 98.941297] nix-daemon[869]: reaped child process 1418, status = succeeded lb # [ 98.951481] niks3-server[1108]: 2026/09/22 22:23:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.959456] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.251Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 98.960921] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.253Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 98.993621] niks3-server[1108]: 2026/09/22 22:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 98.998322] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.290Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.999610] niks3-server[1108]: 2026/09/22 22:23:27 INFO Signed narinfos id=42 count=1 lb # [ 99.006647] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 99.012232] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 99.015994] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 99.021967] niks3-server[1108]: 2026/09/22 22:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 99.025246] niks3-server[1108]: 2026/09/22 22:23:27 INFO Completed upload id=42 lb # [ 99.027503] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 99.025250] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.317Z level=INFO msg="Upload complete. (208ms)" worker2 # [ 99.031616] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 99.046673] nix-daemon[869]: reaped child process 1397, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 4.79 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 5.26 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 99.341586] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 99.792285] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:28Z level=info event=signal_exit lb # [ 100.011465] niks3-server[1108]: 2026/09/22 22:23:28 INFO lead: released remote=192.168.1.4:57710 worker1 # [ 101.018448] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 101.016744] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=scheduler_restarting worker2 # [ 101.020840] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 101.023995] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54754 worker2 # [ 101.027846] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 101.031107] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54754 worker2 # [ 101.035823] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 101.053123] nix-daemon[869]: reaped child process 1285, status = succeeded worker1 # [ 101.217857] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.222358] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 101.227490] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 101.423118] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.427352] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.627802] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.631802] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.832613] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.836690] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 101.832803] nix-grpc-daemon[1232]: E0000 00:00:1790115810.125004 1278 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 101.838384] nix-grpc-daemon[1232]: E0000 00:00:1790115810.130333 1278 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 102.038557] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.042500] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.215261] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 102.216873] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 102.219439] systemd[1]: nix-grpc-daemon.service: Consumed 891ms CPU time over 13.525s wall clock time, 37.5M memory peak, 45.2K incoming IP traffic, 79.4K outgoing IP traffic. worker2 # [ 102.225311] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 102.227588] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 102.229182] systemd[1]: nix-grpc-daemon.socket: Consumed 514us CPU time over 14.293s wall clock time, 256K memory peak, 37.5K incoming IP traffic, 27.5K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 102.244536] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.248631] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.449481] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.453726] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.654546] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.658792] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.859615] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.863736] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.065499] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 103.069496] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.270399] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 103.274579] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.475467] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 103.479588] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.680447] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 103.684519] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.885347] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 103.889475] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.091327] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.095499] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.296808] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.300758] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.501702] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.505768] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.706559] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.711229] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.911728] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.916366] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 105.008417] niks3-server[1108]: 2026/09/22 22:23:33 INFO lead: acquired remote=192.168.1.3:37572 worker1 # [ 105.010741] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_take_over worker1 # [ 105.117987] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.122425] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 105.184469] envoy[904]: conn peer=[2001:db8:1::1]:46574 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9692 tx=4404 ms=4615 lb # [ 105.188278] envoy[904]: conn peer=[2001:db8:1::4]:58286 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1755 tx=425 ms=12385 worker1 # [ 105.323498] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.328166] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 3.23 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 105.528678] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.532794] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.733747] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.742126] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44424 worker1 # [ 105.746442] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker1 # [ 106.671425] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44090 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 106.680986] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 106.704894] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 106.710988] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 106.754795] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 106.768799] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44090 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 106.782257] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 106.794177] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 106.816166] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:36Z level=info event=niks3_push_started pid=1353 worker1 # [ 106.916576] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.103Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 107.002150] nix-daemon[846]: accepted connection from pid 1365, user nix-grpc-daemon (trusted) worker1 # [ 107.014414] nix-daemon[846]: reaped child process 1368, status = succeeded lb # [ 107.020709] niks3-server[1108]: 2026/09/22 22:23:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 107.031779] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.219Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 107.033517] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.221Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 107.063415] niks3-server[1108]: 2026/09/22 22:23:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 107.071189] niks3-server[1108]: 2026/09/22 22:23:35 INFO Signed narinfos id=43 count=1 worker1 # [ 107.077845] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.264Z level=INFO msg="Uploading 1 narinfos" lb # [ 107.078480] niks3-server[1108]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 107.098947] niks3-server[1108]: 2026/09/22 22:23:35 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 107.106108] niks3-server[1108]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 107.110157] niks3-server[1108]: 2026/09/22 22:23:35 INFO Completed upload id=43 worker1 # [ 107.113085] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.300Z level=INFO msg="Upload complete. (193ms)" lb # [ 107.112254] niks3-server[1108]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 107.117936] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 107.124256] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 107.134831] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 107.141774] nix-daemon[846]: reaped child process 1351, status = succeeded worker1 # [ 107.147085] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 108.186579] nix-daemon[846]: reaped child process 1372, status = succeeded worker1 # [ 108.272310] nix-daemon[846]: accepted connection from pid 1388, user nix-grpc-daemon (trusted) worker1 # [ 108.285097] nix-daemon[846]: reaped child process 1391, status = succeeded lb # [ 108.288336] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 108.299905] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 108.303954] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.489Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 108.328590] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 108.335930] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 108.346264] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 108.353598] niks3-server[1108]: 2026/09/22 22:23:36 INFO Signed narinfos id=44 count=1 worker1 # [ 108.356675] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.543Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.360132] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 108.368716] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 108.371738] niks3-server[1108]: 2026/09/22 22:23:36 INFO Completed upload id=44 worker1 # [ 108.374617] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.562Z level=INFO msg="Upload complete. (219ms)" lb # [ 108.375042] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker1 # [ 108.390534] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker1 # [ 108.397632] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 108.402387] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 108.410885] nix-daemon[846]: reaped child process 1370, status = succeeded worker1 # [ 108.434329] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 108.445577] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 108.458363] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.645Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 108.466618] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 108.475269] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 108.563383] nix-daemon[846]: accepted connection from pid 1397, user nix-grpc-daemon (trusted) worker1 # [ 108.578687] nix-daemon[846]: reaped child process 1400, status = succeeded lb # [ 108.580301] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 108.591854] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.779Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 108.593577] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.781Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 108.615625] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 108.622175] niks3-server[1108]: 2026/09/22 22:23:36 INFO Signed narinfos id=45 count=1 worker1 # [ 108.627862] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.815Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.630976] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 108.640430] niks3-server[1108]: 2026/09/22 22:23:37 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 108.651448] niks3-server[1108]: 2026/09/22 22:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 108.657202] niks3-server[1108]: 2026/09/22 22:23:37 INFO Completed upload id=45 worker1 # [ 108.660190] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.847Z level=INFO msg="Upload complete. (175ms)" lb # [ 108.661378] niks3-server[1108]: 2026/09/22 22:23:37 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 108.665490] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 108.673231] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 108.683209] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 108.692086] nix-daemon[846]: reaped child process 1395, status = succeeded worker1 # [ 108.697883] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 110.133917] nix-daemon[846]: reaped child process 1404, status = succeeded worker1 # [ 110.222122] nix-daemon[846]: accepted connection from pid 1420, user nix-grpc-daemon (trusted) worker1 # [ 110.237427] nix-daemon[846]: reaped child process 1423, status = succeeded lb # [ 110.236665] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.247810] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.435Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 110.250432] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.436Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 110.276215] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 110.282142] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.469Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.279244] niks3-server[1108]: 2026/09/22 22:23:38 INFO Signed narinfos id=46 count=1 lb # [ 110.289953] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 110.292733] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 110.295529] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 110.302060] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 110.307965] niks3-server[1108]: 2026/09/22 22:23:38 INFO Completed upload id=46 worker1 # [ 110.310813] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.498Z level=INFO msg="Upload complete. (203ms)" lb # [ 110.310452] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 110.317608] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 110.328210] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 110.332117] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 110.336706] nix-daemon[846]: reaped child process 1402, status = succeeded worker1 # [ 110.372681] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 110.385983] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 110.400156] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.587Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 110.409477] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 110.420182] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 110.512223] nix-daemon[846]: accepted connection from pid 1429, user nix-grpc-daemon (trusted) worker1 # [ 110.527498] nix-daemon[846]: reaped child process 1432, status = succeeded lb # [ 110.530292] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.548225] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.735Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 110.549981] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.737Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 110.567379] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 110.573251] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.760Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.571653] niks3-server[1108]: 2026/09/22 22:23:38 INFO Signed narinfos id=47 count=1 lb # [ 110.577027] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 110.581087] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 110.585148] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 110.593391] niks3-server[1108]: 2026/09/22 22:23:38 INFO Completed upload id=47 worker1 # [ 110.595944] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.783Z level=INFO msg="Upload complete. (165ms)" worker1 # [ 110.598286] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 110.597676] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 110.601430] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 110.609588] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 110.612917] nix-daemon[846]: reaped child process 1427, status = succeeded worker1 # [ 110.617084] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 111.656829] nix-daemon[846]: reaped child process 1436, status = succeeded worker1 # [ 111.731161] nix-daemon[846]: accepted connection from pid 1452, user nix-grpc-daemon (trusted) worker1 # [ 111.746725] nix-daemon[846]: reaped child process 1455, status = succeeded lb # [ 111.746695] niks3-server[1108]: 2026/09/22 22:23:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.758564] nix-grpc-daemon[1353]: time=2026-09-22T22:23:40.945Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 111.760101] nix-grpc-daemon[1353]: time=2026-09-22T22:23:40.947Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 111.791824] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 111.797081] niks3-server[1108]: 2026/09/22 22:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 111.803712] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 111.807081] niks3-server[1108]: 2026/09/22 22:23:40 INFO Signed narinfos id=48 count=1 worker1 # [ 111.812312] nix-grpc-daemon[1353]: time=2026-09-22T22:23:40.999Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.814276] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 111.822983] niks3-server[1108]: 2026/09/22 22:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 111.825740] niks3-server[1108]: 2026/09/22 22:23:40 INFO Completed upload id=48 worker1 # [ 111.828376] nix-grpc-daemon[1353]: time=2026-09-22T22:23:41.015Z level=INFO msg="Upload complete. (202ms)" lb # [ 111.829761] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 111.834761] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 111.850837] nix-daemon[846]: reaped child process 1434, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.34 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.12 seconds) worker2 # [ 112.038697] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 112.045756] systemd[1]: Starting scheduler-token.service... worker2 # [ 112.092439] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 112.093960] systemd[1]: Finished scheduler-token.service. worker2 # [ 112.095388] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 48ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 112.099681] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 112.177674] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 112.182049] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 112.186048] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 112.187961] nix-grpc-daemon[1439]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 112.189213] nix-grpc-daemon[1439]: E0000 00:00:1790115820.477039 1439 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.193121] nix-grpc-daemon[1439]: E0000 00:00:1790115820.484353 1439 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 112.200044] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 112.202166] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 112.202972] nix-grpc-daemon[1439]: E0000 00:00:1790115820.494417 1481 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.217136] nix-grpc-daemon[1439]: E0000 00:00:1790115820.508854 1481 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 112.220116] nix-grpc-daemon[1439]: E0000 00:00:1790115820.509001 1481 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 112.234544] nix-grpc-daemon[1439]: E0000 00:00:1790115820.526978 1481 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 112.249381] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.263165] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 112.267402] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44424 worker1 # [ 112.271338] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.24 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 112.484566] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: a4d5d5302b4a4a3a982633045b256edb client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) worker2 # [ 112.610156] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45578 worker2 # [ 112.621751] nix-daemon[869]: accepted connection from pid 1439, user nix-grpc-daemon (trusted) client # [ 112.647871] nix[1362]: don't know how to build these paths: client # [ 112.648919] nix[1362]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 112.644718] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 112.650113] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 112.690475] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 112.703496] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44090 client # [ 112.724156] nix[1362]: copying 1 paths to 'lb:50051'... worker1 # [ 112.715247] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 client # [ 112.726059] nix[1362]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 112.727383] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 112.823171] nix-daemon[846]: accepted connection from pid 1468, user nix-grpc-daemon (trusted) worker1 # [ 112.836399] nix-daemon[846]: reaped child process 1471, status = succeeded lb # [ 112.839599] niks3-server[1108]: 2026/09/22 22:23:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.850875] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.038Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 112.852930] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.039Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 112.871214] niks3-server[1108]: 2026/09/22 22:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 112.879317] niks3-server[1108]: 2026/09/22 22:23:41 INFO Signed narinfos id=49 count=1 worker1 # [ 112.885196] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.072Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.883531] niks3-server[1108]: 2026/09/22 22:23:41 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 112.892863] niks3-server[1108]: 2026/09/22 22:23:41 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 112.902261] niks3-server[1108]: 2026/09/22 22:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 112.910711] niks3-server[1108]: 2026/09/22 22:23:41 INFO Completed upload id=49 worker1 # [ 112.913524] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.100Z level=INFO msg="Upload complete. (174ms)" lb # [ 112.914838] niks3-server[1108]: 2026/09/22 22:23:41 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 112.918701] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 112.925311] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 worker1 # [ 112.934632] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker1 # [ 112.943607] nix-daemon[846]: reaped child process 1466, status = succeeded worker1 # [ 112.948197] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # [ 112.958190] nix[1362]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 115.131172] systemd-journald[284]: Received client request to rotate journal, rotating. worker2 # [ 115.150152] systemd-journald[284]: Vacuuming done, freed 0B of archived journals from /var/log/journal/0d3681033c0d4c5fab8e6499b4bc6e17. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 115.062515] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 lb # [ 115.184382] envoy[904]: conn peer=[2001:db8:1::1]:52926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9560 tx=4369 ms=5180 worker1 # [ 115.804480] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:44Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 120.397235] nix-daemon[846]: reaped child process 1475, status = succeeded worker1 # [ 120.476108] nix-daemon[846]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker1 # [ 120.487922] nix-daemon[846]: reaped child process 1519, status = succeeded lb # [ 120.495902] niks3-server[1108]: 2026/09/22 22:23:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 120.506251] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 120.510146] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.695Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 120.541871] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 120.546752] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 120.555927] niks3-server[1108]: 2026/09/22 22:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 120.561615] niks3-server[1108]: 2026/09/22 22:23:48 INFO Signed narinfos id=50 count=1 worker1 # [ 120.564695] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.751Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.564206] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 120.575138] niks3-server[1108]: 2026/09/22 22:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 120.579967] niks3-server[1108]: 2026/09/22 22:23:48 INFO Completed upload id=50 worker1 # [ 120.582890] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.770Z level=INFO msg="Upload complete. (221ms)" lb # [ 120.583787] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 120.591676] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 120.605772] nix-daemon[846]: reaped child process 1473, status = succeeded client # [ 120.631923] systemd[1]: rs.service: Deactivated successfully. client # [ 120.636147] systemd[1]: rs.service: Consumed 128ms CPU time over 8.150s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.2K outgoing IP traffic. worker1 # [ 120.805125] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:49Z level=info event=signal_exit lb # [ 121.012194] niks3-server[1108]: 2026/09/22 22:23:49 INFO lead: released remote=192.168.1.3:37572 worker2 # [ 122.013610] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.014996] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=scheduler_restarting worker1 # [ 122.024307] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.028299] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44424 worker1 # [ 122.031852] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 122.035409] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44424 worker1 # [ 122.038932] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 122.055461] nix-daemon[846]: reaped child process 1311, status = succeeded worker2 # [ 122.204217] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_take_over lb # [ 122.206408] niks3-server[1108]: 2026/09/22 22:23:50 INFO lead: acquired remote=192.168.1.4:49644 worker2 # [ 122.213582] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.217589] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 122.229875] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 122.356564] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 122.359889] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 122.362800] systemd[1]: nix-grpc-daemon.service: Consumed 1.108s CPU time over 29.665s wall clock time, 37.6M memory peak, 50.3K incoming IP traffic, 105.2K outgoing IP traffic. worker1 # [ 122.377917] systemd[1]: Starting Nix worker-protocol over gRPC... worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.11 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 122.418691] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_connected addr=lb:50051 client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker2 # [ 122.422579] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker1 # [ 122.465349] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 122.467546] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 122.470921] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 122.475054] nix-grpc-daemon[1526]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 122.477152] nix-grpc-daemon[1526]: E0000 00:00:1790115831.662347 1526 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 122.482599] nix-grpc-daemon[1526]: E0000 00:00:1790115831.667845 1526 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 122.486116] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 122.488580] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 122.491064] nix-grpc-daemon[1526]: E0000 00:00:1790115831.677774 1567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 122.502358] nix-grpc-daemon[1526]: E0000 00:00:1790115831.689816 1567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 122.507054] nix-grpc-daemon[1526]: E0000 00:00:1790115831.692139 1567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 122.516419] nix-grpc-daemon[1526]: E0000 00:00:1790115831.703885 1567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 122.528397] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:50051 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 122.529885] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 122.623947] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.627877] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 122.731061] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.734957] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 122.829129] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.833227] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 122.936115] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.940255] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.035148] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.038942] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 123.140881] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 123.144983] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.239977] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.243915] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 123.345897] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.352164] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34602 worker2 # [ 123.355933] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 123.445121] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.455144] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 123.459099] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34602 worker2 # [ 123.463903] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 11.24 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 123.721570] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: a1bb53bb50aa430384720bd9dc1074ba client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker2 # [ 123.848198] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45578 client # [ 123.869138] nix[1398]: don't know how to build these paths: client # [ 123.870110] nix[1398]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 123.863265] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:52Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 123.867369] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:52Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 123.916878] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 worker1 # [ 123.928382] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker1 # [ 123.945617] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5) worker1 # [ 124.020429] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 150 ms (attempt 2/5) worker1 # [ 124.172612] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 3/5) worker1 # [ 124.179774] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 798 ms (attempt 4/5) worker1 # [ 124.987386] nix-grpc-daemon[1526]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 124.990736] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 125.009669] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38530 client # [ 125.031345] nix[1398]: copying 1 paths to 'lb:50051'... worker1 # [ 125.022400] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38530 client # [ 125.034675] nix[1398]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 125.034099] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker1 # [ 125.054707] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=info event=niks3_push_started pid=1595 worker1 # [ 125.156482] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.343Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" lb # [ 125.185657] envoy[904]: conn peer=[2001:db8:1::1]:52942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2943 tx=1519 ms=7991 lb # [ 125.189505] envoy[904]: conn peer=[2001:db8:1::3]:47432 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6017 tx=1407 ms=29380 worker1 # [ 125.242402] nix-daemon[846]: accepted connection from pid 1608, user nix-grpc-daemon (trusted) worker1 # [ 125.257087] nix-daemon[846]: reaped child process 1611, status = succeeded lb # [ 125.261579] niks3-server[1108]: 2026/09/22 22:23:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.274841] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.462Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 125.276360] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.463Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 125.304588] niks3-server[1108]: 2026/09/22 22:23:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 125.311859] niks3-server[1108]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 125.328450] niks3-server[1108]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 125.337148] niks3-server[1108]: 2026/09/22 22:23:53 INFO Signed narinfos id=51 count=1 worker1 # [ 125.339923] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.527Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.345399] niks3-server[1108]: 2026/09/22 22:23:53 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 125.349069] niks3-server[1108]: 2026/09/22 22:23:53 INFO Completed upload id=51 worker1 # [ 125.351922] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.539Z level=INFO msg="Upload complete. (192ms)" lb # [ 125.355238] niks3-server[1108]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 125.356236] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 125.362521] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 worker1 # [ 125.374060] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker1 # [ 125.378424] nix-daemon[846]: reaped child process 1593, status = succeeded worker1 # [ 125.383348] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) client # [ 125.393357] nix[1398]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 127.321270] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1439 (nix-grpc-daemon) on client request. worker2 # [ 127.339856] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 127.339068] niks3-server[1108]: 2026/09/22 22:23:55 INFO lead: released remote=192.168.1.4:49644 worker1 # [ 127.350434] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" client # [ 127.361331] nix[1398]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 127.355237] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 127.356737] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 127.358103] systemd[1]: nix-grpc-daemon.service: Consumed 218ms CPU time over 15.253s wall clock time, 13.8M memory peak, 11.3K incoming IP traffic, 24.2K outgoing IP traffic. worker2 # [ 127.370283] systemd[1]: Starting scheduler-token.service... worker2 # [ 127.375280] nix-daemon[869]: reaped child process 1499, status = succeeded worker2 # [ 127.410572] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 127.411671] systemd[1]: Finished scheduler-token.service. worker2 # [ 127.413378] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 41ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 127.415986] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 127.419763] systemd[1]: Starting scheduler-token.service... worker2 # [ 127.454249] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 127.455864] systemd[1]: Finished scheduler-token.service. worker2 # [ 127.457344] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 36ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 127.461793] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 127.489561] niks3-server[1108]: 2026/09/22 22:23:55 INFO lead: acquired remote=192.168.1.3:48460 worker1 # [ 127.495636] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_take_over worker2 # [ 127.541349] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 127.543531] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 127.550545] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.546766] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 127.551646] nix-grpc-daemon[1586]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 127.554883] nix-grpc-daemon[1586]: E0000 00:00:1790115835.844123 1586 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 127.560246] nix-grpc-daemon[1586]: E0000 00:00:1790115835.847198 1586 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 127.562389] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 127.563956] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 127.571129] nix-grpc-daemon[1586]: E0000 00:00:1790115835.862510 1629 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds) worker1 # [ 127.581308] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" client: must succeed: sleep 5.0 worker2 # [ 127.584470] nix-grpc-daemon[1586]: E0000 00:00:1790115835.876899 1629 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 127.589053] nix-grpc-daemon[1586]: E0000 00:00:1790115835.879138 1629 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 127.598517] nix-grpc-daemon[1586]: E0000 00:00:1790115835.890948 1629 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 127.607766] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.610189] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 127.783699] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.791169] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38534 worker1 # [ 127.792913] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=1 worker2 # [ 127.811606] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.816671] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 128.018203] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.023333] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 128.224715] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.235655] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:57Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 128.237157] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38534 worker1 # [ 128.238732] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 132.803701] nix-daemon[846]: reaped child process 1615, status = succeeded worker1 # [ 132.877996] nix-daemon[846]: accepted connection from pid 1652, user nix-grpc-daemon (trusted) worker1 # [ 132.891405] nix-daemon[846]: reaped child process 1655, status = succeeded lb # [ 132.895411] niks3-server[1108]: 2026/09/22 22:24:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.906799] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.094Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 132.908352] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.095Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 132.947765] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 132.951701] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 132.961490] niks3-server[1108]: 2026/09/22 22:24:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 132.966894] niks3-server[1108]: 2026/09/22 22:24:01 INFO Signed narinfos id=52 count=1 worker1 # [ 132.973934] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.160Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.974865] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 132.979058] niks3-server[1108]: 2026/09/22 22:24:01 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 132.982925] niks3-server[1108]: 2026/09/22 22:24:01 INFO Completed upload id=52 worker1 # [ 132.985600] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.173Z level=INFO msg="Upload complete. (190ms)" lb # [ 132.984938] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 132.992648] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 133.008741] nix-daemon[846]: reaped child process 1613, status = succeeded client # [ 133.042160] systemd[1]: mid.service: Deactivated successfully. client # [ 133.044906] systemd[1]: mid.service: Consumed 133ms CPU time over 9.320s wall clock time, 43.4M memory peak, 7.8K incoming IP traffic, 8.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.24 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 133.934772] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: ebbf4c93d79042cb81fb6c6c4e01a808 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker2 # [ 134.046717] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 134.058148] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # [ 134.085068] nix[1434]: don't know how to build these paths: client # [ 134.085940] nix[1434]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 134.085752] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:03Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 134.089977] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:03Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 134.126325] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 134.137693] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5) worker2 # [ 134.244559] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5) worker2 # [ 134.417581] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 3/5) worker2 # [ 134.557616] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 682 ms (attempt 4/5) lb # [ 135.187203] envoy[904]: conn peer=[2001:db8:1::4]:53738 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6953 tx=523 ms=15105 lb # [ 135.191245] envoy[904]: conn peer=[2001:db8:1::1]:52314 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3074 tx=1606 ms=9158 worker2 # [ 135.248902] nix-grpc-daemon[1586]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 135.252347] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 135.271921] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 client # [ 135.297626] nix[1434]: copying 1 paths to 'lb:50051'... client # [ 135.300775] nix[1434]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 135.287548] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 135.299100] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 135.323387] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=info event=niks3_push_started pid=1663 worker2 # [ 135.431701] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.722Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 135.519385] nix-daemon[869]: accepted connection from pid 1676, user nix-grpc-daemon (trusted) worker2 # [ 135.532352] nix-daemon[869]: reaped child process 1679, status = succeeded lb # [ 135.544568] niks3-server[1108]: 2026/09/22 22:24:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.556146] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.848Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 135.557719] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.850Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 135.589361] niks3-server[1108]: 2026/09/22 22:24:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 135.601400] niks3-server[1108]: 2026/09/22 22:24:03 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 135.605622] niks3-server[1108]: 2026/09/22 22:24:03 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 135.619353] niks3-server[1108]: 2026/09/22 22:24:03 INFO Signed narinfos id=53 count=1 worker2 # [ 135.617824] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.910Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.630489] niks3-server[1108]: 2026/09/22 22:24:03 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 135.638872] niks3-server[1108]: 2026/09/22 22:24:03 INFO Completed upload id=53 worker2 # [ 135.637560] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.929Z level=INFO msg="Upload complete. (206ms)" lb # [ 135.640488] niks3-server[1108]: 2026/09/22 22:24:04 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 135.642250] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 135.648533] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 135.660111] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 135.668458] nix-daemon[869]: reaped child process 1661, status = succeeded worker2 # [ 135.672655] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # [ 135.686597] nix[1434]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 137.361651] systemd[1]: intr.service: Sent signal SIGINT to main process 1434 (nix) on client request. worker2 # [ 137.348940] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:05Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 137.367793] nix[1434]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 137.374781] nix[1434]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 137.403492] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 137.406305] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 137.410215] systemd[1]: intr.service: Consumed 117ms CPU time over 3.473s wall clock time, 41.4M memory peak, 6.3K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 137.491245] nix-daemon[869]: reaped child process 1681, status = succeeded worker2 # [ 137.493749] nix-daemon[1683]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 137.498507] nix-daemon[869]: reaped child process 1683, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.65 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 138.605985] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 5bfb8a43338e4d5caf02069ad03d1832 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds) worker1 # [ 138.732312] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38530 client # [ 138.748722] nix[1454]: don't know how to build these paths: client # [ 138.749614] nix[1454]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 138.746589] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 138.751878] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 138.791217] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 worker1 # [ 138.804646] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38530 client # [ 138.825215] nix[1454]: copying 1 paths to 'lb:50051'... client # [ 138.827114] nix[1454]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 138.816406] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38530 worker1 # [ 138.825991] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker1 # [ 138.924786] nix-daemon[846]: accepted connection from pid 1691, user nix-grpc-daemon (trusted) worker1 # [ 138.937523] nix-daemon[846]: reaped child process 1694, status = succeeded lb # [ 138.942687] niks3-server[1108]: 2026/09/22 22:24:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.954864] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.956920] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.143Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 138.975158] niks3-server[1108]: 2026/09/22 22:24:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 138.982320] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.169Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.980088] niks3-server[1108]: 2026/09/22 22:24:07 INFO Signed narinfos id=54 count=1 lb # [ 138.987547] niks3-server[1108]: 2026/09/22 22:24:07 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 138.999693] niks3-server[1108]: 2026/09/22 22:24:07 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 139.002453] niks3-server[1108]: 2026/09/22 22:24:07 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 139.006785] niks3-server[1108]: 2026/09/22 22:24:07 INFO Completed upload id=54 worker1 # [ 139.009439] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.196Z level=INFO msg="Upload complete. (169ms)" lb # [ 139.009804] niks3-server[1108]: 2026/09/22 22:24:07 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 139.013438] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 139.018298] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 worker1 # [ 139.027815] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker1 # [ 139.033115] nix-daemon[846]: reaped child process 1689, status = succeeded worker1 # [ 139.037888] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) client # [ 139.047499] nix[1454]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 141.026824] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 141.052935] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 141.232950] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 141.239135] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 worker1 # [ 141.260583] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:10Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 141.263170] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:10Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 141.305792] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 141.318564] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 client # copying 1 paths to 'lb:50051'... worker2 # [ 141.333243] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 141.357993] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 141.466038] nix-daemon[869]: accepted connection from pid 1734, user nix-grpc-daemon (trusted) worker2 # [ 141.479134] nix-daemon[869]: reaped child process 1737, status = succeeded worker1 # [ 141.488241] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:10Z level=info event=draining lb # [ 141.489353] niks3-server[1108]: 2026/09/22 22:24:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.499844] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.792Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 141.502230] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.793Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 141.520492] niks3-server[1108]: 2026/09/22 22:24:09 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 141.531448] niks3-server[1108]: 2026/09/22 22:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 141.536933] niks3-server[1108]: 2026/09/22 22:24:09 INFO Signed narinfos id=55 count=1 worker2 # [ 141.540660] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.832Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.546085] niks3-server[1108]: 2026/09/22 22:24:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 141.558214] niks3-server[1108]: 2026/09/22 22:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 141.565240] niks3-server[1108]: 2026/09/22 22:24:09 INFO Completed upload id=55 worker2 # [ 141.563544] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.855Z level=INFO msg="Upload complete. (191ms)" lb # [ 141.568278] niks3-server[1108]: 2026/09/22 22:24:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 141.568726] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 141.574671] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 141.584118] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 141.596214] nix-daemon[869]: reaped child process 1732, status = succeeded worker2 # [ 141.599886] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 142.636255] nix-daemon[869]: reaped child process 1741, status = succeeded worker2 # [ 142.712337] nix-daemon[869]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker2 # [ 142.724892] nix-daemon[869]: reaped child process 1760, status = succeeded lb # [ 142.736477] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 142.745403] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.037Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 142.746929] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.039Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 142.782989] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 142.787463] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 142.794283] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 142.798921] niks3-server[1108]: 2026/09/22 22:24:11 INFO Signed narinfos id=56 count=1 worker2 # [ 142.800338] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.092Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.809096] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 142.818285] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 142.822416] niks3-server[1108]: 2026/09/22 22:24:11 INFO Completed upload id=56 lb # [ 142.824823] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 142.822336] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.114Z level=INFO msg="Upload complete. (215ms)" worker2 # [ 142.828839] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=1 worker1 # [ 142.837244] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:12Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 142.840319] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:12Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 142.844392] nix-daemon[869]: reaped child process 1739, status = succeeded worker2 # [ 142.879543] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 142.895064] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 142.908408] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.200Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 142.917081] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 142.930336] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 143.032770] nix-daemon[869]: accepted connection from pid 1764, user nix-grpc-daemon (trusted) worker2 # [ 143.046073] nix-daemon[869]: reaped child process 1767, status = succeeded lb # [ 143.055760] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.063210] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.355Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 143.065045] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.357Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 143.088431] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 143.096275] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker2 # [ 143.103380] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.395Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.104587] niks3-server[1108]: 2026/09/22 22:24:11 INFO Signed narinfos id=57 count=1 lb # [ 143.111064] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 143.124105] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 143.131808] niks3-server[1108]: 2026/09/22 22:24:11 INFO Completed upload id=57 worker2 # [ 143.130238] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.422Z level=INFO msg="Upload complete. (187ms)" lb # [ 143.135299] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 143.134241] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 143.138929] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 143.150125] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 143.157213] nix-daemon[869]: reaped child process 1762, status = succeeded worker2 # [ 143.162253] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 143.795860] nix-daemon[869]: reaped child process 1771, status = succeeded worker2 # [ 143.878398] nix-daemon[869]: accepted connection from pid 1787, user nix-grpc-daemon (trusted) worker2 # [ 143.889728] nix-daemon[869]: reaped child process 1790, status = succeeded lb # [ 143.900990] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.907821] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.200Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 143.909442] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.201Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 143.937857] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 143.951117] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 143.958759] niks3-server[1108]: 2026/09/22 22:24:12 INFO Signed narinfos id=58 count=1 worker2 # [ 143.960641] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.252Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.962853] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 143.972119] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 143.980355] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 143.984340] niks3-server[1108]: 2026/09/22 22:24:12 INFO Completed upload id=58 worker2 # [ 143.983152] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.275Z level=INFO msg="Upload complete. (215ms)" lb # [ 143.986911] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker1 # [ 143.998343] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:13Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 143.989735] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=1 worker1 # [ 144.001174] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:13Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 144.005606] nix-daemon[869]: reaped child process 1769, status = succeeded worker2 # [ 144.037992] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 144.050818] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 144.063320] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.355Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 144.072718] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 144.092161] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 144.197186] nix-daemon[869]: accepted connection from pid 1794, user nix-grpc-daemon (trusted) worker2 # [ 144.211217] nix-daemon[869]: reaped child process 1797, status = succeeded lb # [ 144.220669] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 144.227200] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.519Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 144.228742] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.521Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 144.254714] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 144.259900] niks3-server[1108]: 2026/09/22 22:24:12 INFO Signed narinfos id=59 count=1 worker2 # [ 144.261269] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.553Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.263766] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 144.273732] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 144.283522] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 144.288823] niks3-server[1108]: 2026/09/22 22:24:12 INFO Completed upload id=59 worker2 # [ 144.289858] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.582Z level=INFO msg="Upload complete. (184ms)" lb # [ 144.295045] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 144.294598] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 144.300247] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 144.311495] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 144.319881] nix-daemon[869]: reaped child process 1792, status = succeeded worker2 # [ 144.324409] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 145.187517] envoy[904]: conn peer=[2001:db8:1::1]:39422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2993 tx=827 ms=3328 client # farm-top> LOG-farm-top-during-drain worker2 # [ 145.360989] nix-daemon[869]: reaped child process 1801, status = succeeded worker2 # [ 145.444499] nix-daemon[869]: accepted connection from pid 1817, user nix-grpc-daemon (trusted) worker2 # [ 145.458364] nix-daemon[869]: reaped child process 1820, status = succeeded lb # [ 145.467270] niks3-server[1108]: 2026/09/22 22:24:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 145.476294] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.768Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 145.477852] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.770Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 145.507065] niks3-server[1108]: 2026/09/22 22:24:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 145.511331] niks3-server[1108]: 2026/09/22 22:24:13 INFO Signed narinfos id=60 count=1 worker2 # [ 145.512699] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.805Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.523602] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 145.528211] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 145.536100] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 145.545266] niks3-server[1108]: 2026/09/22 22:24:13 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 145.548192] niks3-server[1108]: 2026/09/22 22:24:13 INFO Completed upload id=60 worker2 # [ 145.548271] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.840Z level=INFO msg="Upload complete. (214ms)" lb # [ 145.551771] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 145.554812] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=1 worker2 # [ 145.569607] nix-daemon[869]: reaped child process 1799, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.51 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 145.859603] nix-daemon[846]: reaped child process 1698, status = succeeded worker1 # [ 145.932876] nix-daemon[846]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 145.945462] nix-daemon[846]: reaped child process 1748, status = succeeded lb # [ 145.950389] niks3-server[1108]: 2026/09/22 22:24:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.961000] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.148Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.962550] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.150Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 145.986460] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 145.996586] niks3-server[1108]: 2026/09/22 22:24:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 146.005688] niks3-server[1108]: 2026/09/22 22:24:14 INFO Signed narinfos id=61 count=1 worker1 # [ 146.011334] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.198Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.009746] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 146.017305] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 146.029057] niks3-server[1108]: 2026/09/22 22:24:14 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 146.033181] niks3-server[1108]: 2026/09/22 22:24:14 INFO Completed upload id=61 lb # [ 146.035783] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 146.036320] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.223Z level=INFO msg="Upload complete. (185ms)" worker1 # [ 146.042816] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=1 worker1 # [ 146.058515] nix-daemon[846]: reaped child process 1696, status = succeeded client # [ 146.091334] systemd[1]: sw.service: Deactivated successfully. client # [ 146.094490] systemd[1]: sw.service: Consumed 121ms CPU time over 7.484s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 146.491712] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:15Z level=info event=signal_exit lb # [ 146.494786] niks3-server[1108]: 2026/09/22 22:24:14 INFO lead: released remote=192.168.1.3:48460 client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 147.494583] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 147.496831] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=scheduler_restarting worker1 # [ 147.506906] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 147.510709] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38534 worker1 # [ 147.514111] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 147.517297] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38534 worker1 # [ 147.520914] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 147.540603] nix-daemon[846]: reaped child process 1583, status = succeeded lb # [ 147.572602] niks3-server[1108]: 2026/09/22 22:24:15 INFO lead: acquired remote=192.168.1.4:40444 worker2 # [ 147.574110] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_take_over worker2 # [ 147.694926] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 147.698985] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 147.706797] nix-grpc-daemon[1526]: E0000 00:00:1790115856.893981 1572 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 22, started true, shutdown true worker1 # [ 147.715366] nix-grpc-daemon[1526]: E0000 00:00:1790115856.894214 1572 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 147.724294] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 147.899892] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 147.903892] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 148.104981] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.109226] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 148.310178] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.314156] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 148.515935] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 148.521891] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 148.526144] systemd[1]: nix-grpc-daemon.service: Consumed 671ms CPU time over 26.147s wall clock time, 36.5M memory peak, 28.8K incoming IP traffic, 40K outgoing IP traffic. worker2 # [ 148.529137] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 148.533156] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:35412 worker1 # [ 148.542283] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 148.537180] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 148.632358] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 148.634493] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 148.637778] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 148.642053] nix-grpc-daemon[1762]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 148.643605] nix-grpc-daemon[1762]: E0000 00:00:1790115857.829378 1762 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.649635] nix-grpc-daemon[1762]: E0000 00:00:1790115857.834832 1762 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.651849] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 148.656583] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 148.659152] nix-grpc-daemon[1762]: E0000 00:00:1790115857.845664 1804 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.671878] nix-grpc-daemon[1762]: E0000 00:00:1790115857.859379 1804 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.677150] nix-grpc-daemon[1762]: E0000 00:00:1790115857.861697 1804 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.84 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 148.687543] nix-grpc-daemon[1762]: E0000 00:00:1790115857.875006 1804 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.699371] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.696272] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:35412 worker2 # [ 148.701360] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 11.30 seconds) subtest: queue gauges show a burst while every build blocks lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]' client # [ 150.009225] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # Running as unit: burst.service; invocation ID: 7a01a1542df74a4fadc33e80335ab194 client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 150.136646] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54604 client # [ 150.156210] nix[1510]: don't know how to build these paths: client # [ 150.157210] nix[1510]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv client # [ 150.158174] nix[1510]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv client # [ 150.159338] nix[1510]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv client # [ 150.160443] nix[1510]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker2 # [ 150.148284] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=0 worker2 # [ 150.153567] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 150.157589] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=0 worker2 # [ 150.160698] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 150.164219] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=0 worker2 # [ 150.167325] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=0 worker2 # [ 150.197862] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker1 # [ 150.205790] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker2 # [ 150.210890] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 worker1 # [ 150.217201] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) client # [ 150.236156] nix[1510]: copying 1 paths to 'lb:50051'... worker2 # [ 150.222969] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 client # [ 150.238235] nix[1510]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'... worker1 # [ 150.233820] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker2 # [ 150.235377] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker1 # [ 150.326478] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5) worker2 # [ 150.332889] nix-daemon[869]: accepted connection from pid 1835, user nix-grpc-daemon (trusted) worker2 # [ 150.345743] nix-daemon[869]: reaped child process 1838, status = succeeded lb # [ 150.356739] niks3-server[1108]: 2026/09/22 22:24:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 150.364460] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.656Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 150.366422] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.658Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)" lb # [ 150.390316] niks3-server[1108]: 2026/09/22 22:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 150.396518] niks3-server[1108]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst lb # [ 150.407189] niks3-server[1108]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls lb # [ 150.415040] niks3-server[1108]: 2026/09/22 22:24:18 INFO Signed narinfos id=62 count=1 worker2 # [ 150.413972] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.705Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.420701] niks3-server[1108]: 2026/09/22 22:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 150.430988] niks3-server[1108]: 2026/09/22 22:24:18 INFO Completed upload id=62 worker2 # [ 150.429594] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.722Z level=INFO msg="Upload complete. (183ms)" lb # [ 150.432511] niks3-server[1108]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo worker2 # [ 150.433567] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 150.438758] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 150.450105] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 150.454506] nix-daemon[869]: reaped child process 1833, status = succeeded worker2 # [ 150.459391] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # [ 150.473233] nix[1510]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051... worker1 # [ 150.479477] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 3/5) worker1 # [ 150.547222] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 554 ms (attempt 4/5) worker1 # [ 151.104277] nix-grpc-daemon[1762]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 151.107666] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 151.125454] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 client # [ 151.145215] nix[1510]: copying 1 paths to 'lb:50051'... lb: must succeed: curl -sf localhost:9901/clusters client # [ 151.149162] nix[1510]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'... worker1 # [ 151.139499] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 151.148322] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 151.173247] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=info event=niks3_push_started pid=1823 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1 # [ 151.279341] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.466Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 151.373731] nix-daemon[846]: accepted connection from pid 1839, user nix-grpc-daemon (trusted) worker1 # [ 151.384683] nix-daemon[846]: reaped child process 1842, status = succeeded lb # [ 151.393488] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.404168] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.591Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.405674] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.593Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)" lb # [ 151.434455] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst lb # [ 151.440194] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 151.449283] niks3-server[1108]: 2026/09/22 22:24:19 INFO Signed narinfos id=63 count=1 worker1 # [ 151.455297] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.642Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.461093] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls lb # [ 151.470867] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete worker2 # [ 151.472065] nix-daemon[869]: reaped child process 1842, status = succeeded lb # [ 151.477552] niks3-server[1108]: 2026/09/22 22:24:19 INFO Completed upload id=63 worker1 # [ 151.480404] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.667Z level=INFO msg="Upload complete. (197ms)" lb # [ 151.479838] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo worker1 # [ 151.485563] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 151.493199] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 151.501547] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 151.509677] nix-daemon[846]: reaped child process 1821, status = succeeded worker1 # [ 151.515438] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) client # [ 151.525170] nix[1510]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051... worker2 # [ 151.553845] nix-daemon[869]: accepted connection from pid 1866, user nix-grpc-daemon (trusted) worker2 # [ 151.567949] nix-daemon[869]: reaped child process 1869, status = succeeded lb # [ 151.575733] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 151.582236] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.874Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 151.583945] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.876Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)" lb # [ 151.612730] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst lb # [ 151.623250] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls lb # [ 151.626788] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 151.630538] niks3-server[1108]: 2026/09/22 22:24:19 INFO Signed narinfos id=64 count=1 worker2 # [ 151.631323] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.923Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.641678] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv lb # [ 151.643319] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 151.646880] niks3-server[1108]: 2026/09/22 22:24:20 INFO Completed upload id=64 lb # [ 151.648725] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo worker2 # [ 151.646935] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.939Z level=INFO msg="Upload complete. (180ms)" worker2 # [ 151.653407] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=1 outputs=1 worker2 # [ 151.660522] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:19Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 151.669588] nix-daemon[869]: reaped child process 1840, status = succeeded worker2 # [ 151.703505] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 151.716057] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 client # [ 151.740166] nix[1510]: copying 1 paths to 'lb:50051'... client # [ 151.743811] nix[1510]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'... worker2 # [ 151.729996] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 151.738651] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 151.838833] nix-daemon[869]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 151.852653] nix-daemon[869]: reaped child process 1876, status = succeeded lb # [ 151.861724] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 151.867886] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.160Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 151.869491] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.161Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)" lb # [ 151.894850] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 151.903273] niks3-server[1108]: 2026/09/22 22:24:20 INFO Signed narinfos id=65 count=1 worker2 # [ 151.904895] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.197Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.909143] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst lb # [ 151.913258] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls lb # [ 151.925137] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 151.932960] niks3-server[1108]: 2026/09/22 22:24:20 INFO Completed upload id=65 worker2 # [ 151.931388] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.223Z level=INFO msg="Upload complete. (180ms)" lb # [ 151.936593] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo worker2 # [ 151.935400] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 151.941677] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 151.953106] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 151.960170] nix-daemon[869]: reaped child process 1871, status = succeeded worker2 # [ 151.964651] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # [ 151.978821] nix[1510]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051... worker1 # [ 152.530520] nix-daemon[846]: reaped child process 1847, status = succeeded worker1 # [ 152.606333] nix-daemon[846]: accepted connection from pid 1868, user nix-grpc-daemon (trusted) worker1 # [ 152.619054] nix-daemon[846]: reaped child process 1871, status = succeeded lb # [ 152.621871] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.633737] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.821Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.635421] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.822Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)" lb # [ 152.656104] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv lb # [ 152.674708] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 152.680094] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst worker1 # [ 152.687550] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.875Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.684816] niks3-server[1108]: 2026/09/22 22:24:21 INFO Signed narinfos id=66 count=1 lb # [ 152.691996] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls lb # [ 152.698115] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 152.701151] niks3-server[1108]: 2026/09/22 22:24:21 INFO Completed upload id=66 worker1 # [ 152.703827] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.891Z level=INFO msg="Upload complete. (182ms)" lb # [ 152.704277] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo worker1 # [ 152.709853] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=2 outputs=1 worker2 # [ 152.706495] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.722959] nix-daemon[846]: reaped child process 1845, status = succeeded worker1 # [ 152.761725] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 152.773691] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 client # [ 152.794811] nix[1510]: copying 1 paths to 'lb:50051'... worker1 # [ 152.785530] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 client # [ 152.796648] nix[1510]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'... worker1 # [ 152.795174] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 152.893884] nix-daemon[846]: accepted connection from pid 1875, user nix-grpc-daemon (trusted) worker1 # [ 152.906801] nix-daemon[846]: reaped child process 1878, status = succeeded lb # [ 152.911110] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.923680] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.111Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.925453] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.112Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)" lb # [ 152.946340] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 152.950644] niks3-server[1108]: 2026/09/22 22:24:21 INFO Signed narinfos id=67 count=1 worker1 # [ 152.957023] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.144Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.959628] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls lb # [ 152.965286] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst lb # [ 152.978197] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 152.985460] niks3-server[1108]: 2026/09/22 22:24:21 INFO Completed upload id=67 worker1 # [ 152.988112] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.175Z level=INFO msg="Upload complete. (180ms)" lb # [ 152.989391] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo worker1 # [ 152.991258] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 152.996313] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 153.005658] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 153.013949] nix-daemon[846]: reaped child process 1873, status = succeeded worker1 # [ 153.019555] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) client # [ 153.028448] nix[1510]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051... worker2 # [ 153.808852] nix-daemon[869]: reaped child process 1880, status = succeeded worker2 # [ 153.883979] nix-daemon[869]: accepted connection from pid 1905, user nix-grpc-daemon (trusted) worker2 # [ 153.897828] nix-daemon[869]: reaped child process 1908, status = succeeded lb # [ 153.905983] niks3-server[1108]: 2026/09/22 22:24:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 153.913726] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.205Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 153.915260] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.207Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)" lb # [ 153.952721] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls lb # [ 153.958352] niks3-server[1108]: 2026/09/22 22:24:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker2 # [ 153.961765] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.254Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.963403] niks3-server[1108]: 2026/09/22 22:24:22 INFO Signed narinfos id=68 count=1 lb # [ 153.968555] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst lb # [ 153.973384] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv lb # [ 153.982663] niks3-server[1108]: 2026/09/22 22:24:22 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 153.985588] niks3-server[1108]: 2026/09/22 22:24:22 INFO Completed upload id=68 worker2 # [ 153.984061] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.276Z level=INFO msg="Upload complete. (210ms)" lb # [ 153.987881] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo worker2 # [ 153.990664] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=3 outputs=1 worker2 # [ 154.004905] nix-daemon[869]: reaped child process 1878, status = succeeded worker1 # [ 154.851948] nix-daemon[846]: reaped child process 1882, status = succeeded worker1 # [ 154.928431] nix-daemon[846]: accepted connection from pid 1907, user nix-grpc-daemon (trusted) worker1 # [ 154.939809] nix-daemon[846]: reaped child process 1910, status = succeeded lb # [ 154.945345] niks3-server[1108]: 2026/09/22 22:24:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.955864] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.143Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 154.957509] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.144Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)" lb # [ 154.982794] niks3-server[1108]: 2026/09/22 22:24:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker1 # [ 154.990373] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.177Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.988175] niks3-server[1108]: 2026/09/22 22:24:23 INFO Signed narinfos id=69 count=1 lb # [ 154.997306] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv lb # [ 155.005879] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 155.017405] niks3-server[1108]: 2026/09/22 22:24:23 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 155.024289] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls lb # [ 155.027406] niks3-server[1108]: 2026/09/22 22:24:23 INFO Completed upload id=69 worker1 # [ 155.030270] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.217Z level=INFO msg="Upload complete. (203ms)" lb # [ 155.030682] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo worker1 # [ 155.036653] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=4 outputs=1 worker1 # [ 155.050748] nix-daemon[846]: reaped child process 1880, status = succeeded client # [ 155.079212] systemd[1]: burst.service: Deactivated successfully. client # [ 155.082329] systemd[1]: burst.service: Consumed 156ms CPU time over 5.070s wall clock time, 57.9M memory peak, 14.3K incoming IP traffic, 18.8K outgoing IP traffic. lb # [ 155.187754] envoy[904]: conn peer=[2001:db8:1::1]:39444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9525 tx=4336 ms=4340 lb # [ 155.191369] envoy[904]: conn peer=[2001:db8:1::1]:39428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2945 tx=1522 ms=7327 lb # [ 155.194915] envoy[904]: conn peer=[2001:db8:1::3]:32882 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2254 tx=669 ms=25182 lb # [ 155.198525] envoy[904]: conn peer=[2001:db8:1::1]:35138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9608 tx=5180 ms=4910 client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; } client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: queue gauges show a burst while every build blocks, in 6.25 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 156.243366] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54604 worker1 # [ 156.251770] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker2 # [ 156.286830] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=want client=2 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 156.291250] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 156.295681] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=want client=2 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 156.299585] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=want client=2 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 156.336126] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 156.348761] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 156.360087] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 156.371266] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 156.472299] nix-daemon[846]: accepted connection from pid 1918, user nix-grpc-daemon (trusted) worker1 # [ 156.485207] nix-daemon[846]: reaped child process 1921, status = succeeded lb # [ 156.490537] niks3-server[1108]: 2026/09/22 22:24:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.501877] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.689Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 156.503949] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.690Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 156.520518] niks3-server[1108]: 2026/09/22 22:24:24 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 156.530424] niks3-server[1108]: 2026/09/22 22:24:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 156.541435] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.728Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.538536] niks3-server[1108]: 2026/09/22 22:24:24 INFO Signed narinfos id=70 count=1 lb # [ 156.549621] niks3-server[1108]: 2026/09/22 22:24:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 156.558300] niks3-server[1108]: 2026/09/22 22:24:24 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 156.563769] niks3-server[1108]: 2026/09/22 22:24:24 INFO Completed upload id=70 worker1 # [ 156.566648] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.754Z level=INFO msg="Upload complete. (184ms)" lb # [ 156.568108] niks3-server[1108]: 2026/09/22 22:24:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 156.571349] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 156.577294] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 156.587147] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 156.596243] nix-daemon[846]: reaped child process 1916, status = succeeded worker1 # [ 156.600331] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 157.816249] nix-daemon[846]: reaped child process 1925, status = succeeded worker1 # [ 157.890168] nix-daemon[846]: accepted connection from pid 1941, user nix-grpc-daemon (trusted) worker1 # [ 157.903396] nix-daemon[846]: reaped child process 1944, status = succeeded lb # [ 157.909743] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.921445] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.108Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 157.923073] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.110Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 157.954108] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign worker1 # [ 157.962490] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.149Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.959745] niks3-server[1108]: 2026/09/22 22:24:26 INFO Signed narinfos id=71 count=1 lb # [ 157.968382] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 157.972900] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 157.977522] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 157.985333] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 157.991986] niks3-server[1108]: 2026/09/22 22:24:26 INFO Completed upload id=71 lb # [ 157.993832] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 157.996249] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.183Z level=INFO msg="Upload complete. (188ms)" worker1 # [ 158.002830] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=5 outputs=1 worker2 # [ 157.999848] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:26Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 158.009182] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:26Z level=debug event=want client=2 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 158.018126] nix-daemon[846]: reaped child process 1923, status = succeeded worker1 # [ 158.054507] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 158.067666] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 158.079603] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 158.087650] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 158.186523] nix-daemon[846]: accepted connection from pid 1948, user nix-grpc-daemon (trusted) worker1 # [ 158.201164] nix-daemon[846]: reaped child process 1951, status = succeeded lb # [ 158.202467] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.213054] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.400Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.214570] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.402Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 158.234692] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 158.243550] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 158.250687] niks3-server[1108]: 2026/09/22 22:24:26 INFO Signed narinfos id=72 count=1 worker1 # [ 158.256118] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.443Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.255274] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 158.269420] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 158.275546] niks3-server[1108]: 2026/09/22 22:24:26 INFO Completed upload id=72 worker1 # [ 158.277755] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.465Z level=INFO msg="Upload complete. (176ms)" lb # [ 158.278390] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 158.281796] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 158.288437] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 158.300059] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 158.307517] nix-daemon[846]: reaped child process 1946, status = succeeded worker1 # [ 158.312646] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 159.127890] nix-daemon[846]: reaped child process 1955, status = succeeded worker1 # [ 159.201237] nix-daemon[846]: accepted connection from pid 1971, user nix-grpc-daemon (trusted) worker1 # [ 159.215372] nix-daemon[846]: reaped child process 1974, status = succeeded lb # [ 159.217986] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.228757] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.416Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.230269] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.417Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 159.257784] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 159.270101] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign worker1 # [ 159.277740] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.465Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.276596] niks3-server[1108]: 2026/09/22 22:24:27 INFO Signed narinfos id=73 count=1 lb # [ 159.280831] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 159.288848] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 159.297161] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 159.304983] niks3-server[1108]: 2026/09/22 22:24:27 INFO Completed upload id=73 worker1 # [ 159.307640] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.495Z level=INFO msg="Upload complete. (188ms)" lb # [ 159.306775] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 159.314573] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=6 outputs=1 worker2 # [ 159.311372] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:27Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.323318] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker2 # [ 159.320658] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:27Z level=debug event=want client=2 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 159.333824] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 159.342408] nix-daemon[846]: reaped child process 1953, status = succeeded worker1 # [ 159.345733] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 159.349947] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 159.433518] nix-daemon[846]: accepted connection from pid 1978, user nix-grpc-daemon (trusted) worker1 # [ 159.447978] nix-daemon[846]: reaped child process 1981, status = succeeded lb # [ 159.449361] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.459704] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.647Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.461562] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.648Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 159.480286] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker1 # [ 159.492560] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.679Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.489668] niks3-server[1108]: 2026/09/22 22:24:27 INFO Signed narinfos id=74 count=1 lb # [ 159.493901] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 159.504549] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 159.512293] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 159.517727] niks3-server[1108]: 2026/09/22 22:24:27 INFO Completed upload id=74 worker1 # [ 159.519763] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.707Z level=INFO msg="Upload complete. (164ms)" lb # [ 159.522619] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 159.523730] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 159.528407] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 159.536603] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 159.546114] nix-daemon[846]: reaped child process 1976, status = succeeded worker1 # [ 159.549351] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 160.589802] nix-daemon[846]: reaped child process 1985, status = succeeded worker1 # [ 160.671730] nix-daemon[846]: accepted connection from pid 2001, user nix-grpc-daemon (trusted) worker1 # [ 160.683922] nix-daemon[846]: reaped child process 2004, status = succeeded lb # [ 160.687985] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.698656] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.885Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.700350] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.887Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 160.730433] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 160.738171] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker1 # [ 160.748131] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.935Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.745870] niks3-server[1108]: 2026/09/22 22:24:29 INFO Signed narinfos id=75 count=1 lb # [ 160.751908] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 160.755620] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 160.767088] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 160.771053] niks3-server[1108]: 2026/09/22 22:24:29 INFO Completed upload id=75 lb # [ 160.772871] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 160.773825] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.961Z level=INFO msg="Upload complete. (216ms)" worker2 # [ 160.777850] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:29Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 160.780956] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=7 outputs=1 worker2 # [ 160.786885] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:29Z level=debug event=want client=2 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 160.797329] nix-daemon[846]: reaped child process 1983, status = succeeded worker1 # [ 160.825523] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 160.838214] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 160.851142] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.038Z level=INFO msg="All 1 paths already cached" worker1 # [ 160.859181] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 160.869553] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 160.964894] nix-daemon[846]: accepted connection from pid 2008, user nix-grpc-daemon (trusted) worker1 # [ 160.978593] nix-daemon[846]: reaped child process 2011, status = succeeded lb # [ 160.981921] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.992484] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.179Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 160.994033] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.181Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 161.011836] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 161.020272] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.207Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.017903] niks3-server[1108]: 2026/09/22 22:24:29 INFO Signed narinfos id=76 count=1 lb # [ 161.026969] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 161.032263] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 161.044305] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 161.050715] niks3-server[1108]: 2026/09/22 22:24:29 INFO Completed upload id=76 worker1 # [ 161.053174] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.240Z level=INFO msg="Upload complete. (172ms)" lb # [ 161.054112] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 161.057465] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 161.063154] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 161.074137] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 161.079132] nix-daemon[846]: reaped child process 2006, status = succeeded worker1 # [ 161.082860] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 162.320697] nix-daemon[846]: reaped child process 2015, status = succeeded worker1 # [ 162.405466] nix-daemon[846]: accepted connection from pid 2031, user nix-grpc-daemon (trusted) worker1 # [ 162.416891] nix-daemon[846]: reaped child process 2034, status = succeeded lb # [ 162.422403] niks3-server[1108]: 2026/09/22 22:24:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.433260] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.620Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.437530] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.622Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 162.466487] niks3-server[1108]: 2026/09/22 22:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 162.474567] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 162.482261] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 162.489763] niks3-server[1108]: 2026/09/22 22:24:30 INFO Signed narinfos id=77 count=1 worker1 # [ 162.492676] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.680Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.493616] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 162.504398] niks3-server[1108]: 2026/09/22 22:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 162.507436] niks3-server[1108]: 2026/09/22 22:24:30 INFO Completed upload id=77 worker1 # [ 162.510267] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.697Z level=INFO msg="Upload complete. (219ms)" lb # [ 162.511393] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 162.516958] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=8 outputs=1 worker2 # [ 162.513624] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:30Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 162.523304] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:30Z level=debug event=want client=2 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 162.531946] nix-daemon[846]: reaped child process 2013, status = succeeded worker1 # [ 162.567174] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 162.580075] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 162.593712] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.781Z level=INFO msg="All 1 paths already cached" worker1 # [ 162.601404] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 162.611169] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 162.708464] nix-daemon[846]: accepted connection from pid 2038, user nix-grpc-daemon (trusted) worker1 # [ 162.723873] nix-daemon[846]: reaped child process 2041, status = succeeded lb # [ 162.724449] niks3-server[1108]: 2026/09/22 22:24:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.735484] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.922Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.736996] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.924Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 162.757239] niks3-server[1108]: 2026/09/22 22:24:31 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 162.763257] niks3-server[1108]: 2026/09/22 22:24:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 162.770539] niks3-server[1108]: 2026/09/22 22:24:31 INFO Signed narinfos id=78 count=1 worker1 # [ 162.776890] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.964Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.779205] niks3-server[1108]: 2026/09/22 22:24:31 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 162.789137] niks3-server[1108]: 2026/09/22 22:24:31 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete worker1 # [ 162.797840] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.985Z level=INFO msg="Upload complete. (175ms)" lb # [ 162.795620] niks3-server[1108]: 2026/09/22 22:24:31 INFO Completed upload id=78 lb # [ 162.800382] niks3-server[1108]: 2026/09/22 22:24:31 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 162.800239] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 162.805661] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 162.814699] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 162.821317] nix-daemon[846]: reaped child process 2036, status = succeeded worker1 # [ 162.825461] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 163.874764] nix-daemon[846]: reaped child process 2045, status = succeeded worker1 # [ 163.951797] nix-daemon[846]: accepted connection from pid 2061, user nix-grpc-daemon (trusted) worker1 # [ 163.965389] nix-daemon[846]: reaped child process 2064, status = succeeded lb # [ 163.968641] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.979927] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.167Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.981810] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.168Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 164.009120] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign worker1 # [ 164.020029] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.207Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.017831] niks3-server[1108]: 2026/09/22 22:24:32 INFO Signed narinfos id=79 count=1 lb # [ 164.022760] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 164.029424] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 164.035249] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 164.043912] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 164.050586] niks3-server[1108]: 2026/09/22 22:24:32 INFO Completed upload id=79 worker1 # [ 164.053505] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.240Z level=INFO msg="Upload complete. (220ms)" lb # [ 164.053882] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 164.059559] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=9 outputs=1 worker2 # [ 164.056809] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:32Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.075117] nix-daemon[846]: reaped child process 2043, status = succeeded worker1 # [ 164.105277] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker2 # [ 164.103702] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:32Z level=debug event=want client=2 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 164.117510] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 164.130508] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.317Z level=INFO msg="All 1 paths already cached" worker1 # [ 164.138221] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 164.148167] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 164.243457] nix-daemon[846]: accepted connection from pid 2068, user nix-grpc-daemon (trusted) worker1 # [ 164.258390] nix-daemon[846]: reaped child process 2071, status = succeeded lb # [ 164.259656] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.270697] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.458Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.272272] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.459Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 164.292921] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign lb # [ 164.297996] niks3-server[1108]: 2026/09/22 22:24:32 INFO Signed narinfos id=80 count=1 worker1 # [ 164.304506] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.491Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.304782] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 164.311577] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 164.325439] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 164.332979] niks3-server[1108]: 2026/09/22 22:24:32 INFO Completed upload id=80 worker1 # [ 164.335377] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.522Z level=INFO msg="Upload complete. (176ms)" lb # [ 164.336370] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 164.340649] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 164.346509] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 164.356107] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 164.368485] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 164.370681] nix-daemon[846]: reaped child process 2066, status = succeeded worker1 # [ 165.605674] nix-daemon[846]: reaped child process 2075, status = succeeded worker1 # [ 165.675361] nix-daemon[846]: accepted connection from pid 2091, user nix-grpc-daemon (trusted) worker1 # [ 165.688952] nix-daemon[846]: reaped child process 2094, status = succeeded lb # [ 165.692645] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.703403] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.890Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 165.705165] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.892Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 165.733617] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst worker1 # [ 165.746760] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.934Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.743985] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 165.747646] niks3-server[1108]: 2026/09/22 22:24:34 INFO Signed narinfos id=81 count=1 lb # [ 165.755794] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 165.759630] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 165.767280] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 165.773359] niks3-server[1108]: 2026/09/22 22:24:34 INFO Completed upload id=81 worker1 # [ 165.776351] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.963Z level=INFO msg="Upload complete. (199ms)" lb # [ 165.779056] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 165.781111] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=10 outputs=1 worker2 # [ 165.778261] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:34Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 165.789768] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker2 # [ 165.787854] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:34Z level=debug event=want client=2 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 165.801286] nix-daemon[846]: reaped child process 2073, status = succeeded worker1 # [ 165.804486] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 165.812344] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.999Z level=INFO msg="All 2 paths already cached" worker1 # [ 165.817625] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 165.822281] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 165.903053] nix-daemon[846]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 165.915615] nix-daemon[846]: reaped child process 2101, status = succeeded lb # [ 165.920215] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.932815] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.120Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.934764] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.121Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 165.954398] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 165.960134] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 165.965341] niks3-server[1108]: 2026/09/22 22:24:34 INFO Signed narinfos id=82 count=1 worker1 # [ 165.970947] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.158Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.976162] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 165.985449] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 165.989166] niks3-server[1108]: 2026/09/22 22:24:34 INFO Completed upload id=82 worker1 # [ 165.993141] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.180Z level=INFO msg="Upload complete. (166ms)" lb # [ 165.992624] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 165.997198] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 166.002104] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 166.011706] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 166.021112] nix-daemon[846]: reaped child process 2096, status = succeeded worker1 # [ 166.024165] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 166.638196] nix-daemon[846]: reaped child process 2105, status = succeeded worker1 # [ 166.713089] nix-daemon[846]: accepted connection from pid 2121, user nix-grpc-daemon (trusted) worker1 # [ 166.725558] nix-daemon[846]: reaped child process 2124, status = succeeded lb # [ 166.729469] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.743274] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.930Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.744982] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.932Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 166.778156] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 166.784860] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 166.791847] niks3-server[1108]: 2026/09/22 22:24:35 INFO Signed narinfos id=83 count=1 lb # [ 166.796375] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls worker1 # [ 166.799487] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.986Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.800332] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 166.811982] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 166.815943] niks3-server[1108]: 2026/09/22 22:24:35 INFO Completed upload id=83 lb # [ 166.817832] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 166.818822] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.006Z level=INFO msg="Upload complete. (188ms)" worker2 # [ 166.823197] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:35Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.828525] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=11 outputs=1 worker1 # [ 166.843233] nix-daemon[846]: reaped child process 2103, status = succeeded worker1 # [ 166.872295] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 166.885617] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 166.899581] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.086Z level=INFO msg="All 2 paths already cached" worker1 # [ 166.908276] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 166.919144] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 167.014114] nix-daemon[846]: accepted connection from pid 2128, user nix-grpc-daemon (trusted) worker1 # [ 167.029510] nix-daemon[846]: reaped child process 2131, status = succeeded lb # [ 167.031952] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.042264] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.229Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 167.043765] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.231Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 167.063447] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 167.069800] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign lb # [ 167.076769] niks3-server[1108]: 2026/09/22 22:24:35 INFO Signed narinfos id=84 count=1 worker1 # [ 167.084458] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.271Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.083146] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 167.099184] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 167.104191] niks3-server[1108]: 2026/09/22 22:24:35 INFO Completed upload id=84 worker1 # [ 167.106490] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.293Z level=INFO msg="Upload complete. (174ms)" lb # [ 167.107414] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 167.111364] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 167.117954] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 167.127653] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 167.136902] nix-daemon[846]: reaped child process 2126, status = succeeded worker1 # [ 167.141392] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 168.571305] nix-daemon[846]: reaped child process 2135, status = succeeded worker1 # [ 168.641931] nix-daemon[846]: accepted connection from pid 2151, user nix-grpc-daemon (trusted) worker1 # [ 168.656347] nix-daemon[846]: reaped child process 2154, status = succeeded lb # [ 168.660067] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.670713] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.858Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.673461] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.859Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 168.695934] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 168.706114] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign worker1 # [ 168.717410] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.904Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.714677] niks3-server[1108]: 2026/09/22 22:24:37 INFO Signed narinfos id=85 count=1 lb # [ 168.720596] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 168.726891] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 168.737234] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 168.739692] niks3-server[1108]: 2026/09/22 22:24:37 INFO Completed upload id=85 lb # [ 168.742506] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 168.743657] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.931Z level=INFO msg="Upload complete. (193ms)" worker2 # [ 168.746828] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:37Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 168.751598] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=12 outputs=1 worker1 # [ 168.765200] nix-daemon[846]: reaped child process 2133, status = succeeded worker1 # [ 168.794776] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 168.807814] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 168.820873] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.008Z level=INFO msg="All 2 paths already cached" worker1 # [ 168.828952] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 168.839137] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 168.932766] nix-daemon[846]: accepted connection from pid 2158, user nix-grpc-daemon (trusted) worker1 # [ 168.947134] nix-daemon[846]: reaped child process 2161, status = succeeded lb # [ 168.949216] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.959650] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.147Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.961205] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.148Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 168.978802] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/86/sign lb # [ 168.983811] niks3-server[1108]: 2026/09/22 22:24:37 INFO Signed narinfos id=86 count=1 worker1 # [ 168.989289] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.176Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.991916] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 169.000476] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 169.011526] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/86/complete worker1 # [ 169.018864] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.206Z level=INFO msg="Upload complete. (168ms)" lb # [ 169.016465] niks3-server[1108]: 2026/09/22 22:24:37 INFO Completed upload id=86 worker1 # [ 169.021747] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 169.021042] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 169.027739] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 worker1 # [ 169.036727] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 169.041686] nix-daemon[846]: reaped child process 2156, status = succeeded worker1 # [ 169.046740] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 170.083865] nix-daemon[846]: reaped child process 2165, status = succeeded worker1 # [ 170.163403] nix-daemon[846]: accepted connection from pid 2181, user nix-grpc-daemon (trusted) worker1 # [ 170.177141] nix-daemon[846]: reaped child process 2184, status = succeeded lb # [ 170.181444] niks3-server[1108]: 2026/09/22 22:24:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.192404] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.379Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.193943] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.381Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 170.221671] niks3-server[1108]: 2026/09/22 22:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/87/sign worker1 # [ 170.232193] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.419Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.229466] niks3-server[1108]: 2026/09/22 22:24:38 INFO Signed narinfos id=87 count=1 lb # [ 170.237105] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 170.243530] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 170.250110] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 170.257115] niks3-server[1108]: 2026/09/22 22:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/87/complete lb # [ 170.262954] niks3-server[1108]: 2026/09/22 22:24:38 INFO Completed upload id=87 worker1 # [ 170.265330] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.452Z level=INFO msg="Upload complete. (209ms)" lb # [ 170.268600] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 170.270678] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=13 outputs=1 worker1 # [ 170.285217] nix-daemon[846]: reaped child process 2163, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 14.25 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 170.456061] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 79b88f80a3fa43e9a3e2e2131993b960 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 170.578902] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54604 client # [ 170.599111] nix[1580]: don't know how to build these paths: client # [ 170.600195] nix[1580]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 170.587213] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 client # [ 170.615814] nix[1580]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker worker2 # [ 170.601222] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:38Z level=debug event=want client=3 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 175.187882] envoy[904]: conn peer=[2001:db8:1::1]:46774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27051 tx=12297 ms=14082 client # [ 200.616542] nix[1580]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 200.624507] nix[1580]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 200.651585] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 200.654910] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 200.659339] systemd[1]: gpu.service: Consumed 133ms CPU time over 30.203s wall clock time, 37.6M memory peak, 5.1K incoming IP traffic, 5.1K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.40 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.16 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 202.669363] nix-grpc-daemon[1762]: ts=2026-09-22T22:25:11Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 203.481095] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 203.486694] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 203.507112] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=want client=4 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 203.512391] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 203.551701] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 203.564449] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 203.577471] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 203.589464] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 203.694524] nix-daemon[869]: accepted connection from pid 1950, user nix-grpc-daemon (trusted) worker2 # [ 203.708340] nix-daemon[869]: reaped child process 1953, status = succeeded lb # [ 203.719596] niks3-server[1108]: 2026/09/22 22:25:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.726561] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.018Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 203.728601] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.020Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 203.757211] niks3-server[1108]: 2026/09/22 22:25:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/88/sign worker2 # [ 203.763263] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.055Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.764646] niks3-server[1108]: 2026/09/22 22:25:12 INFO Signed narinfos id=88 count=1 lb # [ 203.772492] niks3-server[1108]: 2026/09/22 22:25:12 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 203.778372] niks3-server[1108]: 2026/09/22 22:25:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 203.794177] niks3-server[1108]: 2026/09/22 22:25:12 INFO Received complete upload request method=POST path=/api/pending_closures/88/complete lb # [ 203.797223] niks3-server[1108]: 2026/09/22 22:25:12 INFO Completed upload id=88 worker2 # [ 203.795909] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.088Z level=INFO msg="Upload complete. (194ms)" lb # [ 203.799868] niks3-server[1108]: 2026/09/22 22:25:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 203.800847] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 203.808207] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 203.818667] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 203.827434] nix-daemon[869]: reaped child process 1948, status = succeeded client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... worker2 # [ 203.835745] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 205.050083] nix-daemon[869]: reaped child process 1957, status = succeeded worker2 # [ 205.127881] nix-daemon[869]: accepted connection from pid 1973, user nix-grpc-daemon (trusted) worker2 # [ 205.139607] nix-daemon[869]: reaped child process 1976, status = succeeded lb # [ 205.149638] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.161449] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.453Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 205.162971] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.455Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 205.189329] envoy[904]: conn peer=[2001:db8:1::1]:33822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=561 ms=30042 lb # [ 205.197842] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 205.202419] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 205.207875] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/89/sign lb # [ 205.210947] niks3-server[1108]: 2026/09/22 22:25:13 INFO Signed narinfos id=89 count=1 worker2 # [ 205.209635] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.501Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.215715] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 205.219883] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/89/complete lb # [ 205.222894] niks3-server[1108]: 2026/09/22 22:25:13 INFO Completed upload id=89 worker2 # [ 205.221559] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.513Z level=INFO msg="Upload complete. (179ms)" lb # [ 205.225620] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 205.227644] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=14 outputs=1 worker2 # [ 205.237723] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=want client=4 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 205.242206] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 205.250457] nix-daemon[869]: reaped child process 1955, status = succeeded worker2 # [ 205.280818] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 205.293076] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 205.305506] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.597Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 205.313803] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 205.323270] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 205.416336] nix-daemon[869]: accepted connection from pid 1982, user nix-grpc-daemon (trusted) worker2 # [ 205.428636] nix-daemon[869]: reaped child process 1985, status = succeeded lb # [ 205.438679] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.445435] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.737Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 205.447836] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.740Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 205.471493] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/90/sign lb # [ 205.476395] niks3-server[1108]: 2026/09/22 22:25:13 INFO Signed narinfos id=90 count=1 worker2 # [ 205.477442] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.769Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.484259] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 205.491078] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 205.498973] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/90/complete lb # [ 205.502439] niks3-server[1108]: 2026/09/22 22:25:13 INFO Completed upload id=90 worker2 # [ 205.500927] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.793Z level=INFO msg="Upload complete. (167ms)" lb # [ 205.504304] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 205.505126] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 205.511176] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 205.518864] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 205.525836] nix-daemon[869]: reaped child process 1980, status = succeeded worker2 # [ 205.528623] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 206.743763] nix-daemon[869]: reaped child process 1989, status = succeeded worker2 # [ 206.821355] nix-daemon[869]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker2 # [ 206.832644] nix-daemon[869]: reaped child process 2008, status = succeeded lb # [ 206.843180] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.849651] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.141Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 206.851187] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.143Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 206.886725] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/91/sign worker2 # [ 206.892239] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.184Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.894143] niks3-server[1108]: 2026/09/22 22:25:15 INFO Signed narinfos id=91 count=1 lb # [ 206.902337] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 206.907117] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 206.913829] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 206.923559] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received complete upload request method=POST path=/api/pending_closures/91/complete lb # [ 206.929404] niks3-server[1108]: 2026/09/22 22:25:15 INFO Completed upload id=91 worker2 # [ 206.927606] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.219Z level=INFO msg="Upload complete. (191ms)" lb # [ 206.931962] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 206.934558] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=15 outputs=1 worker2 # [ 206.946382] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=want client=4 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 206.950383] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 206.959818] nix-daemon[869]: reaped child process 1987, status = succeeded worker2 # [ 206.990555] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 207.002987] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 207.016409] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.308Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 207.026160] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 207.036164] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 207.136386] nix-daemon[869]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker2 # [ 207.151178] nix-daemon[869]: reaped child process 2017, status = succeeded lb # [ 207.159747] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.166127] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.458Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 207.167677] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.460Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 207.188881] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/92/sign lb # [ 207.194300] niks3-server[1108]: 2026/09/22 22:25:15 INFO Signed narinfos id=92 count=1 worker2 # [ 207.195552] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.488Z level=INFO msg="Uploading 1 narinfos" lb # [ 207.205171] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 207.214808] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 207.225580] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received complete upload request method=POST path=/api/pending_closures/92/complete worker2 # [ 207.229376] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.521Z level=INFO msg="Upload complete. (182ms)" lb # [ 207.230925] niks3-server[1108]: 2026/09/22 22:25:15 INFO Completed upload id=92 lb # [ 207.232843] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 207.231538] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 207.235484] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 worker2 # [ 207.243995] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 207.250965] nix-daemon[869]: reaped child process 2012, status = succeeded worker2 # [ 207.255892] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 208.495617] nix-daemon[869]: reaped child process 2021, status = succeeded worker2 # [ 208.575637] nix-daemon[869]: accepted connection from pid 2037, user nix-grpc-daemon (trusted) worker2 # [ 208.586983] nix-daemon[869]: reaped child process 2040, status = succeeded lb # [ 208.598284] niks3-server[1108]: 2026/09/22 22:25:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 208.604683] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.896Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 208.606333] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.898Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 208.638197] niks3-server[1108]: 2026/09/22 22:25:16 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 208.647516] niks3-server[1108]: 2026/09/22 22:25:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/93/sign lb # [ 208.652281] niks3-server[1108]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 208.660722] niks3-server[1108]: 2026/09/22 22:25:17 INFO Signed narinfos id=93 count=1 worker2 # [ 208.662592] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.954Z level=INFO msg="Uploading 1 narinfos" lb # [ 208.669615] niks3-server[1108]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 208.677178] niks3-server[1108]: 2026/09/22 22:25:17 INFO Received complete upload request method=POST path=/api/pending_closures/93/complete lb # [ 208.682794] niks3-server[1108]: 2026/09/22 22:25:17 INFO Completed upload id=93 lb # [ 208.685842] niks3-server[1108]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 208.682899] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.975Z level=INFO msg="Upload complete. (219ms)" worker2 # [ 208.689712] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=16 outputs=1 worker2 # [ 208.705147] nix-daemon[869]: reaped child process 2019, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.39 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 209.671494] nix-grpc-daemon[1762]: ts=2026-09-22T22:25:18Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.84 seconds) (finished: run the VM test script, in 210.99 seconds) test script finished in 211.17s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T22:25:20Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T22:25:20Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T22:25:20Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.03 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh