tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) lb # Formatting '/build/vm-state-lb/tmp.YU0TGN12un', fmt=raw size=1073741824 client # Formatting '/build/vm-state-client/tmp.a3IIkCCYTp', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done worker1 # Formatting '/build/vm-state-worker1/tmp.lu775QR304', fmt=raw size=1073741824 lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # mke2fs 1.47.4 (6-Mar-2025) lb # Filesystem UUID: 584ecce4-ad2e-4d2e-9f8c-48f804df99f9 worker1 # Discarding device blocks: 0/262144 done lb # Superblock backups stored on blocks: worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # 32768, 98304, 163840, 229376 worker1 # Filesystem UUID: d062716e-6d66-4e79-a03e-5a9d2dc53b53 lb # worker1 # Superblock backups stored on blocks: lb # Allocating group tables: 0/8 done worker1 # 32768, 98304, 163840, 229376 client # Filesystem UUID: b9f13cff-0ead-459d-99cb-c38c5adb499c lb # Writing inode tables: 0/8 done worker1 # client # Superblock backups stored on blocks: lb # Creating journal (8192 blocks): done worker1 # Allocating group tables: 0/8 done client # 32768, 98304, 163840, 229376 lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Writing inode tables: 0/8 done client # lb # worker1 # Creating journal (8192 blocks): done client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done lb # Virtualisation disk image created. worker2: QEMU running (pid 52) worker2 # Disk image does not exist, creating the virtualisation disk image... lb # Starting virtiofs daemons... worker1 # Writing superblocks and filesystem accounting information: 0/8 done (finished: start all VMs, in 0.24 seconds) lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # client: waiting for unit network-addresses-eth1.service lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # Virtualisation disk image created. client: waiting for the VM to finish booting lb # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # Starting virtiofs daemons... worker2 # Formatting '/build/vm-state-worker2/tmp.4SvOpmkl2X', fmt=raw size=1073741824 worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Creating journal (8192 blocks): done worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Discarding device blocks: 0/262144 done lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... client # worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Filesystem UUID: 27aedd73-c7f5-47bc-89d2-75f46435235d lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Virtualisation disk image created. worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Starting virtiofs daemons... worker2 # Superblock backups stored on blocks: worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # 32768, 98304, 163840, 229376 worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # Allocating group tables: 0/8 done worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Writing inode tables: 0/8 done client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Creating journal (8192 blocks): done client # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Virtualisation disk image created. client # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # Starting virtiofs daemons... client # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker2 # worker2 # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker1 # Booting from ROM... client # Booting from ROM... worker2 # Booting from ROM... lb # Booting from ROM... worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4idnay9kf4i79rgksq2a0cx0x5kksln8-nixos-system-worker1-test/init regInfo=/nix/store/hnxmbc46xwssrsa5c66xddlq152f9x0y-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test/init regInfo=/nix/store/9lyia4mvv2i1s4lyj2244g6qjddq61k6-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xnscg6z9qxa84gbw1h8qb1f0c0aarhsv-nixos-system-worker2-test/init regInfo=/nix/store/l9mgb5s68rv42f8xbdmqfv6fgq35z9b7-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] NX (Execute Disable) protection: active lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000001] kvm-clock: using sched offset of 479607283 cycles client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000001] kvm-clock: using sched offset of 498262300 cycles worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] kvm-clock: using sched offset of 471071575 cycles lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.002742] Using GB pages for direct mapping client # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.002831] RAMDISK: [mem 0x5e370000-0x5ffcffff] client # [ 0.002735] Using GB pages for direct mapping worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.002861] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker1 # [ 0.002840] ACPI: Early table checksum verification disabled worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.002869] ACPI: Early table checksum verification disabled worker1 # [ 0.002843] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002872] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002846] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002876] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002731] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.002851] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.002742] Using GB pages for direct mapping client # [ 0.002881] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.002858] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002884] RAMDISK: [mem 0x5e36f000-0x5ffcffff] worker1 # [ 0.002860] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.002887] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002893] ACPI: Early table checksum verification disabled lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.002889] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.002896] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.002862] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.002891] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002900] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.002863] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] SMBIOS 2.8 present. client # [ 0.002893] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002904] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002865] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002894] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.002911] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002866] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.002913] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.000000] Hypervisor detected: KVM client # [ 0.002896] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002868] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002915] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002897] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.002869] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002898] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002916] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] kvm-clock: using sched offset of 495544413 cycles worker1 # [ 0.002869] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002898] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002870] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.002918] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.002899] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.002870] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000004] tsc: Detected 2400.012 MHz processor worker2 # [ 0.002919] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002899] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002871] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.002920] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.002900] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.002871] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.002921] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.003103] No NUMA configuration found client # [ 0.002900] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.003121] No NUMA configuration found worker2 # [ 0.002922] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.003103] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.002726] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.003122] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.002922] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.003106] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.002736] Using GB pages for direct mapping worker1 # [ 0.005307] Zone ranges: client # [ 0.003124] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.002889] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker2 # [ 0.002923] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.005339] Zone ranges: worker1 # [ 0.005308] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.002897] ACPI: Early table checksum verification disabled client # [ 0.005340] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002923] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.005310] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.002899] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.005311] Normal empty client # [ 0.005342] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.002924] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.005312] Device empty client # [ 0.005343] Normal empty worker2 # [ 0.003152] No NUMA configuration found worker1 # [ 0.005312] Movable zone start for each node client # [ 0.005343] Device empty lb # [ 0.002903] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005313] Early memory node ranges client # [ 0.005344] Movable zone start for each node worker2 # [ 0.003153] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.002907] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005345] Early memory node ranges worker1 # [ 0.005313] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.003155] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.005383] Zone ranges: client # [ 0.005345] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.005314] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.002913] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005384] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.005346] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.002915] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.005315] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.005386] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.005347] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.005334] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.005387] Normal empty lb # [ 0.002917] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005388] Device empty client # [ 0.005366] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.005592] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.005388] Movable zone start for each node lb # [ 0.002918] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005624] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.005389] Early memory node ranges worker1 # [ 0.031346] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.031798] ACPI: PM-Timer IO Port: 0x608 client # [ 0.031571] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.005389] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.002920] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.032029] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.031809] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.005390] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.032039] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.002921] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.031834] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.005391] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.032065] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.002922] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.031837] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.005411] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.032067] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.002923] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.031839] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.005668] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.032069] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.002924] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.031840] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.031527] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.032069] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.031981] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.031841] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.002924] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.031991] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.032070] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.031842] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.002925] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.032017] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.032071] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.031844] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002925] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.032020] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.031845] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.032074] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002926] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.031848] TSC deadline timer available client # [ 0.032075] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.032022] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.003145] No NUMA configuration found worker1 # [ 0.031852] CPU topo: Max. logical packages: 1 client # [ 0.032078] TSC deadline timer available worker2 # [ 0.032023] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.031853] CPU topo: Max. logical dies: 1 lb # [ 0.003146] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.032082] CPU topo: Max. logical packages: 1 worker1 # [ 0.031853] CPU topo: Max. dies per package: 1 client # [ 0.032083] CPU topo: Max. logical dies: 1 worker2 # [ 0.032024] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.003148] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005347] Zone ranges: worker1 # [ 0.031857] CPU topo: Max. threads per core: 1 client # [ 0.032083] CPU topo: Max. dies per package: 1 worker2 # [ 0.032025] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.031857] CPU topo: Num. cores per package: 1 client # [ 0.032086] CPU topo: Max. threads per core: 1 lb # [ 0.005348] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.031857] CPU topo: Num. threads per package: 1 client # [ 0.032087] CPU topo: Num. cores per package: 1 worker2 # [ 0.032027] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.005349] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.005350] Normal empty worker2 # [ 0.032028] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.032087] CPU topo: Num. threads per package: 1 worker1 # [ 0.031858] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.005351] Device empty worker2 # [ 0.032031] TSC deadline timer available client # [ 0.032087] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.005352] Movable zone start for each node worker1 # [ 0.031874] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.032035] CPU topo: Max. logical packages: 1 lb # [ 0.005353] Early memory node ranges client # [ 0.032105] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.032035] CPU topo: Max. logical dies: 1 worker1 # [ 0.031902] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.005353] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.032036] CPU topo: Max. dies per package: 1 client # [ 0.032134] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.032039] CPU topo: Max. threads per core: 1 lb # [ 0.005354] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.031903] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.032040] CPU topo: Num. cores per package: 1 client # [ 0.032136] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.031905] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.005355] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.032040] CPU topo: Num. threads per package: 1 worker1 # [ 0.031906] Booting paravirtualized kernel on KVM client # [ 0.032137] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.005374] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.032041] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.032138] Booting paravirtualized kernel on KVM lb # [ 0.005635] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.031909] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.032058] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.031567] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.032141] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.032016] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.036388] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.032087] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.036605] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.032027] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.038695] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.032089] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.038737] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.038719] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.032053] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.032090] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.038769] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.032055] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.032092] Booting paravirtualized kernel on KVM lb # [ 0.032057] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.032094] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.032058] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.036564] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.032059] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.038739] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4idnay9kf4i79rgksq2a0cx0x5kksln8-nixos-system-worker1-test/init regInfo=/nix/store/hnxmbc46xwssrsa5c66xddlq152f9x0y-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.038863] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.032059] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.038770] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test/init regInfo=/nix/store/9lyia4mvv2i1s4lyj2244g6qjddq61k6-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.038906] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.032062] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.032063] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.038831] Unknown kernel command line parameters "regInfo=/nix/store/hnxmbc46xwssrsa5c66xddlq152f9x0y-closure-info/registration", will be passed to user space. worker1 # [ 0.038843] random: crng init done lb # [ 0.032066] TSC deadline timer available client # [ 0.038862] Unknown kernel command line parameters "regInfo=/nix/store/9lyia4mvv2i1s4lyj2244g6qjddq61k6-closure-info/registration", will be passed to user space. client # [ 0.038875] random: crng init done lb # [ 0.032071] CPU topo: Max. logical packages: 1 worker1 # [ 0.038844] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.032071] CPU topo: Max. logical dies: 1 client # [ 0.038875] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.032072] CPU topo: Max. dies per package: 1 worker1 # [ 0.040921] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.032075] CPU topo: Max. threads per core: 1 client # [ 0.041142] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.038908] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xnscg6z9qxa84gbw1h8qb1f0c0aarhsv-nixos-system-worker2-test/init regInfo=/nix/store/l9mgb5s68rv42f8xbdmqfv6fgq35z9b7-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.041962] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.032075] CPU topo: Num. cores per package: 1 worker1 # [ 0.041993] Fallback order for Node 0: 0 client # [ 0.042181] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.032076] CPU topo: Num. threads per package: 1 client # [ 0.042216] Fallback order for Node 0: 0 worker1 # [ 0.041996] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.038998] Unknown kernel command line parameters "regInfo=/nix/store/l9mgb5s68rv42f8xbdmqfv6fgq35z9b7-closure-info/registration", will be passed to user space. lb # [ 0.032076] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.041997] Policy zone: DMA32 worker2 # [ 0.039010] random: crng init done client # [ 0.042219] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.042220] Policy zone: DMA32 lb # [ 0.032094] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.044435] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.039011] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.044649] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.032124] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.047430] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.041084] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.047608] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.050857] allocated 3145728 bytes of page_ext lb # [ 0.032125] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.050874] allocated 3145728 bytes of page_ext worker1 # [ 0.060816] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.042130] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.032127] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.061001] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.042161] Fallback order for Node 0: 0 worker1 # [ 0.060818] ftrace: allocated 192 pages with 2 groups lb # [ 0.032128] Booting paravirtualized kernel on KVM worker1 # [ 0.061637] Dynamic Preempt: lazy client # [ 0.061003] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.042164] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.061831] Dynamic Preempt: lazy worker2 # [ 0.042165] Policy zone: DMA32 worker1 # [ 0.061811] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.032131] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.061811] rcu: RCU event tracing is enabled. client # [ 0.061987] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.044584] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.061988] rcu: RCU event tracing is enabled. lb # [ 0.036619] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.061812] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.047553] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.061988] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.061813] Trampoline variant of Tasks RCU enabled. lb # [ 0.038714] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.050968] allocated 3145728 bytes of page_ext client # [ 0.061989] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.061814] Rude variant of Tasks RCU enabled. lb # [ 0.038755] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.060873] ftrace: allocating 48787 entries in 192 pages client # [ 0.061990] Rude variant of Tasks RCU enabled. worker1 # [ 0.061814] Tracing variant of Tasks RCU enabled. worker2 # [ 0.060874] ftrace: allocated 192 pages with 2 groups client # [ 0.061990] Tracing variant of Tasks RCU enabled. worker2 # [ 0.061698] Dynamic Preempt: lazy worker1 # [ 0.061815] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.061881] rcu: Preemptible hierarchical RCU implementation. client # [ 0.061991] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.061816] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.061882] rcu: RCU event tracing is enabled. client # [ 0.061991] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.061882] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.061831] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.062013] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.061884] Trampoline variant of Tasks RCU enabled. lb # [ 0.038757] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.061833] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.061884] Rude variant of Tasks RCU enabled. client # [ 0.062014] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.061885] Tracing variant of Tasks RCU enabled. worker1 # [ 0.061833] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.038848] Unknown kernel command line parameters "regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration", will be passed to user space. client # [ 0.062015] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.061885] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.038860] random: crng init done worker1 # [ 0.066237] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.066365] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.061886] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.038861] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.066532] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.066638] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.061907] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.040910] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.066538] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.066644] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.041941] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.061908] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.041970] Fallback order for Node 0: 0 worker1 # [ 0.066639] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.070178] Console: colour VGA+ 80x25 client # [ 0.066753] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.061909] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.041973] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.070181] printk: legacy console [tty0] enabled client # [ 0.070270] Console: colour VGA+ 80x25 lb # [ 0.041974] Policy zone: DMA32 worker2 # [ 0.066258] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.070273] printk: legacy console [tty0] enabled worker1 # [ 0.099789] printk: legacy console [ttyS0] enabled lb # [ 0.044382] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.099703] printk: legacy console [ttyS0] enabled worker2 # [ 0.066549] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.196391] ACPI: Core revision 20250807 lb # [ 0.047343] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.195611] ACPI: Core revision 20250807 lb # [ 0.050736] allocated 3145728 bytes of page_ext worker2 # [ 0.066556] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.060477] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.197261] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.060478] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.066655] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.196508] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.061280] Dynamic Preempt: lazy worker2 # [ 0.070234] Console: colour VGA+ 80x25 worker1 # [ 0.198753] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.070237] printk: legacy console [tty0] enabled client # [ 0.197993] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.199687] x2apic enabled lb # [ 0.061411] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.061411] rcu: RCU event tracing is enabled. worker2 # [ 0.099701] printk: legacy console [ttyS0] enabled client # [ 0.198972] x2apic enabled worker1 # [ 0.200418] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.195805] ACPI: Core revision 20250807 lb # [ 0.061412] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.199740] APIC: Switched APIC routing to: physical x2apic lb # [ 0.061414] Trampoline variant of Tasks RCU enabled. lb # [ 0.061414] Rude variant of Tasks RCU enabled. worker2 # [ 0.196732] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.202196] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.061414] Tracing variant of Tasks RCU enabled. client # [ 0.201554] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.198286] APIC: Switch to symmetric I/O mode setup lb # [ 0.061415] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.199226] x2apic enabled worker1 # [ 0.203152] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.061416] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.202524] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.199979] APIC: Switched APIC routing to: physical x2apic lb # [ 0.061430] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.204756] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.204183] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.061431] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.205839] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.201748] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.205267] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.061432] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.206914] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.065780] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.206321] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.207753] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.202759] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.066083] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.207181] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.204371] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.066089] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.208757] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.205456] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.208184] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.066186] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.209753] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.069728] Console: colour VGA+ 80x25 worker2 # [ 0.206491] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.069730] printk: legacy console [tty0] enabled client # [ 0.210181] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.210754] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.099219] printk: legacy console [ttyS0] enabled worker2 # [ 0.207369] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.211181] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.211753] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.194900] ACPI: Core revision 20250807 client # [ 0.212181] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.212753] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.208373] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.213181] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.195791] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.209369] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.197320] APIC: Switch to symmetric I/O mode setup lb # [ 0.198310] x2apic enabled worker2 # [ 0.210368] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.199087] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.211368] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.213753] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.215760] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.212368] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.214181] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.200840] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.216188] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.216480] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.217754] active return thunk: srso_alias_return_thunk client # [ 0.217182] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.201815] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.218182] active return thunk: srso_alias_return_thunk worker1 # [ 0.218774] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.203474] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.213368] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.219753] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.219203] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.215374] Spectre V2 : Enabling IBPB for BPF lb # [ 0.204557] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.220753] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.220181] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.205596] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.216078] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.221753] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.221901] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.217369] active return thunk: srso_alias_return_thunk lb # [ 0.206471] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.222753] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.222181] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.218389] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.223753] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.223181] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.207474] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.219368] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.224181] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.224753] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.208471] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.220368] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.225754] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.225181] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.209471] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.221368] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.226753] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.227068] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.210470] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.222368] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.227753] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.227877] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.211471] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.223368] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.228753] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.228881] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.224368] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.229753] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.229888] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.225369] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.230181] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.230753] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.226368] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.212470] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.231181] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.227368] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.214477] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.228368] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.215207] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.229368] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.216471] active return thunk: srso_alias_return_thunk worker2 # [ 0.230368] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.217492] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.218471] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.219470] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.220470] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.221470] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.222471] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.223471] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.225471] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.226470] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.227471] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.228471] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.229470] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.230471] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.265040] Freeing SMP alternatives memory: 44K worker1 # [ 0.265760] pid_max: default: 32768 minimum: 301 client # [ 0.266054] Freeing SMP alternatives memory: 44K worker1 # [ 0.266596] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.266737] pid_max: default: 32768 minimum: 301 worker1 # [ 0.267824] landlock: Up and running. client # [ 0.267263] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.268467] Yama: becoming mindful. client # [ 0.268280] landlock: Up and running. worker1 # [ 0.268967] LSM support for eBPF active client # [ 0.269182] Yama: becoming mindful. worker2 # [ 0.265310] Freeing SMP alternatives memory: 44K client # [ 0.270268] LSM support for eBPF active worker1 # [ 0.269893] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.265918] pid_max: default: 32768 minimum: 301 client # [ 0.270994] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.270791] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.266458] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.267477] landlock: Up and running. client # [ 0.272216] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.268369] Yama: becoming mindful. worker2 # [ 0.269539] LSM support for eBPF active worker1 # [ 0.273627] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.274493] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.270311] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.274284] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.274758] ... version: 2 client # [ 0.275736] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.271406] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.275442] ... bit width: 48 client # [ 0.276189] ... version: 2 worker1 # [ 0.275756] ... generic counters: 6 client # [ 0.276909] ... bit width: 48 client # [ 0.277183] ... generic counters: 6 worker1 # [ 0.276502] ... generic bitmap: 000000000000003f worker2 # [ 0.273783] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.276803] ... fixed-purpose counters: 0 client # [ 0.277889] ... generic bitmap: 000000000000003f client # [ 0.278183] ... fixed-purpose counters: 0 worker1 # [ 0.277510] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.274877] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.278912] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.275373] ... version: 2 worker1 # [ 0.277756] ... value mask: 0000ffffffffffff worker2 # [ 0.276099] ... bit width: 48 client # [ 0.279183] ... value mask: 0000ffffffffffff worker1 # [ 0.278755] ... max period: 00007fffffffffff worker2 # [ 0.276371] ... generic counters: 6 client # [ 0.280048] ... max period: 00007fffffffffff lb # [ 0.264816] Freeing SMP alternatives memory: 44K worker1 # [ 0.279663] ... global_ctrl mask: 000000000000003f worker2 # [ 0.277133] ... generic bitmap: 000000000000003f lb # [ 0.265474] pid_max: default: 32768 minimum: 301 client # [ 0.280820] ... global_ctrl mask: 000000000000003f worker1 # [ 0.280516] signal: max sigframe size: 3376 worker2 # [ 0.277437] ... fixed-purpose counters: 0 client # [ 0.281289] signal: max sigframe size: 3376 worker1 # [ 0.280845] rcu: Hierarchical SRCU implementation. lb # [ 0.266258] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.278175] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.282064] rcu: Hierarchical SRCU implementation. lb # [ 0.267537] landlock: Up and running. worker1 # [ 0.281596] rcu: Max phase no-delay instances is 400. lb # [ 0.268126] Yama: becoming mindful. worker2 # [ 0.279062] ... value mask: 0000ffffffffffff client # [ 0.282755] rcu: Max phase no-delay instances is 400. lb # [ 0.268684] LSM support for eBPF active worker2 # [ 0.279371] ... max period: 00007fffffffffff worker2 # [ 0.280313] ... global_ctrl mask: 000000000000003f lb # [ 0.269571] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.281198] signal: max sigframe size: 3376 lb # [ 0.270514] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.281979] rcu: Hierarchical SRCU implementation. worker2 # [ 0.282373] rcu: Max phase no-delay instances is 400. worker1 # [ 0.286926] smp: Bringing up secondary CPUs ... client # [ 0.287677] smp: Bringing up secondary CPUs ... worker1 # [ 0.287713] smp: Brought up 1 node, 1 CPU lb # [ 0.273246] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.288198] smp: Brought up 1 node, 1 CPU worker1 # [ 0.288249] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.288877] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.273970] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.274476] ... version: 2 worker1 # [ 0.288904] Memory: 1454584K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) lb # [ 0.275193] ... bit width: 48 client # [ 0.289320] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker1 # [ 0.289965] devtmpfs: initialized lb # [ 0.275473] ... generic counters: 6 worker2 # [ 0.287775] smp: Bringing up secondary CPUs ... client # [ 0.290413] devtmpfs: initialized worker2 # [ 0.288384] smp: Brought up 1 node, 1 CPU lb # [ 0.276138] ... generic bitmap: 000000000000003f worker1 # [ 0.290836] x86/mm: Memory block size: 128MB client # [ 0.291199] x86/mm: Memory block size: 128MB lb # [ 0.276519] ... fixed-purpose counters: 0 worker2 # [ 0.289035] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.277231] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.292539] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.277474] ... value mask: 0000ffffffffffff client # [ 0.292975] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.289531] Memory: 1454548K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) lb # [ 0.278347] ... max period: 00007fffffffffff worker1 # [ 0.293649] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.290600] devtmpfs: initialized client # [ 0.294039] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.279145] ... global_ctrl mask: 000000000000003f worker1 # [ 0.294852] pinctrl core: initialized pinctrl subsystem lb # [ 0.279583] signal: max sigframe size: 3376 client # [ 0.295252] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.291470] x86/mm: Memory block size: 128MB worker1 # [ 0.295936] PM: RTC time: 16:58:00, date: 2026-09-22 lb # [ 0.280322] rcu: Hierarchical SRCU implementation. client # [ 0.296399] PM: RTC time: 16:58:00, date: 2026-09-22 lb # [ 0.281048] rcu: Max phase no-delay instances is 400. worker2 # [ 0.293210] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.294321] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.299688] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.299892] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.295445] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.296591] PM: RTC time: 16:58:00, date: 2026-09-22 worker1 # [ 0.300948] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.300681] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.286031] smp: Bringing up secondary CPUs ... worker1 # [ 0.301777] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.301210] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.286487] smp: Brought up 1 node, 1 CPU lb # [ 0.287153] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.303022] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.302451] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.300110] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.303765] audit: initializing netlink subsys (disabled) client # [ 0.303192] audit: initializing netlink subsys (disabled) lb # [ 0.287660] Memory: 1454576K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) client # [ 0.304343] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.300862] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.304757] audit: type=2000 audit(1790096281.559:1): state=initialized audit_enabled=0 res=1 lb # [ 0.288714] devtmpfs: initialized client # [ 0.304346] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.305900] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.301394] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.289442] x86/mm: Memory block size: 128MB client # [ 0.305185] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.305902] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.306100] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.302635] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.306757] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.303381] audit: initializing netlink subsys (disabled) lb # [ 0.291035] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.307711] thermal_sys: Registered thermal governor 'user_space' client # [ 0.306907] audit: type=2000 audit(1790096281.560:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.308506] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.308186] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.304373] audit: type=2000 audit(1790096281.563:1): state=initialized audit_enabled=0 res=1 lb # [ 0.291502] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.308779] cpuidle: using governor menu client # [ 0.308200] cpuidle: using governor menu lb # [ 0.292545] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.305473] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.293667] PM: RTC time: 16:58:00, date: 2026-09-22 worker2 # [ 0.305475] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.310973] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.310188] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.306372] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.311977] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.311389] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.307295] thermal_sys: Registered thermal governor 'user_space' client # [ 0.312186] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.312759] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.308150] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.313767] PCI: Using configuration type 1 for base access client # [ 0.313195] PCI: Using configuration type 1 for base access worker2 # [ 0.308383] cpuidle: using governor menu lb # [ 0.297197] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.314842] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.314262] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.310578] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.297956] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.298494] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.311594] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.312374] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.299744] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.313382] PCI: Using configuration type 1 for base access lb # [ 0.300483] audit: initializing netlink subsys (disabled) client # [ 0.319418] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.314517] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.301475] audit: type=2000 audit(1790096281.575:1): state=initialized audit_enabled=0 res=1 client # [ 0.320184] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.302618] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.321781] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.302619] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.322756] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.303474] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.304443] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.305192] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.305485] cpuidle: using governor menu client # [ 0.325185] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.326183] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.321394] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.307736] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.327757] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.322371] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.328757] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.308694] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.309476] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.310484] PCI: Using configuration type 1 for base access lb # [ 0.311609] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.327372] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.328372] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.336545] ACPI: Added _OSI(Module Device) client # [ 0.337185] ACPI: Added _OSI(Processor Device) client # [ 0.337932] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.318487] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.340062] ACPI: Added _OSI(Module Device) worker1 # [ 0.340747] ACPI: Added _OSI(Processor Device) lb # [ 0.319474] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.341257] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.339624] ACPI: Added _OSI(Module Device) client # [ 0.344094] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.340348] ACPI: Added _OSI(Processor Device) lb # [ 0.324474] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.340900] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.325474] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.347039] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.351169] ACPI: Interpreter enabled client # [ 0.350592] ACPI: Interpreter enabled worker1 # [ 0.351771] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.351200] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.346684] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.352461] ACPI: Using IOAPIC for interrupt routing client # [ 0.351913] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.354802] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.354234] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.350771] ACPI: Interpreter enabled worker1 # [ 0.355757] PCI: Using E820 reservations for host bridge windows client # [ 0.355185] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.351386] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.336763] ACPI: Added _OSI(Module Device) lb # [ 0.337443] ACPI: Added _OSI(Processor Device) worker2 # [ 0.352084] ACPI: Using IOAPIC for interrupt routing lb # [ 0.337996] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.358854] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.358262] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.354408] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.355372] PCI: Using E820 reservations for host bridge windows lb # [ 0.343776] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.358525] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.366101] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.365541] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.366762] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.366189] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.347898] ACPI: Interpreter enabled worker1 # [ 0.367832] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.348489] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.367263] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.349221] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.368878] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.368314] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.370117] PCI host bridge to bus 0000:00 client # [ 0.369538] PCI host bridge to bus 0000:00 worker1 # [ 0.370760] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.366053] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.370187] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.371756] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.351519] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.371184] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.366377] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.352474] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.372756] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.372183] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.367462] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.373756] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.373184] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.368495] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.374756] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.374183] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.355586] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.369738] PCI host bridge to bus 0000:00 worker1 # [ 0.375756] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.375183] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.370375] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.376756] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.376189] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.371372] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.377704] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.377131] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.372371] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.379138] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.373371] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.378630] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.374372] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.375371] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.362944] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.376372] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.363479] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.377383] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.364550] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.365595] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.378821] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.366841] PCI host bridge to bus 0000:00 worker1 # [ 0.381820] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.381223] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.367478] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.382769] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.382196] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.368473] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.383156] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.383700] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.369473] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.384160] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.385053] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.370474] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.371473] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.385891] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.386673] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.372473] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.373473] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.381460] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.382384] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.374462] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.388201] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.389772] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.389039] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.383386] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.390586] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.375900] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.389896] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.391453] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.384609] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.390189] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.391762] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.386268] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.391703] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.393740] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.393200] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.389411] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.396712] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.394018] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.390227] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.397384] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.394894] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.391098] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.378522] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.397777] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.379486] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.391377] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.395741] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.399330] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.380431] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.392932] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.381699] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.398205] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.395411] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.383193] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.399191] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.401763] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.396263] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.403378] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.400109] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.397146] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.403777] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.386490] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.401540] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.387340] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.398788] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.405304] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.388202] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.403200] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.388479] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.404027] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.407503] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.404888] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.407763] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.401410] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.390574] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.405190] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.408685] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.402262] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.403145] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.409561] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.392492] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.407295] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.393325] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.404811] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.411291] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.394195] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.409196] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.410127] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.412778] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.395064] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.407348] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.413719] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.408028] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.411587] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.415134] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.408393] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.413196] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.410271] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.397712] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.414137] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.416768] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.399090] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.411722] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.399495] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.417716] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.415575] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.401053] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.413384] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.419337] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.418206] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.414394] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.419143] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.402505] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.420768] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.415970] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.403369] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.420524] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.421710] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.404197] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.404479] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.423096] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.422197] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.418055] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.423111] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.418394] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.424768] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.406339] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.424526] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.419996] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.425715] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.408486] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.409433] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.421383] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.427301] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.426203] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.422296] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.427016] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.410904] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.427885] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.429564] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.423778] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.430381] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.412486] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.428740] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.430777] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.413442] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.426119] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.432356] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.430201] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.427138] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.415010] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.431029] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.427935] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.416486] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.432205] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.417457] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.435139] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.433740] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.430246] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.436384] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.418844] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.431013] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.436777] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.434853] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.431393] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.420486] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.435383] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.438330] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.421445] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.436832] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.439575] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.433472] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.437382] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.440560] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.423368] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.436050] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.442419] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.438825] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.436378] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.425493] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.437356] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.426342] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.442954] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.427210] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.438792] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.444784] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.428059] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.440153] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.440569] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.429801] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.443235] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.431146] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.431495] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.444309] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.446098] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.440045] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.433074] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.434193] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.442660] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.434706] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.445833] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.443464] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.436136] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.448503] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.444470] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.436669] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.449043] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.445435] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.439113] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.450072] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.447213] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.451000] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.448078] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.452814] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.446639] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.449512] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.453664] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.450902] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.449127] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.454793] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.450648] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.456470] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.451697] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.454172] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.455030] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.452622] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.455990] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.439728] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.459835] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.454432] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.457031] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.460865] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.442135] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.455325] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.458211] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.461863] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.459229] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.442702] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.456417] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.462861] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.460257] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.463852] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.443796] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.461284] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.464852] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.458792] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.462217] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.465855] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.444900] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.463193] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.466852] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.464177] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.446490] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.467793] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.464950] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.447361] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.468744] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.462449] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.465196] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.463478] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.469529] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.466155] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.448514] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.464467] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.470586] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.467057] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.450120] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.465469] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.471516] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.467937] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.471768] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.466468] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.472744] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.469256] iommu: Default domain type: Translated worker2 # [ 0.467671] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.473509] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.470058] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.468478] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.471227] ACPI: bus type USB registered lb # [ 0.453594] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.469468] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.474821] iommu: Default domain type: Translated client # [ 0.472006] usbcore: registered new interface driver usbfs lb # [ 0.454591] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.470407] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.472859] usbcore: registered new interface driver hub worker1 # [ 0.475615] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.455574] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.473192] usbcore: registered new device driver usb worker2 # [ 0.471356] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.476771] ACPI: bus type USB registered lb # [ 0.456569] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.472096] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.477525] usbcore: registered new interface driver usbfs client # [ 0.474858] NetLabel: Initializing lb # [ 0.457571] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.472385] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.477773] usbcore: registered new interface driver hub client # [ 0.475185] NetLabel: domain hash size = 128 worker1 # [ 0.478616] usbcore: registered new device driver usb lb # [ 0.458572] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.473327] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.475976] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.474099] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.459573] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.476963] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.480292] NetLabel: Initializing worker2 # [ 0.474386] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.477196] PCI: Using ACPI for IRQ routing lb # [ 0.460608] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.480757] NetLabel: domain hash size = 128 lb # [ 0.461533] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.475359] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.481481] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.481842] NetLabel: unlabeled traffic allowed by default lb # [ 0.462486] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.482776] PCI: Using ACPI for IRQ routing worker2 # [ 0.477107] iommu: Default domain type: Translated lb # [ 0.463489] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.477379] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.464485] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.478645] ACPI: bus type USB registered lb # [ 0.465486] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.479444] usbcore: registered new interface driver usbfs lb # [ 0.466490] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.480380] usbcore: registered new interface driver hub lb # [ 0.467479] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.481272] usbcore: registered new device driver usb lb # [ 0.468486] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.482937] NetLabel: Initializing worker2 # [ 0.483372] NetLabel: domain hash size = 128 lb # [ 0.470457] iommu: Default domain type: Translated worker2 # [ 0.484084] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.471107] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.484410] NetLabel: unlabeled traffic allowed by default lb # [ 0.471732] ACPI: bus type USB registered worker2 # [ 0.485383] PCI: Using ACPI for IRQ routing lb # [ 0.472533] usbcore: registered new interface driver usbfs lb # [ 0.473484] usbcore: registered new interface driver hub lb # [ 0.474489] usbcore: registered new device driver usb lb # [ 0.476311] NetLabel: Initializing lb # [ 0.476920] NetLabel: domain hash size = 128 lb # [ 0.477473] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.478455] NetLabel: unlabeled traffic allowed by default lb # [ 0.479233] PCI: Using ACPI for IRQ routing client # [ 0.520520] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.521180] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.521180] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.521188] vgaarb: loaded client # [ 0.521946] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.526954] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.522185] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.527752] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.527752] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.527761] vgaarb: loaded worker1 # [ 0.528550] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.525264] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.529408] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.528780] VFS: Disk quotas dquot_6.6.0 client # [ 0.529509] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.532837] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.529565] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.530914] pnp: PnP ACPI init worker2 # [ 0.530367] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.531702] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.530367] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.532661] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.536292] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.530376] vgaarb: loaded client # [ 0.534184] pnp: PnP ACPI: found 5 devices worker1 # [ 0.536970] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.531119] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.538306] pnp: PnP ACPI init worker2 # [ 0.531371] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.539078] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.522487] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.540058] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.523469] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.541681] pnp: PnP ACPI: found 5 devices lb # [ 0.523469] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.523517] vgaarb: loaded worker2 # [ 0.536468] clocksource: Switched to clocksource kvm-clock lb # [ 0.524436] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.541743] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.525084] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.543155] clocksource: Switched to clocksource acpi_pm client # [ 0.544185] NET: Registered PF_INET protocol family worker2 # [ 0.539997] VFS: Disk quotas dquot_6.6.0 client # [ 0.545395] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.540722] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.542072] pnp: PnP ACPI init worker1 # [ 0.549307] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.529625] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.550795] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.542872] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.551762] NET: Registered PF_INET protocol family worker2 # [ 0.543783] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.545325] pnp: PnP ACPI: found 5 devices worker1 # [ 0.552961] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.533725] VFS: Disk quotas dquot_6.6.0 lb # [ 0.534490] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.536011] pnp: PnP ACPI init lb # [ 0.536950] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.538107] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.539843] pnp: PnP ACPI: found 5 devices worker2 # [ 0.552934] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.554374] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.555389] NET: Registered PF_INET protocol family worker2 # [ 0.556556] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.561855] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.563427] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.564809] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.547700] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.566184] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.569181] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.549156] clocksource: Switched to clocksource acpi_pm client # [ 0.567384] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.570696] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.550134] NET: Registered PF_INET protocol family client # [ 0.568486] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.571974] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.551309] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.569752] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.573307] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.570798] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.574577] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.572005] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.572966] NET: Registered PF_XDP protocol family worker1 # [ 0.575774] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.573816] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.577130] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.574835] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.578339] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.575866] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.579587] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.576978] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.580572] NET: Registered PF_XDP protocol family client # [ 0.578100] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.581435] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.572964] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.579215] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.582419] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.574573] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.583428] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.580925] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.575871] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.584544] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.577206] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.585681] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.583075] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.578451] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.586767] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.579549] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.585143] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.588493] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.580836] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.587096] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.581954] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.568912] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.590968] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.583137] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.588756] PCI: CLS 0 bytes, default 64 lb # [ 0.570468] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.584088] NET: Registered PF_XDP protocol family client # [ 0.589664] Trying to unpack rootfs image as initramfs... worker1 # [ 0.592849] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.584915] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.571762] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.585900] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.573069] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.594805] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.586922] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.574310] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.596477] PCI: CLS 0 bytes, default 64 worker2 # [ 0.588014] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.575476] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.589106] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.594052] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.576682] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.597360] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.590147] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.599018] Trying to unpack rootfs image as initramfs... lb # [ 0.577710] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.591796] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.578913] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.579947] NET: Registered PF_XDP protocol family lb # [ 0.580850] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.594430] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.581875] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.596315] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.582941] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.584077] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.598220] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.585200] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.586296] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.599920] PCI: CLS 0 bytes, default 64 lb # [ 0.588145] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.600798] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.602598] Trying to unpack rootfs image as initramfs... lb # [ 0.591304] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.593431] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.595441] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.597184] PCI: CLS 0 bytes, default 64 lb # [ 0.598108] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.599910] Trying to unpack rootfs image as initramfs... client # [ 0.632437] Initialise system trusted keyrings client # [ 0.635612] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.642620] Initialise system trusted keyrings worker1 # [ 0.646295] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.644252] Initialise system trusted keyrings worker2 # [ 0.646889] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.655455] Key type asymmetric registered client # [ 0.658571] Asymmetric key parser 'x509' registered client # [ 0.659417] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.665530] Key type asymmetric registered client # [ 0.662667] io scheduler mq-deadline registered client # [ 0.663444] io scheduler kyber registered lb # [ 0.645877] Initialise system trusted keyrings worker1 # [ 0.670248] Asymmetric key parser 'x509' registered client # [ 0.667143] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.649457] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.671067] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.668426] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.672410] io scheduler mq-deadline registered worker1 # [ 0.673184] io scheduler kyber registered client # [ 0.672340] Linux agpgart interface v0.103 client # [ 0.673149] ACPI: bus type drm_connector registered worker2 # [ 0.668855] Key type asymmetric registered worker1 # [ 0.676806] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.669599] Asymmetric key parser 'x509' registered worker1 # [ 0.678099] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.670477] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.677976] usbcore: registered new interface driver usbserial_generic client # [ 0.679101] usbserial: USB Serial support registered for generic worker1 # [ 0.683859] Linux agpgart interface v0.103 worker2 # [ 0.675942] io scheduler mq-deadline registered worker1 # [ 0.684667] ACPI: bus type drm_connector registered worker2 # [ 0.676726] io scheduler kyber registered client # [ 0.681578] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.681578] Please enable it if your BIOS has the CPPC option. client # [ 0.683812] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.679379] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.687738] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.688872] usbserial: USB Serial support registered for generic worker2 # [ 0.680607] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.687716] drop_monitor: Initializing network drop monitor service lb # [ 0.670759] Key type asymmetric registered client # [ 0.688912] NET: Registered PF_INET6 protocol family lb # [ 0.671520] Asymmetric key parser 'x509' registered worker1 # [ 0.692254] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.692254] Please enable it if your BIOS has the CPPC option. lb # [ 0.672373] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.686104] Linux agpgart interface v0.103 client # [ 0.692002] Segment Routing with IPv6 worker1 # [ 0.694518] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.686882] ACPI: bus type drm_connector registered client # [ 0.694584] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.697405] drop_monitor: Initializing network drop monitor service client # [ 0.695650] IPI shorthand broadcast: enabled worker2 # [ 0.690173] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.698603] NET: Registered PF_INET6 protocol family lb # [ 0.677575] io scheduler mq-deadline registered lb # [ 0.678318] io scheduler kyber registered worker2 # [ 0.691236] usbserial: USB Serial support registered for generic worker1 # [ 0.701731] Segment Routing with IPv6 worker2 # [ 0.693853] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.693853] Please enable it if your BIOS has the CPPC option. lb # [ 0.682111] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.696173] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.683366] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.705259] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.706551] IPI shorthand broadcast: enabled client # [ 0.703955] sched_clock: Marking stable (570013622, 133535962)->(774839825, -71290241) worker2 # [ 0.699989] drop_monitor: Initializing network drop monitor service lb # [ 0.687224] Linux agpgart interface v0.103 lb # [ 0.687984] ACPI: bus type drm_connector registered worker2 # [ 0.701179] NET: Registered PF_INET6 protocol family worker2 # [ 0.704273] Segment Routing with IPv6 client # [ 0.709633] registered taskstats version 1 client # [ 0.710601] Loading compiled-in X.509 certificates lb # [ 0.692954] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.706860] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.714881] sched_clock: Marking stable (580014565, 134214089)->(783820450, -69591796) lb # [ 0.694088] usbserial: USB Serial support registered for generic worker2 # [ 0.707967] IPI shorthand broadcast: enabled lb # [ 0.697417] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.697417] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.720339] registered taskstats version 1 worker1 # [ 0.721291] Loading compiled-in X.509 certificates lb # [ 0.699688] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.703598] drop_monitor: Initializing network drop monitor service worker2 # [ 0.716414] sched_clock: Marking stable (582014972, 133812331)->(788582917, -72755614) lb # [ 0.704747] NET: Registered PF_INET6 protocol family lb # [ 0.707961] Segment Routing with IPv6 client # [ 0.727033] Demotion targets for Node 0: null worker2 # [ 0.722019] registered taskstats version 1 worker2 # [ 0.723007] Loading compiled-in X.509 certificates lb # [ 0.710426] In-situ OAM (IOAM) with IPv6 lb # [ 0.711533] IPI shorthand broadcast: enabled client # [ 0.730596] Key type .fscrypt registered client # [ 0.731283] Key type fscrypt-provisioning registered client # [ 0.732232] ima: No TPM chip found, activating TPM-bypass! client # [ 0.734562] ima: Allocated hash algorithm: sha1 worker1 # [ 0.737785] Demotion targets for Node 0: null client # [ 0.735339] ima: No architecture policies found client # [ 0.737561] PM: Magic number: 10:811:995 worker1 # [ 0.741274] Key type .fscrypt registered lb # [ 0.719958] sched_clock: Marking stable (586015107, 133380733)->(791504012, -72108172) worker1 # [ 0.741961] Key type fscrypt-provisioning registered client # [ 0.739190] RAS: Correctable Errors collector initialized. worker1 # [ 0.742926] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.745240] ima: Allocated hash algorithm: sha1 lb # [ 0.724625] registered taskstats version 1 worker1 # [ 0.746031] ima: No architecture policies found lb # [ 0.725621] Loading compiled-in X.509 certificates worker1 # [ 0.748241] PM: Magic number: 10:811:995 worker2 # [ 0.741834] Demotion targets for Node 0: null worker1 # [ 0.749849] RAS: Correctable Errors collector initialized. worker2 # [ 0.742714] Key type .fscrypt registered client # [ 0.748230] clk: Disabling unused clocks worker2 # [ 0.743380] Key type fscrypt-provisioning registered worker2 # [ 0.744273] ima: No TPM chip found, activating TPM-bypass! client # [ 0.752581] PM: genpd: Disabling unused power domains worker2 # [ 0.748836] ima: Allocated hash algorithm: sha1 worker2 # [ 0.749624] ima: No architecture policies found worker2 # [ 0.750544] PM: Magic number: 10:811:995 worker1 # [ 0.758913] clk: Disabling unused clocks worker1 # [ 0.762263] PM: genpd: Disabling unused power domains worker2 # [ 0.754180] RAS: Correctable Errors collector initialized. lb # [ 0.744410] Demotion targets for Node 0: null lb # [ 0.747458] Key type .fscrypt registered lb # [ 0.748103] Key type fscrypt-provisioning registered lb # [ 0.749029] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.762871] clk: Disabling unused clocks worker2 # [ 0.763556] PM: genpd: Disabling unused power domains lb # [ 0.751412] ima: Allocated hash algorithm: sha1 lb # [ 0.752160] ima: No architecture policies found lb # [ 0.754415] PM: Magic number: 10:811:995 lb # [ 0.756167] RAS: Correctable Errors collector initialized. lb # [ 0.765090] clk: Disabling unused clocks lb # [ 0.768438] PM: genpd: Disabling unused power domains client # [ 0.916399] Freeing initrd memory: 29056K client # [ 0.919525] Freeing unused decrypted memory: 2028K worker1 # [ 0.924281] Freeing initrd memory: 29056K client # [ 0.922201] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.923244] Write protecting the kernel read-only data: 32768k worker1 # [ 0.927471] Freeing unused decrypted memory: 2028K client # [ 0.925076] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.926529] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.930138] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.931315] Write protecting the kernel read-only data: 32768k worker1 # [ 0.933191] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.934767] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.928008] Freeing initrd memory: 29060K worker2 # [ 0.931207] Freeing unused decrypted memory: 2028K worker2 # [ 0.933892] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.934988] Write protecting the kernel read-only data: 32768k worker2 # [ 0.936887] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.938410] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.943789] Freeing initrd memory: 29064K lb # [ 0.947238] Freeing unused decrypted memory: 2028K lb # [ 0.950278] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.951347] Write protecting the kernel read-only data: 32768k lb # [ 0.953358] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.954934] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.977371] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.978415] Run /init as init process worker1 # [ 0.985782] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.986902] Run /init as init process client # [ 0.989285] systemd[1]: Inserted module 'autofs4' worker2 # [ 0.989009] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.997612] systemd[1]: Inserted module 'autofs4' worker2 # [ 0.990071] Run /init as init process worker2 # [ 1.000671] systemd[1]: Inserted module 'autofs4' client # [ 1.009071] fuse: init (API version 7.45) worker1 # [ 1.017472] fuse: init (API version 7.45) client # [ 1.016459] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.018821] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.021802] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.024840] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.023770] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.027368] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.006076] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.007127] Run /init as init process worker2 # [ 1.020454] fuse: init (API version 7.45) worker1 # [ 1.030397] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.028892] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.032493] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.030420] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.027872] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.037649] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.030224] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.039344] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.019143] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.033376] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.039825] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.035433] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.041427] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.046603] virtiofs virtio6: discovered new tag: shared client # [ 1.045282] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.048348] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.040874] virtiofs virtio5: discovered new tag: nix-store client # [ 1.046873] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.042571] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.052714] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.054406] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.049276] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.050949] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.039302] fuse: init (API version 7.45) worker2 # [ 1.054294] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.055875] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.046874] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.049720] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.068687] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.053106] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.074998] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.055440] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.061041] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.062627] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.078016] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.070058] virtiofs virtio6: discovered new tag: shared lb # [ 1.071560] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.075632] virtiofs virtio7: discovered new tag: xchg lb # [ 1.077249] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.100371] systemd[1]: Successfully made /usr/ read-only. client # [ 1.404444] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.409666] systemd[1]: Detected virtualization kvm. client # [ 1.410530] systemd[1]: Detected architecture x86-64. client # [ 1.411392] systemd[1]: Running in initrd. worker1 # [ 1.410556] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.415422] systemd[1]: Detected virtualization kvm. client # [ 1.412617] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.416286] systemd[1]: Detected architecture x86-64. client # [ 1.413778] systemd[1]: Hostname set to . worker1 # [ 1.417090] systemd[1]: Running in initrd. worker1 # [ 1.418092] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.419243] systemd[1]: Hostname set to . worker2 # [ 1.414783] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.427054] systemd[1]: Detected virtualization kvm. worker2 # [ 1.429242] systemd[1]: Detected architecture x86-64. worker2 # [ 1.431378] systemd[1]: Running in initrd. worker2 # [ 1.433975] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.436933] systemd[1]: Hostname set to . lb # [ 1.437023] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.448980] systemd[1]: Detected virtualization kvm. lb # [ 1.451124] systemd[1]: Detected architecture x86-64. lb # [ 1.453300] systemd[1]: Running in initrd. lb # [ 1.455843] systemd[1]: Initializing machine ID from random generator. lb # [ 1.458728] systemd[1]: Hostname set to . client # [ 1.603349] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.611444] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.643369] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.648773] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.647937] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.652561] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.649166] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.650650] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.653697] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.651756] systemd[1]: Reached target Path Units. worker1 # [ 1.655031] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.652658] systemd[1]: Reached target Slice Units. worker1 # [ 1.656070] systemd[1]: Reached target Path Units. client # [ 1.653577] systemd[1]: Reached target Swaps. worker1 # [ 1.656898] systemd[1]: Reached target Slice Units. client # [ 1.654350] systemd[1]: Reached target Timer Units. worker1 # [ 1.657744] systemd[1]: Reached target Swaps. worker1 # [ 1.658517] systemd[1]: Reached target Timer Units. client # [ 1.655377] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.659446] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.656677] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.651679] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.660592] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.657847] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.661706] systemd[1]: Listening on Journal Sockets. client # [ 1.658871] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.662674] systemd[1]: Listening on udev Control Socket. client # [ 1.659934] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.663704] systemd[1]: Listening on udev Kernel Socket. client # [ 1.660941] systemd[1]: Reached target Socket Units. worker1 # [ 1.664622] systemd[1]: Reached target Socket Units. client # [ 1.662898] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.666292] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.670011] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.667622] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.678295] systemd[1]: Starting Journal Service... client # [ 1.675744] systemd[1]: Starting Journal Service... worker2 # [ 1.691374] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.702788] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.695180] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.680957] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.696335] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.702738] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.697724] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.698876] systemd[1]: Reached target Path Units. worker2 # [ 1.699790] systemd[1]: Reached target Slice Units. worker1 # [ 1.707369] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.700666] systemd[1]: Reached target Swaps. worker2 # [ 1.701432] systemd[1]: Reached target Timer Units. client # [ 1.706657] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.702359] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.703541] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.704647] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.705601] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.706567] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.715305] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.707471] systemd[1]: Reached target Socket Units. client # [ 1.713741] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.709283] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.713894] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.726746] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.728196] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.726968] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.728849] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.733841] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.735209] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.739295] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.720501] systemd[1]: Starting Journal Service... client # [ 1.741968] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.744635] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.747996] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.754303] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.735058] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.749039] systemd[1]: Starting Load Kernel Modules... lb # [ 1.739756] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.752932] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.758639] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.741040] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.742503] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.743676] systemd[1]: Reached target Path Units. worker1 # [ 1.764354] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.744646] systemd[1]: Reached target Slice Units. lb # [ 1.745564] systemd[1]: Reached target Swaps. lb # [ 1.746420] systemd[1]: Reached target Timer Units. worker2 # [ 1.760081] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.747455] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.748695] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.749916] systemd[1]: Listening on Journal Sockets. lb # [ 1.750969] systemd[1]: Listening on udev Control Socket. lb # [ 1.752033] systemd[1]: Listening on udev Kernel Socket. client # [ 1.769342] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.752989] systemd[1]: Reached target Socket Units. worker1 # [ 1.775553] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.754879] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.771512] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.759463] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.779764] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.780133] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.786536] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.796327] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.769075] systemd[1]: Starting Journal Service... worker2 # [ 1.794203] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.804421] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.802171] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.798271] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.794638] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.817297] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.809893] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.815658] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.798505] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.814535] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.825452] systemd[1]: Starting Apply Kernel Variables... client # [ 1.823109] systemd[1]: Finished Load Kernel Modules. lb # [ 1.806584] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.823877] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.835836] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.817922] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.819906] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.844371] systemd[1]: Started Journal Service. worker1 # [ 1.711105] systemd-modules-load[67]: Inserted module 'dm_mod' worker1 # [ 1.714313] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.827531] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.715375] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.717322] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.716276] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.850964] systemd[1]: Started Journal Service. client # lb # [ 1.833474] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.719584] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.721547] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.724065] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.725308] systemd[1]: Reached target Local File Systems. lb # [ 1.839821] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.728741] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.855940] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.735812] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.736102] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.865093] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.737154] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.738103] systemd[1]: Reached target Local File Systems. worker1 # [ 1.740911] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.853472] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.742097] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.874376] systemd[1]: Finished Load Kernel Modules. lb # [ 1.860273] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.748621] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.751575] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.869595] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.883912] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.760540] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.894247] systemd[1]: Started Journal Service. worker2 # [ 1.757891] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.762134] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.763257] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.776194] systemd[1]: Finished Create System Files and Directories. lb # [ 1.893002] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.773228] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.787253] systemd-udevd[78]: Using default interface naming scheme 'v261'. worker2 # [ 1.780712] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.901613] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.783103] systemd[1]: Reached target Local File Systems. worker2 # [ 1.787058] systemd[1]: Starting Create System Files and Directories... lb # [ 1.913463] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.795162] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.801275] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 1.808900] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.802646] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.925607] systemd[1]: Starting Apply Kernel Variables... client # [ 1.823809] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.942734] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.823175] systemd[1]: Finished Create System Files and Directories. lb # [ 1.810736] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.814317] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.948748] systemd[1]: Started Journal Service. lb # [ 1.816306] systemd-modules-load[67]: Inserted module 'virtio_gpu' lb # [ 1.828549] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.830662] systemd[1]: Reached target Local File Systems. lb # [ 1.832284] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.847443] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.839629] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.863174] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.864360] systemd[1]: Reached target System Initialization. lb # [ 1.845072] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.866306] systemd[1]: Reached target Basic System. worker2 # [ 1.870730] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.881744] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.882740] systemd[1]: Reached target System Initialization. client # [ 1.883572] systemd[1]: Reached target Basic System. lb # [ 1.870392] systemd[1]: Finished Create System Files and Directories. lb # [ 1.892331] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.925114] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.926120] systemd[1]: Reached target System Initialization. worker2 # [ 1.926946] systemd[1]: Reached target Basic System. lb # [ 1.914653] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.975793] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.976739] systemd[1]: Reached target System Initialization. lb # [ 1.977611] systemd[1]: Reached target Basic System. worker1 # [ 2.180923] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.181626] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.189674] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.201584] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.206535] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.207289] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.204463] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.209387] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.218312] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.220310] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.220960] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.224240] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.225967] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.223820] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.227090] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.224505] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.230459] usb usb1: Product: EHCI Host Controller worker1 # [ 2.231117] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.233081] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.235389] hub 1-0:1.0: USB hub found worker1 # [ 2.235958] hub 1-0:1.0: 6 ports detected worker1 # [ 2.237969] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.239545] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.246947] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.250343] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.247430] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.248213] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.250090] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.250776] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.256642] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.260076] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.261191] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.258601] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.253912] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.259721] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.263356] usb usb1: Product: EHCI Host Controller client # [ 2.264183] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.261062] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.266405] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.261787] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.267401] hub 1-0:1.0: USB hub found client # [ 2.268572] hub 1-0:1.0: 6 ports detected worker2 # [ 2.264182] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.270664] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.271370] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.275011] SCSI subsystem initialized worker1 # [ 2.276933] usb usb2: Product: UHCI Host Controller client # [ 2.276628] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.272313] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.277384] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.273105] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.275131] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.287060] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.287922] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.281942] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.283187] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.288416] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.284388] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.159633] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.287829] usb usb1: Product: EHCI Host Controller worker1 # [ 2.161958] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.288561] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.291180] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.293266] hub 1-0:1.0: USB hub found client # [ 2.299147] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.294450] hub 1-0:1.0: 6 ports detected worker1 # [ 2.306468] hub 2-0:1.0: USB hub found worker1 # [ 2.174844] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.302462] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.176819] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.308579] usb usb2: Product: UHCI Host Controller worker2 # [ 2.303287] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.309260] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.315494] hub 2-0:1.0: 2 ports detected lb # [ 2.295353] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.186653] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.315865] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.302686] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.188188] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.316683] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.328302] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.307269] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.326369] SCSI subsystem initialized worker1 # [ 2.197983] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.324545] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.325898] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.314809] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.201810] systemd[1]: Finished Virtual Console Setup. lb # [ 2.315552] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.340640] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.323771] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.337084] usb usb2: Product: UHCI Host Controller client # [ 2.207887] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.337795] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.324575] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.209905] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.344557] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.326362] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.333418] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.347130] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.334358] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.335975] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.357689] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.338407] usb usb1: Product: EHCI Host Controller lb # [ 2.339061] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.359737] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.342523] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.343312] hub 1-0:1.0: USB hub found worker2 # [ 2.356884] hub 2-0:1.0: USB hub found lb # [ 2.344536] hub 1-0:1.0: 6 ports detected client # [ 2.229314] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.232784] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.231353] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.233698] systemd[1]: Reached target Initrd Root Device. client # [ 2.365635] hub 2-0:1.0: USB hub found worker1 # [ 2.368719] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.369924] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.368125] hub 2-0:1.0: 2 ports detected worker2 # [ 2.364235] hub 2-0:1.0: 2 ports detected worker1 # [ 2.238324] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.373781] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.356546] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.378230] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.357309] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.378965] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.242155] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.377710] SCSI subsystem initialized worker1 # [ 2.385643] usb usb3: Product: UHCI Host Controller worker1 # [ 2.387419] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.388178] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.370686] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.250152] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.394631] hub 3-0:1.0: USB hub found client # [ 2.258679] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.395755] hub 3-0:1.0: 2 ports detected worker2 # [ 2.252853] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.260211] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.255167] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.395987] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.378136] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.401293] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.265336] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.402008] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.382465] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.383632] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.406419] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.398980] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.407171] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.399760] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.407986] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.412452] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.414315] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.281599] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.408307] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.413770] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.416680] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.285710] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.420592] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.425466] usb usb4: Product: UHCI Host Controller client # [ 2.422592] usb usb3: Product: UHCI Host Controller lb # [ 2.404684] usb usb2: Product: UHCI Host Controller client # [ 2.423277] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.426402] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.427197] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.407164] SCSI subsystem initialized client # [ 2.426586] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.429734] hub 4-0:1.0: USB hub found worker2 # [ 2.421956] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.422745] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.428718] hub 3-0:1.0: USB hub found worker1 # [ 2.432294] hub 4-0:1.0: 2 ports detected lb # [ 2.279786] systemd[1]: Starting Virtual Console Setup... lb # [ 2.414138] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.433838] hub 3-0:1.0: 2 ports detected worker2 # [ 2.295668] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.417411] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.303057] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.298422] systemd[1]: Finished Virtual Console Setup. client # [ 2.439781] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.421557] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.310734] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.440356] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.448901] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.294538] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.441485] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.448565] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.450177] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.432943] hub 2-0:1.0: USB hub found worker1 # [ 2.454233] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.451749] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.455192] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.454747] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.450909] usb usb3: Product: UHCI Host Controller worker2 # [ 2.451617] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.457331] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.458375] usb usb4: Product: UHCI Host Controller worker2 # [ 2.323078] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.323939] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.325126] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.312176] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.459916] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.468705] scsi host0: ahci lb # [ 2.314169] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.466130] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.462077] hub 3-0:1.0: USB hub found client # [ 2.468240] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.463971] hub 3-0:1.0: 2 ports detected worker1 # [ 2.472304] scsi host1: ahci lb # [ 2.451498] hub 2-0:1.0: 2 ports detected worker1 # [ 2.473244] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.471433] hub 4-0:1.0: USB hub found client # [ 2.472674] hub 4-0:1.0: 2 ports detected worker1 # [ 2.476304] scsi host2: ahci worker1 # [ 2.477903] scsi host3: ahci lb # [ 2.322819] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.470078] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.479546] scsi host4: ahci worker1 # [ 2.481067] scsi host5: ahci lb # [ 2.327449] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.482724] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.483884] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.485068] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.486260] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.478866] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.487538] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.479964] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.488718] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.489214] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.485327] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.487116] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.474753] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.475544] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.489869] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.492858] usb usb4: Product: UHCI Host Controller worker2 # [ 2.493613] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.495861] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.501931] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.498263] hub 4-0:1.0: USB hub found client # [ 2.504579] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.500126] hub 4-0:1.0: 2 ports detected lb # [ 2.487493] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.506212] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.488283] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.510406] scsi host0: ahci lb # [ 2.359058] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.360062] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.372416] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.512230] scsi host1: ahci client # [ 2.513955] scsi host2: ahci lb # [ 2.495313] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.515694] scsi host3: ahci lb # [ 2.364067] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.376790] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.517288] scsi host4: ahci client # [ 2.519061] scsi host5: ahci client # [ 2.520175] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.502311] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.503639] usb usb3: Product: UHCI Host Controller client # [ 2.521982] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.504352] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.523229] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.524389] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.525557] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.526680] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.509426] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.514685] hub 3-0:1.0: USB hub found lb # [ 2.515906] hub 3-0:1.0: 2 ports detected lb # [ 2.522638] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.536856] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.524554] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.527495] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.528289] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.531548] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.535532] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.549521] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.550632] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.407066] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.554890] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.558902] scsi host0: ahci lb # [ 2.412457] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.560163] scsi host1: ahci lb # [ 2.548462] usb usb4: Product: UHCI Host Controller worker2 # [ 2.562090] scsi host2: ahci lb # [ 2.549155] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.550128] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.564124] scsi host3: ahci worker2 # [ 2.565774] scsi host4: ahci lb # [ 2.552635] hub 4-0:1.0: USB hub found lb # [ 2.553841] hub 4-0:1.0: 2 ports detected worker2 # [ 2.567384] scsi host5: ahci worker2 # [ 2.568419] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.570224] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.571397] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.572530] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.573694] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.574883] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.573168] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.603762] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.604925] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.584420] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.606274] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.606876] usb 1-1: Manufacturer: QEMU worker1 # [ 2.607613] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.586612] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.587530] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.599325] scsi host0: ahci worker1 # [ 2.621166] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.601026] scsi host1: ahci lb # [ 2.602701] scsi host2: ahci lb # [ 2.604349] scsi host3: ahci lb # [ 2.605980] scsi host4: ahci lb # [ 2.607814] scsi host5: ahci lb # [ 2.609270] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.610706] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.611960] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.613105] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.614292] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.615495] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.634524] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.635686] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.637162] usb 1-1: Product: QEMU USB Tablet client # [ 2.637886] usb 1-1: Manufacturer: QEMU client # [ 2.638418] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.652691] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.667132] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.670029] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.673305] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.675182] usb 1-1: Manufacturer: QEMU worker2 # [ 2.676908] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.708519] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.589162] systemd[1]: Mounting /sysroot... client # [ 2.593400] systemd[1]: Mounting /sysroot... lb # [ 2.713620] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.716519] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.719931] usb 1-1: Product: QEMU USB Tablet lb # [ 2.721736] usb 1-1: Manufacturer: QEMU lb # [ 2.723363] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.754721] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.639154] systemd[1]: Mounting /sysroot... worker1 # [ 2.800980] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.803571] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.805829] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.808067] ata3.00: applying bridge limits worker1 # [ 2.810049] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.812414] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.814588] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.817102] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.819456] ata3.00: configured for UDMA/100 worker1 # [ 2.821882] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.682760] systemd[1]: Mounting /sysroot... client # [ 2.839811] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.840804] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.841945] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.842825] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.843847] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.844658] ata3.00: applying bridge limits client # [ 2.845372] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.846284] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.847382] ata3.00: configured for UDMA/100 client # [ 2.848449] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.896527] usbcore: registered new interface driver usbhid worker2 # [ 2.889159] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.899587] usbhid: USB HID core driver worker2 # [ 2.891346] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.894052] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.896210] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.898726] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.906668] usbcore: registered new interface driver usbhid client # [ 2.907465] usbhid: USB HID core driver worker2 # [ 2.901118] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.911364] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.903409] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.905611] ata3.00: applying bridge limits worker2 # [ 2.907447] ata3.00: configured for UDMA/100 worker2 # [ 2.911013] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.925326] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.927424] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.931807] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.929747] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.939786] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.943039] EXT4-fs (vda): mounted filesystem d062716e-6d66-4e79-a03e-5a9d2dc53b53 r/w with ordered data mode. Quota mode: none. client # [ 2.943700] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.945787] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.927703] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.815702] systemd[1]: Mounted /sysroot. lb # [ 2.928717] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.816992] systemd[1]: Reached target Initrd Root File System. lb # [ 2.930021] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.931079] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.931894] ata3.00: applying bridge limits lb # [ 2.932692] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.820145] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.933663] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.934585] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.935478] ata3.00: configured for UDMA/100 lb # [ 2.936503] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.959309] EXT4-fs (vda): mounted filesystem b9f13cff-0ead-459d-99cb-c38c5adb499c r/w with ordered data mode. Quota mode: none. client # [ 2.832985] systemd[1]: Mounted /sysroot. client # [ 2.833759] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.836789] systemd-sysroot-fstab-check[137]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.839585] systemd[1]: Reload requested from client PID 137 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.841070] systemd[1]: Reloading... client # [ 2.839065] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 2.845079] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 2.852791] systemd[1]: Mounting /sysroot/run... worker2 # [ 2.987957] usbcore: registered new interface driver usbhid client # [ 2.862033] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 2.991828] usbhid: USB HID core driver client # [ 2.868159] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 2.878403] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.995772] usbcore: registered new interface driver usbhid lb # [ 3.001423] usbhid: USB HID core driver worker2 # [ 3.015024] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 3.019040] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.020793] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 3.029937] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 3.038728] EXT4-fs (vda): mounted filesystem 27aedd73-c7f5-47bc-89d2-75f46435235d r/w with ordered data mode. Quota mode: none. lb # [ 3.025864] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.027776] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.910873] systemd[1]: Mounted /sysroot. worker1 # [ 2.920973] systemd[1]: Reloading finished in 78 ms. lb # [ 3.034080] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.913828] systemd[1]: Reached target Initrd Root File System. client # [ 2.919150] systemd-sysroot-fstab-check[145]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.915960] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.922795] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 2.928524] systemd-sysroot-fstab-check[137]: Requesting initrd-fs.target/start/replace... client # [ 2.927578] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 2.928375] systemd[1]: Mounted /sysroot/run. client # [ 2.928978] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.045570] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.931050] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 2.933162] systemd-sysroot-fstab-check[137]: Requesting swap.target/start/replace... lb # [ 3.048262] EXT4-fs (vda): mounted filesystem 584ecce4-ad2e-4d2e-9f8c-48f804df99f9 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.937120] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.938208] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.939286] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 2.937256] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 2.920187] systemd[1]: Mounted /sysroot. worker2 # [ 2.934096] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.939606] systemd[1]: Reload requested from client PID 145 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.922554] systemd[1]: Reached target Initrd Root File System. client # [ 2.941101] systemd[1]: Reloading... worker2 # [ 2.937149] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.926077] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.939148] systemd[1]: Reloading... lb # [ 2.941524] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.946058] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.947531] systemd[1]: Reloading... client # [ 3.012370] systemd[1]: Reloading finished in 70 ms. client # [ 3.021553] systemd-sysroot-fstab-check[145]: Requesting initrd-fs.target/start/replace... client # [ 3.024379] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.025563] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.021575] systemd[1]: Reloading finished in 82 ms. client # [ 3.027681] systemd-sysroot-fstab-check[145]: Requesting swap.target/start/replace... client # [ 3.030934] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.032089] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.034083] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.036905] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.031608] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.036166] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker2 # [ 3.039738] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.040774] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.041797] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.049336] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.031954] systemd[1]: Reloading finished in 85 ms. client # [ 3.050791] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.041027] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... lb # [ 3.046119] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... lb # [ 3.049135] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.050522] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.051643] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.590546] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.593745] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.598131] systemd[1]: Mounting /sysroot/run... client # [ 3.595153] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.602155] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.608145] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.626941] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.631785] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.634650] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.638730] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.640159] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.643769] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.644716] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.640185] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.648196] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.654168] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.651437] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.646176] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.655589] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.656244] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.656297] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.665155] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.682085] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.678790] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.686074] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 3.691846] systemd[1]: Finished Find NixOS closure. client # [ 3.694142] systemd[1]: Reached target Initrd Default Target. client # [ 3.695421] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.685183] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.709809] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.690934] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.711393] systemd[1]: Stopped target Basic System. client # [ 3.713232] systemd[1]: Stopped target Initrd Root Device. client # [ 3.714126] systemd[1]: Stopped target Path Units. client # [ 3.714911] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.716110] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.717337] systemd[1]: Stopped target Slice Units. lb # [ 3.699259] systemd[1]: Mounting /sysroot/run... client # [ 3.718436] systemd[1]: Stopped target Socket Units. client # [ 3.719527] systemd[1]: Stopped target System Initialization. client # [ 3.720708] systemd[1]: Stopped target Swaps. client # [ 3.721757] systemd[1]: Stopped target Timer Units. worker2 # [ 3.716933] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.722830] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.724142] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.719307] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.725839] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.727085] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.722135] systemd[1]: Mounted /sysroot/run. lb # [ 3.708938] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.728236] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.723857] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.725589] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.731067] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.732157] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.732966] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.734107] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.729912] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.734927] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.736385] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.719351] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.739109] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.740267] systemd[1]: Stopped Create System Files and Directories. client # [ 3.741267] systemd[1]: Stopped target Local File Systems. client # [ 3.742145] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.743187] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.744291] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.740551] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.746662] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.742073] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.747848] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.744329] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.750127] systemd[1]: Stopped Virtual Console Setup. client # [ 3.758951] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.763141] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.768945] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.765962] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.770951] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.767088] systemd[1]: Reached target Initrd File Systems. lb # [ 3.754578] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.773074] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.768688] systemd[1]: Starting Find NixOS closure... client # [ 3.774373] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.775904] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.772139] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.778118] systemd[1]: Closed udev Control Socket. lb # [ 3.761147] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.779188] systemd[1]: Starting Cleanup udev Database... lb # [ 3.762216] systemd[1]: Mounted /sysroot/run. client # [ 3.780060] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.782153] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.783579] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.784748] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.785826] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.768432] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.787137] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.769428] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.772765] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.789199] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.783201] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.796583] systemd[1]: Finished Find NixOS closure. client # [ 3.802151] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.784661] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.797848] systemd[1]: Reached target Initrd Default Target. client # [ 3.803618] systemd[1]: Finished Cleanup udev Database. lb # [ 3.786969] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.800075] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.805995] systemd[1]: Reached target Switch Root. client # [ 3.807108] systemd[1]: Starting NixOS Activation... worker2 # [ 3.813436] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.814777] systemd[1]: Stopped target Basic System. worker2 # [ 3.815687] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.817104] systemd[1]: Stopped target Path Units. worker2 # [ 3.817845] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.818932] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.819982] systemd[1]: Stopped target Slice Units. lb # [ 3.807832] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.820823] systemd[1]: Stopped target Socket Units. lb # [ 3.808942] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.821855] systemd[1]: Stopped target System Initialization. worker2 # [ 3.822908] systemd[1]: Stopped target Swaps. lb # [ 3.810564] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.823741] systemd[1]: Stopped target Timer Units. worker2 # [ 3.824707] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.825823] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.814136] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.827138] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.828246] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.829800] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.831137] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.832217] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.833297] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.834629] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.836260] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.837606] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.838856] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.840052] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.842143] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.843127] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.831269] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.845110] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.846114] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.847135] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.849157] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.850167] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.838379] systemd[1]: Finished Find NixOS closure. lb # [ 3.839682] systemd[1]: Reached target Initrd Default Target. lb # [ 3.841659] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.856571] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.860043] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.867415] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.855670] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.857072] systemd[1]: Stopped target Basic System. worker2 # [ 3.871121] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.859127] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.859846] systemd[1]: Stopped target Path Units. worker2 # [ 3.872210] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.877099] initrd-nixos-activation-start[193]: booting system configuration /nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test worker2 # [ 3.873234] systemd[1]: Closed udev Control Socket. lb # [ 3.860544] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.861563] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.875203] systemd[1]: Starting Cleanup udev Database... lb # [ 3.862797] systemd[1]: Stopped target Slice Units. lb # [ 3.863531] systemd[1]: Stopped target Socket Units. worker2 # [ 3.876056] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.864259] systemd[1]: Stopped target System Initialization. lb # [ 3.865036] systemd[1]: Stopped target Swaps. worker2 # [ 3.878067] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.865650] systemd[1]: Stopped target Timer Units. worker2 # [ 3.878931] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.867139] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.880132] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.867926] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.881141] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.868726] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.882086] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.869741] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.882942] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.871316] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.885627] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.873147] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.874191] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.875222] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.876404] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.877454] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.878759] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.880097] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.882123] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.883233] systemd[1]: Stopped target Local File Systems. lb # [ 3.884259] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.885478] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.904099] initrd-nixos-activation-start[193]: running activation script... lb # [ 3.887131] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.887995] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.902220] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.889747] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.891123] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.904077] systemd[1]: Finished Cleanup udev Database. worker2 # [ 3.905742] systemd[1]: Reached target Switch Root. worker2 # [ 3.906765] systemd[1]: Starting NixOS Activation... lb # [ 3.900490] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.903748] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.909146] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.911132] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.912918] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.914104] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.916959] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.917970] systemd[1]: Closed udev Control Socket. lb # [ 3.918914] systemd[1]: Starting Cleanup udev Database... lb # [ 3.920230] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.921282] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.923149] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.924208] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.925173] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.926087] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.941824] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.944083] systemd[1]: Finished Cleanup udev Database. lb # [ 3.944779] systemd[1]: Reached target Switch Root. lb # [ 3.946545] systemd[1]: Starting NixOS Activation... worker2 # [ 3.985946] initrd-nixos-activation-start[190]: booting system configuration /nix/store/xnscg6z9qxa84gbw1h8qb1f0c0aarhsv-nixos-system-worker2-test worker2 # [ 4.014940] initrd-nixos-activation-start[190]: running activation script... lb # [ 4.017369] initrd-nixos-activation-start[191]: booting system configuration /nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test lb # [ 4.041953] initrd-nixos-activation-start[191]: running activation script... client # [ 4.102733] initrd-nixos-activation-start[216]: setting up /etc... client # [ 4.209874] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.211516] systemd[1]: Finished NixOS Activation. client # [ 4.213388] systemd[1]: Starting Switch Root... worker2 # [ 4.213492] initrd-nixos-activation-start[213]: setting up /etc... client # [ 4.226885] systemd[1]: Switching root. lb # [ 4.237981] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 4.306331] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.307941] systemd[1]: Finished NixOS Activation. worker2 # [ 4.309771] systemd[1]: Starting Switch Root... worker2 # [ 4.322635] systemd[1]: Switching root. client # [ 4.487750] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.346236] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.348076] systemd[1]: Finished NixOS Activation. lb # [ 4.350117] systemd[1]: Starting Switch Root... lb # [ 4.364162] systemd[1]: Switching root. worker2 # [ 4.582867] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.590497] NET: Registered PF_VSOCK protocol family lb # [ 4.622190] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.651824] NET: Registered PF_VSOCK protocol family lb # [ 4.703925] NET: Registered PF_VSOCK protocol family worker1 # [ 4.591386] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.638658] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.640606] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.643907] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.648253] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.676078] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.677216] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.685111] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.686441] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.688148] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.701520] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.703614] systemd[1]: Stopped target Basic System. worker1 # [ 4.704506] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.705495] systemd[1]: Stopped target Path Units. worker1 # [ 4.706414] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.708098] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.709162] systemd[1]: Stopped target Slice Units. worker1 # [ 4.709922] systemd[1]: Stopped target Socket Units. worker1 # [ 4.710637] systemd[1]: Stopped target System Initialization. worker1 # [ 4.711745] systemd[1]: Stopped target Swaps. worker1 # [ 4.712691] systemd[1]: Stopped target Timer Units. worker1 # [ 4.713748] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.715148] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.715974] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.716972] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.718621] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.720176] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.721297] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.722332] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.723578] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.725131] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.726228] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.727430] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.728427] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.730095] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.730855] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.731820] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.732884] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.737572] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.738660] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.739665] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.749527] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.751525] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.754470] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.756096] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.758329] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.760081] systemd[1]: Closed udev Control Socket. worker1 # [ 4.761069] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.762125] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.763182] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.764136] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.766061] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.766971] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.767896] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.768790] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.771115] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.786135] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.787398] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.789117] systemd[1]: Reached target Switch Root. worker1 # [ 4.789993] systemd[1]: Starting NixOS Activation... client # [ 4.951022] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 4.960771] systemd[1]: Detected virtualization kvm. client # [ 4.962597] systemd[1]: Detected architecture x86-64. client # [ 4.964561] systemd[1]: Detected first boot. client # [ 4.968662] systemd[1]: Initializing machine ID from random generator. worker1 # [ 4.858578] initrd-nixos-activation-start[189]: booting system configuration /nix/store/4idnay9kf4i79rgksq2a0cx0x5kksln8-nixos-system-worker1-test worker1 # [ 4.884166] initrd-nixos-activation-start[189]: running activation script... worker2 # [ 5.008964] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.012851] systemd[1]: Detected virtualization kvm. worker2 # [ 5.013557] systemd[1]: Detected architecture x86-64. worker2 # [ 5.014309] systemd[1]: Detected first boot. worker2 # [ 5.016597] systemd[1]: Initializing machine ID from random generator. lb # [ 5.062769] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.066639] systemd[1]: Detected virtualization kvm. lb # [ 5.067379] systemd[1]: Detected architecture x86-64. lb # [ 5.068127] systemd[1]: Detected first boot. lb # [ 5.070594] systemd[1]: Initializing machine ID from random generator. client # [ 5.089631] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.174775] systemd[1]: Applying preset policy. lb # [ 5.172773] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.078920] initrd-nixos-activation-start[212]: setting up /etc... worker2 # [ 5.219392] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.270863] systemd[1]: Applying preset policy. worker1 # [ 5.177698] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.304863] systemd[1]: Applying preset policy. worker1 # [ 5.180066] systemd[1]: Finished NixOS Activation. worker1 # [ 5.181208] systemd[1]: Starting Switch Root... client # [ 5.318986] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.193693] systemd[1]: Switching root. worker1 # [ 5.455741] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.457852] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.458911] systemd[1]: Populated /etc with preset unit settings. client # [ 5.501682] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 5.502982] systemd[1]: Stopped initrd-switch-root.service. client # [ 5.504995] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 5.507043] systemd[1]: Created slice Slice /system/getty. client # [ 5.508342] systemd[1]: Created slice User and Session Slice. client # [ 5.509352] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.510594] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 5.511646] systemd[1]: Expecting device /dev/hvc0... client # [ 5.512328] systemd[1]: Expecting device /dev/ttyS0... client # [ 5.513110] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.513952] systemd[1]: Stopped target initrd-fs.target. client # [ 5.514734] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.515494] systemd[1]: Stopped target initrd-switch-root.target. client # [ 5.516321] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.517230] systemd[1]: Reached target Path Units. client # [ 5.517941] systemd[1]: Reached target Remote File Systems. client # [ 5.518720] systemd[1]: Reached target Slice Units. client # [ 5.519392] systemd[1]: Reached target Swaps. client # [ 5.521228] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 5.523609] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.525257] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.527144] systemd[1]: Listening on Factory Reset Management. client # [ 5.539400] systemd[1]: Listening on Hostname Service Socket. client # [ 5.542114] systemd[1]: Starting Journal Log Access Socket... client # [ 5.543466] systemd[1]: Listening on Journal Audit Socket. client # [ 5.545750] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.546846] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 5.548333] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.549636] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.554706] NET: Registered PF_VSOCK protocol family client # [ 5.553568] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.554557] systemd[1]: Listening on udev Control Socket. client # [ 5.555371] systemd[1]: Listening on udev Varlink Socket. client # [ 5.557478] systemd[1]: Mounting Huge Pages File System... client # [ 5.560599] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.566683] systemd[1]: Mounting Kernel Debug File System... client # [ 5.575438] systemd[1]: Mounting Kernel Trace File System... client # [ 5.582491] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.590591] systemd[1]: Starting Load Kernel Module configfs... client # [ 5.597573] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 5.606754] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.614759] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.626675] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.622771] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 5.627489] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.624201] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.626283] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.628370] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.629676] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.630602] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.631867] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.632970] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.633692] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.634446] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.635262] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.636067] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.636896] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.637745] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.638671] systemd[1]: Reached target Path Units. worker2 # [ 5.639369] systemd[1]: Reached target Remote File Systems. client # [ 5.644611] systemd[1]: Starting Journal Service... worker2 # [ 5.640133] systemd[1]: Reached target Slice Units. worker2 # [ 5.640868] systemd[1]: Reached target Swaps. worker2 # [ 5.642592] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.644930] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.646590] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.652656] systemd[1]: Starting Load Kernel Modules... client # [ 5.663213] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.648384] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.660899] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.663684] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.665187] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.667991] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.674241] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.669114] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.670260] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.671600] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.675397] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.680678] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.676409] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.677264] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.679362] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.683374] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.691480] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.674654] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.676038] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.691140] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.678171] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 5.680524] systemd[1]: Created slice Slice /system/getty. client # [ 5.698679] systemd-journald[286]: Collecting audit messages is enabled. lb # [ 5.681834] systemd[1]: Created slice User and Session Slice. client # [ 5.700070] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.682801] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.697227] systemd[1]: Mounting Kernel Trace File System... lb # [ 5.684006] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.685098] systemd[1]: Expecting device /dev/hvc0... lb # [ 5.685826] systemd[1]: Expecting device /dev/ttyS0... client # [ 5.704996] systemd[1]: Mounted Huge Pages File System. lb # [ 5.686667] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.687699] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.688482] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.706683] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 5.689276] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.690120] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.691014] systemd[1]: Reached target Path Units. lb # [ 5.691720] systemd[1]: Reached target Remote File Systems. lb # [ 5.692512] systemd[1]: Reached target Slice Units. lb # [ 5.693181] systemd[1]: Reached target Swaps. worker2 # [ 5.707043] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.713013] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.695220] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.697853] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.586856] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.722664] systemd[1]: Started Journal Service. client # [ 5.590539] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.721949] systemd[1]: Starting Load Kernel Module configfs... lb # [ 5.699700] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.596268] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.724589] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 5.597317] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.713050] systemd[1]: Listening on Factory Reset Management. lb # [ 5.713978] systemd[1]: Listening on Hostname Service Socket. lb # [ 5.716825] systemd[1]: Starting Journal Log Access Socket... lb # [ 5.718292] systemd[1]: Listening on Journal Audit Socket. client # [ 5.605403] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.733447] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 5.721092] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 5.722284] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.723436] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.724701] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 5.610139] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.738916] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.745122] loop: module loaded lb # [ 5.728855] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.729929] systemd[1]: Listening on udev Control Socket. client # [ 5.614746] systemd-modules-load[287]: Inserted module 'loop' lb # [ 5.730827] systemd[1]: Listening on udev Varlink Socket. lb # [ 5.733057] systemd[1]: Mounting Huge Pages File System... lb # [ 5.735344] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.748991] systemd[1]: Mounting FUSE Control File System... client # [ 5.625336] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.753596] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 5.742581] systemd[1]: Mounting Kernel Debug File System... client # [ 5.762089] EXT4-fs (vda): re-mounted b9f13cff-0ead-459d-99cb-c38c5adb499c. client # [ 5.631826] systemd[1]: Finished Load Kernel Modules. lb # [ 5.749809] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.765988] systemd[1]: Starting Journal Service... client # [ 5.639936] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.770467] systemd[1]: Starting Load Kernel Modules... client # [ 5.642100] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.759253] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.648065] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.779906] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 5.651657] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.652715] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.770537] systemd[1]: Starting Load Kernel Module configfs... client # [ 5.656775] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.785859] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.786771] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.663421] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.793202] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.779903] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.799150] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.800723] systemd[1]: Mounted Huge Pages File System. client # [ 5.674098] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 5.803047] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.675109] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.805060] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.792898] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.807044] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.810407] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.812060] systemd[1]: Mounted FUSE Control File System. lb # [ 5.801470] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.686788] systemd-oomd[289]: No swap; memory pressure usage will be degraded worker2 # [ 5.819042] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.812201] systemd[1]: Mounting FUSE Control File System... client # [ 5.702474] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 5.816986] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.833398] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.834710] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.839490] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.829496] systemd[1]: Starting Journal Service... lb # [ 5.834000] systemd[1]: Starting Load Kernel Modules... client # [ 5.858258] systemd-journald[286]: Received client request to flush runtime journal. lb # [ 5.844389] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.863169] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.854466] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.858145] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.871797] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.890225] systemd-journald[283]: Collecting audit messages is enabled. worker2 # [ 5.894865] EXT4-fs (vda): re-mounted 27aedd73-c7f5-47bc-89d2-75f46435235d. lb # [ 5.886094] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.901005] loop: module loaded worker2 # [ 5.905501] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.893432] systemd[1]: Mounted Huge Pages File System. lb # [ 5.894310] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.908900] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.911121] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 5.912178] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.921839] systemd[1]: Detected virtualization kvm. worker2 # [ 5.915125] systemd[1]: Starting Firewall... worker1 # [ 5.923648] systemd[1]: Detected architecture x86-64. worker2 # [ 5.916580] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.904763] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 5.925587] systemd[1]: Detected first boot. lb # [ 5.909341] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 5.929581] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.925263] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.913670] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.915004] loop: module loaded lb # [ 5.915819] systemd-journald[284]: Collecting audit messages is enabled. worker2 # [ 5.931078] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.931919] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.923491] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.927839] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.816425] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 5.932086] systemd[1]: Mounted FUSE Control File System. client # [ 5.817287] systemd[1]: Reached target First Boot Complete. client # [ 5.818983] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.948083] systemd[1]: Started Journal Service. lb # [ 5.936453] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.816094] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.821873] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 5.818250] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.821397] systemd-modules-load[284]: Inserted module 'loop' lb # [ 5.945442] EXT4-fs (vda): re-mounted 584ecce4-ad2e-4d2e-9f8c-48f804df99f9. lb # [ 5.947784] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.828794] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.816807] systemd[1]: Queued start job for default target Multi-User System. lb # [ 5.821099] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.822303] systemd-modules-load[285]: Inserted module 'loop' lb # [ 5.959071] systemd[1]: Starting Firewall... lb # [ 5.965417] systemd[1]: Starting Apply Kernel Variables... client # [ 5.852391] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 5.849788] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 5.857795] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.978830] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.989215] systemd[1]: Started Journal Service. lb # [ 5.859339] systemd-oomd[286]: No swap; memory pressure usage will be degraded lb # [ 5.869172] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 5.888156] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 5.890728] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.877452] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.896377] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 5.898602] systemd[1]: Reached target First Boot Complete. client # [ 5.911863] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.043888] systemd-journald[283]: Received client request to flush runtime journal. lb # [ 5.900556] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.907161] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.909131] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.929060] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 5.930296] systemd[1]: Reached target Preparation for Local File Systems. client # [ 5.932746] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 5.917180] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.917990] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.962844] systemd-udevd[318]: Using default interface naming scheme 'v261'. client # [ 5.995160] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 5.977381] systemd[1]: Finished Apply Kernel Variables. lb # [ 6.112564] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 6.169994] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.040428] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.045966] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.049299] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.050113] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.050936] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.054141] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.055775] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.072635] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.070100] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.072276] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.074174] systemd[1]: Reached target First Boot Complete. lb # [ 6.080468] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.087157] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.093722] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.107470] systemd-udevd[316]: Using default interface naming scheme 'v261'. client # [ 6.120072] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.136427] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.274666] systemd[1]: Applying preset policy. client # [ 6.157375] (udev-worker)[321]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.164337] (udev-worker)[325]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.166533] (udev-worker)[325]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.179447] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.180604] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.193160] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 6.194460] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.197341] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.246126] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.247605] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.249114] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.251490] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.252961] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.254504] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.241704] systemd-udevd[326]: Using default interface naming scheme 'v261'. worker2 # [ 6.266350] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 6.430094] systemd[1]: Populated /etc with preset unit settings. client # [ 6.438338] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 6.291204] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 6.449061] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 client # [ 6.452454] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 worker2 # [ 6.347956] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.373590] systemd[1]: Mounting /run/wrappers... client # [ 6.465820] ACPI: button: Power Button [PWRF] client # [ 6.472359] mousedev: PS/2 mouse device common for all mice lb # [ 6.405760] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.431044] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.438542] systemd[1]: Mounted /run/wrappers. client # [ 6.440471] systemd[1]: Reached target Local File Systems. client # [ 6.441911] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.446851] systemd[1]: Starting register-nix-paths.service... client # [ 6.448782] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.450380] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.454545] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.498257] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 6.532884] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 6.532953] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:58:07 UTC (1790096287) client # [ 6.533023] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 6.462189] systemd[1]: Starting Create System Files and Directories... worker2 # [ 6.460555] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.616743] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.618117] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.620578] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.622758] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.624130] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.625029] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.626277] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.627380] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.628059] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.628810] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.629666] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.630443] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.631251] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.632059] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.632941] systemd[1]: Reached target Path Units. worker1 # [ 6.633666] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.634471] systemd[1]: Reached target Slice Units. worker1 # [ 6.635146] systemd[1]: Reached target Swaps. worker1 # [ 6.636820] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.497152] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.639130] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 6.640754] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.490662] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 6.506980] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.642538] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.511484] (udev-worker)[359]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.655094] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 6.514583] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.503078] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.657763] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.659133] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.661860] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.662992] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.664079] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.665468] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.668904] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.669938] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.670867] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.673031] systemd[1]: Mounting Huge Pages File System... client # [ 6.538560] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.534950] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.677282] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.537290] systemd[1]: Reached target Local File Systems. client # [ 6.543178] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 6.538293] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 6.682290] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 6.541385] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.544356] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.533781] systemd-journald[286]: Time jumped backwards, rotating. client # [ 6.538798] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 6.688582] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 6.547196] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.551765] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.554158] systemd[1]: Starting Create System Files and Directories... lb # [ 6.543325] (udev-worker)[348]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.698346] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.565097] systemd[1]: Finished Create System Files and Directories. lb # [ 6.548125] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.706718] systemd[1]: Starting Load Kernel Module configfs... client # [ 6.573232] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.554228] (udev-worker)[358]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.709883] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 6.577198] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.715568] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.561903] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.723032] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.546686] Console: switching to colour dummy device 80x25 client # [ 6.552312] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 6.738366] systemd[1]: Mounting FUSE Control File System... worker1 # [ 6.739166] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.591264] systemd[1]: Mounted /run/wrappers. lb # [ 6.592022] systemd[1]: Reached target Local File Systems. lb # [ 6.596107] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.599427] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.755829] systemd[1]: Starting Journal Service... lb # [ 6.604865] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.760530] systemd[1]: Starting Load Kernel Modules... lb # [ 6.608113] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.767667] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 6.629298] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.772710] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.552393] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 6.619602] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.632973] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.772056] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 6.774993] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.772058] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 6.644297] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.780952] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.629365] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.785092] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.787786] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.790782] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.793333] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.794167] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.796450] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.802710] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.805893] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.804971] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 6.805680] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 6.679097] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.682828] systemd[1]: Starting Update is Completed... worker1 # [ 6.831338] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 6.832668] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.836235] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 6.695784] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.700169] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.701853] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.859777] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.725651] systemd[1]: Finished Update is Completed. lb # [ 6.714663] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.721451] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 6.881314] EXT4-fs (vda): re-mounted d062716e-6d66-4e79-a03e-5a9d2dc53b53. worker1 # [ 6.885839] systemd-journald[282]: Collecting audit messages is enabled. client # [ 6.885071] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 6.885764] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 6.892509] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.893720] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.897285] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.899031] loop: module loaded worker1 # [ 6.903609] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.904473] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.907795] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.913145] systemd[1]: Starting Firewall... worker2 # [ 6.775351] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.918800] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.778627] systemd[1]: Finished Create System Files and Directories. worker1 # [ 6.943269] systemd[1]: Started Journal Service. lb # [ 6.788960] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.793596] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.816377] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.820163] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.825543] systemd-modules-load[283]: Inserted module 'loop' worker1 # [ 6.833210] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.834412] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.828091] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.831847] systemd[1]: Starting Update is Completed... worker1 # [ 6.839626] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.937193] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 6.884156] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.884984] systemd[1]: Reached target First Boot Complete. client # [ 6.888200] systemd[1]: Starting Virtual Console Setup... client # [ 6.937563] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 6.978022] Console: switching to colour frame buffer device 160x50 client # [ 7.033400] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 7.039153] systemd-journald[282]: Received client request to flush runtime journal. lb # [ 6.888178] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 6.901481] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 6.902678] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.904117] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.905333] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.921787] systemd[1]: Finished Update is Completed. lb # [ 6.911749] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.913358] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.915186] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.933120] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 6.934363] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.936579] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.938624] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.941421] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.943660] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.946198] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.952199] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 6.954548] systemd[1]: Stopped Virtual Console Setup. client # [ 6.961304] systemd[1]: Starting Virtual Console Setup... lb # [ 6.949152] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.955159] systemd[1]: Starting Update is Completed... worker1 # [ 7.015577] systemd-oomd[284]: No swap; memory pressure usage will be degraded worker1 # [ 7.021861] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.022948] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.023920] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.024786] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.025842] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.028124] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 7.167819] ppdev: user-space parallel port driver client # [ 7.038446] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.041521] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 7.041042] systemd[1]: Finished Firewall. worker2 # [ 7.179767] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.192948] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 7.050735] systemd[1]: Finished Update is Completed. client # [ 7.207882] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.082404] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.212293] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.086884] systemd[1]: Stopped Virtual Console Setup. client # [ 7.089463] systemd[1]: Starting Virtual Console Setup... lb # [ 7.213493] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.102453] systemd-udevd[317]: Using default interface naming scheme 'v261'. lb # [ 7.223261] mousedev: PS/2 mouse device common for all mice lb # [ 7.244286] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.174573] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.173455] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.176107] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.320866] kvm_amd: TSC scaling supported client # [ 7.321318] kvm_amd: Nested Virtualization enabled client # [ 7.322175] kvm_amd: Nested Paging enabled client # [ 7.322750] kvm_amd: LBR virtualization supported client # [ 7.323187] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.323991] kvm_amd: Virtual GIF supported client # [ 7.324371] kvm_amd: Virtual NMI enabled client # [ 7.361697] EDAC MC: Ver: 3.0.0 worker1 # [ 7.246374] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 7.258860] ACPI: button: Power Button [PWRF] worker2 # [ 7.314428] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.328642] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.340455] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.340538] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:58:07 UTC (1790096287) worker1 # [ 7.339498] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.275251] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.340611] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.341951] systemd-journald[283]: Time jumped backwards, rotating. worker2 # [ 7.376337] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.376429] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.398359] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.370562] systemd[1]: Finished register-nix-paths.service. client # [ 7.377889] systemd-vconsole-setup[422]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 7.381084] systemd[1]: Finished Virtual Console Setup. client # [ 7.382655] systemd[1]: Reached target System Initialization. client # [ 7.384035] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.385354] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 7.386247] systemd[1]: Reached target Timer Units. client # [ 7.388101] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.388962] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.389818] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 7.390937] systemd[1]: Reached target Socket Units. client # [ 7.391650] systemd[1]: Reached target Basic System. lb # [ 7.373594] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.393894] systemd[1]: Started backdoor.service. client # [ 7.395121] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.378070] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 7.417243] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.420138] Console: switching to colour dummy device 80x25 client # [ 7.401423] systemd[1]: Starting nftables firewall... client # [ 7.406165] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.413977] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.545946] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.545951] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.278272] ACPI: button: Power Button [PWRF] lb # [ 7.294961] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 7.422845] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.549341] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.295034] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:58:07 UTC (1790096287) worker2 # [ 7.550036] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.425085] systemd[1]: Started Reset console on configuration changes. client # [ 7.434171] systemd[1]: Starting resolvconf update... worker1 # [ 7.442311] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 7.575823] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.576506] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.295111] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.295621] systemd-journald[284]: Time jumped backwards, rotating. lb # [ 7.298278] parport_pc 00:02: reported by Plug and Play ACPI client # connecting to host... worker2 # [ 7.599066] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.473372] (udev-worker)[352]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.600147] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 7.478030] (udev-worker)[356]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.484102] (udev-worker)[356]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.336904] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.439751] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.454828] Console: switching to colour dummy device 80x25 worker1 # [ 7.487093] systemd[1]: Mounting /run/wrappers... client # [ 7.485192] systemd[1]: Starting D-Bus System Message Bus... lb # [ 7.474230] systemd[1]: Finished register-nix-paths.service. lb # [ 7.475287] systemd[1]: Reached target System Initialization. client # [ 7.493564] systemd[1]: Finished Post-Boot Actions. client # [ 7.494490] nsncd[430]: Sep 22 16:58:08.593 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.478065] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.498072] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 7.482147] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.483064] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.483938] systemd[1]: Reached target Timer Units. lb # [ 7.484638] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.503985] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.487476] systemd[1]: Listening on niks3 server socket. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 7.500811] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.503901] systemd[1]: Reached target System Initialization. lb # [ 7.490485] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.515166] systemd[1]: Reached target User and Group Name Lookups. lb # [ 7.491247] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.492312] systemd[1]: Reached target Socket Units. worker1 # [ 7.530918] systemd[1]: Mounted /run/wrappers. client # [ 7.528961] systemd[1]: Starting User Login Management... worker2 # [ 7.505474] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.493037] systemd[1]: Reached target Basic System. client: connected to guest root shell client # [ 7.537722] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 7.496520] systemd[1]: Started backdoor.service. client: (connecting took 8.24 seconds) worker1 # [ 7.533322] systemd[1]: Reached target Local File Systems. lb # [ 7.501312] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.509755] systemd[1]: Started Daily Cleanup of Temporary Directories. client: (finished: waiting for the VM to finish booting, in 8.24 seconds) worker1 # [ 7.534495] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.515103] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.536138] systemd[1]: Starting register-nix-paths.service... lb # [ 7.461877] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.539204] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.591502] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.541609] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.525463] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.544761] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.539364] systemd[1]: Started Reset console on configuration changes. lb # [ 7.591642] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.550387] systemd[1]: Starting Create System Files and Directories... lb # [ 7.691708] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.510616] systemd[1]: Reached target Timer Units. lb # [ 7.691715] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 7.511354] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 7.562383] systemd[1]: Starting resolvconf update... worker2 # [ 7.512298] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.514074] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 7.514914] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.516040] systemd[1]: Reached target Socket Units. worker2 # [ 7.517113] systemd[1]: Reached target Basic System. worker2 # [ 7.520434] systemd[1]: Started backdoor.service. worker2 # [ 7.521172] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.526299] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.531076] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.536055] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.542258] systemd[1]: Starting resolvconf update... worker2 # [ 7.547774] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 7.577748] systemd[1]: Starting Virtual Console Setup... lb # [ 7.580859] systemd[1]: Started rustfs.service. lb # [ 7.599838] systemd[1]: Starting rustfs-bucket.service... client # [ 7.624797] dbus-broker-launch[442]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.628904] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 7.612424] systemd[1]: Finished Firewall. worker1 # [ 7.636124] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.635816] dbus-broker-launch[442]: NSS returned no entry for 'systemd-timesync' lb # connecting to host... client # [ 7.636985] dbus-broker-launch[442]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.742340] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.754719] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.636381] systemd[1]: Finished Post-Boot Actions. client # [ 7.653309] systemd-logind[458]: New seat seat0. lb # [ 7.772802] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.657752] systemd-logind[458]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 7.660976] systemd-logind[458]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 7.662113] systemd-logind[458]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 7.778113] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.645822] systemd[1]: Finished Post-Boot Actions. lb # [ 7.652331] nsncd[519]: Sep 22 16:58:07.988 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # connecting to host... lb # [ 7.657318] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.687181] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.691039] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.693855] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 7.698421] systemd[1]: Started User Login Management. client # [ 7.700271] systemd[1]: Started D-Bus System Message Bus. lb # [ 7.691491] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.692432] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.711053] systemd[1]: Starting linger-users.service... client # [ 7.713709] dbus-broker-launch[442]: Ready lb # [ 7.705304] systemd[1]: Starting D-Bus System Message Bus... lb # [ 7.719566] systemd[1]: Starting User Login Management... worker2 # [ 7.837716] Console: switching to colour frame buffer device 160x50 client # [ 7.742327] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 7.744158] systemd[1]: Stopping Host and Network Name Lookups... client # [ 7.744933] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 7.674490] nsncd[515]: Sep 22 16:58:07.965 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.742077] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.747659] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.748848] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 7.750941] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 7.746516] dbus-broker-launch[519]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.749344] dbus-broker-launch[519]: NSS returned no entry for 'systemd-timesync' client # [ 7.756289] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.752127] dbus-broker-launch[519]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 7.754237] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.758191] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.759849] systemd[1]: Starting User Login Management... worker2 # [ 7.761293] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 7.769581] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.764422] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.765420] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.766160] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.766880] systemd[1]: Started D-Bus System Message Bus. client # [ 7.778428] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.783091] systemd[1]: linger-users.service: Deactivated successfully. client # [ 7.784621] systemd[1]: Finished linger-users.service. lb # [ 7.768605] systemd[1]: Starting Virtual Console Setup... lb # [ 7.772959] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.799705] dbus-broker-launch[519]: Ready client # [ 7.805369] systemd[1]: Finished resolvconf update. client # [ 7.812087] systemd[1]: Starting DHCP Client... worker2 # [ 7.946164] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 7.822447] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.822201] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.825497] systemd[1]: Starting Update is Completed... client # [ 7.823229] nsncd[529]: Sep 22 16:58:08.921 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.825140] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.825942] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.847981] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 7.856259] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 7.857395] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.865142] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.866348] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.860081] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 7.861299] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 7.869307] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.870534] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.864095] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 7.865120] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.865965] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.873772] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.876167] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.879065] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.882237] systemd-logind[541]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 7.886424] systemd-logind[541]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 7.891112] systemd-logind[541]: New seat seat0. worker2 # [ 7.891917] systemd[1]: Started User Login Management. worker2 # [ 7.894780] systemd[1]: Starting linger-users.service... client # [ 7.903617] dhcpcd[555]: dhcpcd-10.3.2 starting client # [ 7.908606] dhcpcd[563]: dev: loaded udev worker1 # [ 7.918493] systemd[1]: Finished Update is Completed. client # [ 8.050842] 8021q: 802.1Q VLAN Support v1.8 client # [ 7.944075] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 7.947195] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.081897] ppdev: user-space parallel port driver worker2 # [ 7.949811] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.951803] nsncd[589]: Sep 22 16:58:08.241 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.956040] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.961047] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 7.963469] systemd[1]: Finished linger-users.service. worker2 # [ 7.974417] systemd[1]: Finished resolvconf update. worker2 # [ 7.976824] systemd[1]: Reached target Preparation for Network. worker2 # [ 7.980410] systemd[1]: Starting DHCP Client... worker2 # [ 7.982993] systemd[1]: Starting Address configuration of eth1... client # [ 8.123241] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 7.985093] systemd[1]: Starting Extra networking commands.... client # [ 8.138713] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.139358] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 8.141896] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.142783] cfg80211: failed to load regulatory.db worker1 # [ 8.033121] systemd[1]: Finished Firewall. client # [ 8.045623] systemd[1]: Finished nftables firewall. client # [ 8.047703] systemd[1]: Reached target Preparation for Network. client # [ 8.051117] systemd[1]: Starting Address configuration of eth1... client # [ 8.187047] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.055420] systemd[1]: Starting Extra networking commands.... client # [ 8.057209] dhcpcd[563]: eth0: waiting for carrier client # [ 8.057858] dhcpcd[563]: eth0: carrier acquired worker1 # [ 8.197123] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.067826] dhcpcd[563]: DUID 00:01:00:01:32:45:70:21:52:54:00:12:34:56 client # [ 8.068825] dhcpcd[563]: eth0: IAID 00:12:34:56 client # [ 8.070575] dhcpcd[563]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.216946] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 8.092556] systemd-vconsole-setup[560]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.096719] systemd[1]: Finished Virtual Console Setup. client # [ 8.236488] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.107928] network-addresses-eth1-start[619]: adding address 192.168.1.4/24... done lb # [ 8.182922] Console: switching to colour frame buffer device 160x50 client # [ 8.114595] network-addresses-eth1-start[586]: adding address 192.168.1.1/24... done lb # [ 8.187864] ppdev: user-space parallel port driver lb # [ 8.230998] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 7.978492] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.101682] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.124641] network-addresses-eth1-start[586]: adding address 2001:db8:1::1/64... done lb # [ 8.105447] dbus-broker-launch[552]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.108936] dbus-broker-launch[552]: NSS returned no entry for 'systemd-timesync' worker2 # [ 8.122275] network-addresses-eth1-start[619]: adding address 2001:db8:1::4/64... done lb # [ 8.109982] dbus-broker-launch[552]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.112195] systemd-logind[553]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.136496] systemd[1]: Finished Address configuration of eth1. lb # [ 8.118171] systemd-logind[553]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.119927] nsncd[607]: Sep 22 16:58:08.434 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.123757] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.124729] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.125943] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 8.127910] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 8.142085] systemd[1]: Finished Address configuration of eth1. lb # [ 8.131448] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.132562] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.133748] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.135163] dbus-broker-launch[552]: Ready client # [ 8.154133] systemd[1]: Finished Extra networking commands.. client # [ 8.155782] systemd[1]: Reached target Network. lb # [ 8.137643] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.139111] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.158271] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.160397] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.140706] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.141566] systemd-logind[553]: New seat seat0. lb # [ 8.142305] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.144319] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.165403] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 8.145833] systemd[1]: Started User Login Management. lb # [ 8.148414] systemd[1]: Starting linger-users.service... lb # [ 8.153707] systemd[1]: Starting Virtual Console Setup... client # [ 8.172776] systemd[1]: Finished Permit User Sessions. client # [ 8.175770] systemd[1]: Started Getty on tty1. client # [ 8.176728] systemd[1]: Reached target Login Prompts. worker2 # [ 8.316549] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.201202] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.202217] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.202911] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 8.205585] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.209099] systemd-logind[541]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.206338] systemd[1]: Finished resolvconf update. lb # [ 8.212205] systemd[1]: Reached target Preparation for Network. worker2 # [ 8.231189] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.231989] systemd[1]: Reached target Network. lb # [ 8.221472] systemd[1]: Starting DHCP Client... worker2 # [ 8.236089] systemd[1]: Starting Permit User Sessions... lb # [ 8.225113] systemd-logind[553]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.228097] systemd[1]: Starting Address configuration of eth1... lb # [ 8.363336] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.243287] dhcpcd[629]: dhcpcd-10.3.2 starting lb # [ 8.233189] systemd[1]: Starting Extra networking commands.... worker2 # [ 8.252592] dhcpcd[689]: dev: loaded udev lb # [ 8.255503] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.403834] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 8.405070] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.405478] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 8.266461] systemd[1]: Finished linger-users.service. worker1 # [ 8.241775] ACPI: button: Power Button [PWRF] worker2 # [ 8.288553] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.353456] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.298118] systemd[1]: Started Getty on tty1. worker2 # [ 8.299752] systemd[1]: Reached target Login Prompts. lb # [ 8.423953] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.364786] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 8.381154] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.381540] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:58:08 UTC (1790096288) worker1 # [ 8.381621] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.382423] systemd-journald[282]: Time jumped backwards, rotating. worker1 # [ 8.389244] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.389327] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 8.363442] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.358684] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.362989] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.403847] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 8.430248] Console: switching to colour dummy device 80x25 worker1 # [ 8.438790] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.378914] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.532709] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.536226] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.536338] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 8.552781] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 8.552783] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.443164] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.444546] systemd[1]: Reached target System Initialization. worker1 # [ 8.445837] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 8.448677] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 8.451249] systemd[1]: Reached target Timer Units. worker1 # [ 8.586161] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.586838] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.453440] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.454664] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 8.584809] kvm_amd: TSC scaling supported worker2 # [ 8.585214] kvm_amd: Nested Virtualization enabled worker2 # [ 8.585693] kvm_amd: Nested Paging enabled worker2 # [ 8.586339] kvm_amd: LBR virtualization supported worker1 # [ 8.460188] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 8.587587] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.461070] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 8.588297] kvm_amd: Virtual GIF supported worker1 # [ 8.462197] systemd[1]: Reached target Socket Units. worker2 # [ 8.588722] kvm_amd: Virtual NMI enabled worker1 # [ 8.462867] systemd[1]: Reached target Basic System. worker1 # [ 8.467304] systemd[1]: Started backdoor.service. worker1 # [ 8.468071] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.468989] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.474063] systemd[1]: Starting Post-Boot Actions... worker2 # [ 8.600559] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 8.454232] network-addresses-eth1-start[645]: adding address 192.168.1.2/24... done worker2 # [ 8.601230] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.603644] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.604466] cfg80211: failed to load regulatory.db worker1 # [ 8.478760] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.484061] systemd[1]: Starting resolvconf update... worker1 # [ 8.491241] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 8.635599] EDAC MC: Ver: 3.0.0 lb # [ 8.493503] network-addresses-eth1-start[645]: adding address 2001:db8:1::2/64... done worker2 # [ 8.650062] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.517577] dhcpcd[689]: eth0: waiting for carrier worker2 # [ 8.518861] dhcpcd[689]: libudev: received NULL device worker2 # [ 8.519788] dhcpcd[689]: libudev: received NULL device worker2 # [ 8.520944] dhcpcd[689]: eth0: carrier acquired worker2 # [ 8.527576] dhcpcd[689]: DUID 00:01:00:01:32:45:70:20:52:54:00:12:34:56 worker2 # [ 8.528695] dhcpcd[689]: eth0: IAID 00:12:34:56 worker2 # [ 8.529498] dhcpcd[689]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.562243] systemd[1]: Finished Post-Boot Actions. worker2 # [ 8.561162] systemd-vconsole-setup[683]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.550482] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.564123] systemd[1]: Finished Virtual Console Setup. worker1 # [ 8.584578] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.589090] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.592166] nsncd[512]: Sep 22 16:58:08.838 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # connecting to host... worker1 # [ 8.597526] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.598988] systemd[1]: Starting User Login Management... worker1 # [ 8.623818] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.604764] dhcpcd[661]: dhcpcd-10.3.2 starting lb # [ 8.749525] kvm_amd: TSC scaling supported lb # [ 8.749942] kvm_amd: Nested Virtualization enabled lb # [ 8.750929] kvm_amd: Nested Paging enabled lb # [ 8.751913] kvm_amd: LBR virtualization supported lb # [ 8.753294] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 8.754692] kvm_amd: Virtual GIF supported lb # [ 8.755084] kvm_amd: Virtual NMI enabled worker1 # [ 8.643549] dbus-broker-launch[516]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.625299] dhcpcd[719]: dev: loaded udev worker1 # [ 8.784453] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 8.785576] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 8.653242] dbus-broker-launch[516]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.655124] dbus-broker-launch[516]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.640199] systemd[1]: Finished Extra networking commands.. lb # [ 8.643736] systemd[1]: Reached target Network. worker1 # [ 8.665662] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.655559] systemd[1]: Starting PostgreSQL Server... lb # [ 8.658952] systemd[1]: Starting Permit User Sessions... lb # [ 8.803075] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.805769] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.696784] dbus-broker-launch[516]: Ready lb # [ 8.838188] EDAC MC: Ver: 3.0.0 worker1 # [ 8.730994] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.757850] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 8.758963] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.760325] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 8.761171] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.740898] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.761970] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.766424] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.768450] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.760826] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.782421] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.770854] systemd[1]: Started Getty on tty1. lb # [ 8.771552] systemd[1]: Reached target Login Prompts. client: (finished: waiting for unit network-addresses-eth1.service, in 9.47 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 9.004241] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.973061] Console: switching to colour frame buffer device 160x50 lb # [ 9.044668] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 9.048122] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.051405] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.052303] cfg80211: failed to load regulatory.db worker1 # [ 9.074639] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.828532] systemd[1]: Started Name Service Cache Daemon (nsncd). lb: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker1 # [ 8.953049] nsncd[586]: Sep 22 16:58:09.080 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.961859] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.968607] network-addresses-eth1-start[613]: adding address 192.168.1.3/24... done worker1 # [ 8.971112] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.972326] systemd[1]: Finished resolvconf update. worker1 # [ 8.981428] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.982689] systemd[1]: Starting DHCP Client... worker1 # [ 8.984218] systemd[1]: Starting Address configuration of eth1... worker1 # [ 8.987077] systemd[1]: Starting Extra networking commands.... worker1 # [ 8.990148] systemd-logind[535]: New seat seat0. worker1 # [ 8.990877] network-addresses-eth1-start[613]: adding address 2001:db8:1::3/64... done worker1 # [ 8.994024] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.996596] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.133166] ppdev: user-space parallel port driver worker1 # [ 9.001098] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.001891] systemd-logind[535]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 9.005443] systemd-logind[535]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 9.008383] systemd[1]: Started User Login Management. worker1 # [ 9.009761] systemd[1]: Starting linger-users.service... lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.027533] systemd[1]: Finished Address configuration of eth1. lb # [ 9.155564] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 9.023726] dhcpcd[719]: eth0: waiting for carrier lb # [ 9.024871] dhcpcd[719]: eth0: carrier acquired lb # [ 9.032358] postgresql-pre-start[738]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.034539] postgresql-pre-start[738]: This user must also own the server process. worker1 # [ 9.060647] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.040480] dhcpcd[719]: DUID 00:01:00:01:32:45:70:21:52:54:00:12:34:56 lb # [ 9.041576] dhcpcd[719]: eth0: IAID 00:12:34:56 worker1 # [ 9.062163] systemd[1]: Finished linger-users.service. lb # [ 9.042338] dhcpcd[719]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.044174] postgresql-pre-start[738]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.045372] postgresql-pre-start[738]: The default database encoding has accordingly been set to "UTF8". lb # [ 9.046509] postgresql-pre-start[738]: The default text search configuration will be set to "english". lb # [ 9.047866] postgresql-pre-start[738]: Data page checksums are enabled. lb # [ 9.049046] postgresql-pre-start[738]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.050618] postgresql-pre-start[738]: creating subdirectories ... ok lb # [ 9.051741] postgresql-pre-start[738]: selecting dynamic shared memory implementation ... posix worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } lb # [ 9.151657] postgresql-pre-start[738]: selecting default "max_connections" ... 100 worker1 # [ 9.174177] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.174989] systemd[1]: Reached target Network. worker1 # [ 9.179068] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.182412] dhcpcd[621]: dhcpcd-10.3.2 starting worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.07 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.192459] dhcpcd[695]: dev: loaded udev lb # [ 9.173474] systemd-vconsole-setup[659]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.178288] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.340733] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.342053] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.189319] dhcpcd[719]: eth0: soliciting a DHCP lease worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.03 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 9.346765] NET: Registered PF_PACKET protocol family worker1 # [ 9.235732] systemd-logind[535]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 9.220521] dhcpcd[719]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb # [ 9.222172] dhcpcd[719]: eth0: probing address 10.0.2.15/24 lb: waiting for unit niks3.service worker1 # [ 9.244287] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.251994] systemd[1]: Started Getty on tty1. worker1 # [ 9.252707] systemd[1]: Reached target Login Prompts. lb # [ 9.246146] postgresql-pre-start[738]: selecting default "shared_buffers" ... 128MB worker1 # [ 9.402160] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.318458] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.319631] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.466153] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 9.341880] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.484869] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.369752] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.523456] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.524895] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.527695] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 9.528555] cfg80211: failed to load regulatory.db worker2 # [ 9.407381] dhcpcd[689]: eth0: soliciting a DHCP lease worker2 # [ 9.549276] NET: Registered PF_PACKET protocol family worker2 # [ 9.420086] dhcpcd[689]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.422220] dhcpcd[689]: eth0: probing address 10.0.2.15/24 client # [ 9.457133] dhcpcd[563]: eth0: soliciting an IPv6 router client # [ 9.460126] dhcpcd[563]: eth0: Router Advertisement from fe80::2 client # [ 9.462241] dhcpcd[563]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 9.464396] dhcpcd[563]: eth0: adding route to fec0::/64 client # [ 9.466193] dhcpcd[563]: eth0: adding default route via fe80::2 worker1 # [ 9.607704] kvm_amd: TSC scaling supported worker1 # [ 9.608317] kvm_amd: Nested Virtualization enabled worker1 # [ 9.608770] kvm_amd: Nested Paging enabled worker1 # [ 9.610472] kvm_amd: LBR virtualization supported worker1 # [ 9.610918] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.611832] kvm_amd: Virtual GIF supported worker1 # [ 9.613794] kvm_amd: Virtual NMI enabled worker1 # [ 9.627518] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 9.496319] dhcpcd[695]: eth0: waiting for carrier worker1 # [ 9.497620] dhcpcd[695]: libudev: received NULL device worker1 # [ 9.498579] dhcpcd[695]: libudev: received NULL device worker1 # [ 9.500082] dhcpcd[695]: eth0: carrier acquired worker1 # [ 9.509095] dhcpcd[695]: DUID 00:01:00:01:32:45:70:21:52:54:00:12:34:56 worker1 # [ 9.511384] dhcpcd[695]: eth0: IAID 00:12:34:56 worker1 # [ 9.512043] dhcpcd[695]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.669828] EDAC MC: Ver: 3.0.0 client # [ 9.554602] dhcpcd[563]: eth0: soliciting a DHCP lease worker1 # [ 9.571613] systemd-vconsole-setup[702]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.574385] systemd[1]: Finished Virtual Console Setup. client # [ 9.705054] NET: Registered PF_PACKET protocol family client # [ 9.578211] dhcpcd[563]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 9.581355] dhcpcd[563]: eth0: probing address 10.0.2.15/24 lb # [ 9.806513] postgresql-pre-start[738]: selecting default time zone ... UTC lb # [ 9.809231] postgresql-pre-start[738]: creating configuration files ... ok lb # [ 9.977127] postgresql-pre-start[738]: running bootstrap script ... ok worker1 # [ 10.105506] dhcpcd[695]: eth0: soliciting a DHCP lease worker1 # [ 10.257368] NET: Registered PF_PACKET protocol family worker1 # [ 10.130813] dhcpcd[695]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.133506] dhcpcd[695]: eth0: probing address 10.0.2.15/24 lb # [ 10.396456] postgresql-pre-start[738]: performing post-bootstrap initialization ... ok lb # [ 10.489118] dhcpcd[719]: eth0: soliciting an IPv6 router lb # [ 10.490397] dhcpcd[719]: eth0: Router Advertisement from fe80::2 lb # [ 10.491596] dhcpcd[719]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 10.492723] dhcpcd[719]: eth0: adding route to fec0::/64 lb # [ 10.493653] dhcpcd[719]: eth0: adding default route via fe80::2 lb # [ 10.538344] postgresql-pre-start[738]: syncing data to disk ... ok lb # [ 10.539231] postgresql-pre-start[738]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.540369] postgresql-pre-start[738]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.542190] postgresql-pre-start[738]: Success. You can now start the database server using: lb # [ 10.543189] postgresql-pre-start[738]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 10.615817] postgres[789]: [789] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.618489] postgres[789]: [789] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.619555] postgres[789]: [789] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.621749] postgres[789]: [789] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 10.633271] postgres[798]: [798] LOG: database system was shut down at 2026-09-22 16:58:10 GMT lb # [ 10.638838] postgres[789]: [789] LOG: database system is ready to accept connections lb # [ 10.643374] systemd[1]: Started PostgreSQL Server. lb # [ 10.649728] systemd[1]: Starting PostgreSQL Setup Scripts... worker2 # [ 10.695728] dhcpcd[689]: eth0: soliciting an IPv6 router worker2 # [ 10.698504] dhcpcd[689]: eth0: Router Advertisement from fe80::2 worker2 # [ 10.700645] dhcpcd[689]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 10.702807] dhcpcd[689]: eth0: adding route to fec0::/64 worker2 # [ 10.704560] dhcpcd[689]: eth0: adding default route via fe80::2 lb # [ 10.772361] postgresql-setup-start[809]: CREATE DATABASE lb # [ 10.800948] postgresql-setup-start[814]: CREATE ROLE lb # [ 10.812979] postgresql-setup-start[816]: ALTER DATABASE lb # [ 10.817341] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.819303] systemd[1]: Reached target PostgreSQL. worker1 # [ 11.384954] dhcpcd[695]: eth0: soliciting an IPv6 router worker1 # [ 11.388091] dhcpcd[695]: eth0: Router Advertisement from fe80::2 worker1 # [ 11.390215] dhcpcd[695]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 11.392528] dhcpcd[695]: eth0: adding route to fec0::/64 worker1 # [ 11.394404] dhcpcd[695]: eth0: adding default route via fe80::2 client # [ 14.290623] dhcpcd[563]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 14.292946] dhcpcd[563]: eth0: adding route to 10.0.2.0/24 client # [ 14.295788] dhcpcd[563]: eth0: adding default route via 10.0.2.2 worker2 # [ 14.291761] dhcpcd[689]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 14.295504] dhcpcd[689]: eth0: adding route to 10.0.2.0/24 worker2 # [ 14.297605] dhcpcd[689]: eth0: adding default route via 10.0.2.2 client # [ 14.385741] systemd[1]: Started DHCP Client. worker2 # [ 14.382584] systemd[1]: Started DHCP Client. client # [ 14.388574] systemd[1]: Reached target Multi-User System. worker2 # [ 14.384390] systemd[1]: Reached target Multi-User System. client # [ 14.389562] systemd[1]: Startup finished in 848ms (kernel) + 3.585s (initrd) + 9.955s (userspace) = 14.389s. worker2 # [ 14.385566] systemd[1]: Startup finished in 859ms (kernel) + 3.637s (initrd) + 9.888s (userspace) = 14.385s. lb # [ 14.390806] dhcpcd[719]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 14.392361] dhcpcd[719]: eth0: adding route to 10.0.2.0/24 lb # [ 14.393427] dhcpcd[719]: eth0: adding default route via 10.0.2.2 lb # [ 14.460688] systemd[1]: Started DHCP Client. lb # [ 14.462775] systemd[1]: Reached target Network is Online. lb # [ 14.466225] systemd[1]: Started Envoy reverse proxy. lb # [ 14.469059] systemd[1]: Started mock-oidc.service. lb # [ 14.546862] mock-oidc-server[908]: Mock OIDC Server running lb # [ 14.548564] mock-oidc-server[908]: OIDC Address: 192.168.1.2:8080 lb # [ 14.550099] mock-oidc-server[908]: Issue Address: 0.0.0.0:8081 lb # [ 14.551186] mock-oidc-server[908]: Issuer: http://192.168.1.2:8080/oidc lb # [ 14.552768] mock-oidc-server[908]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 14.553959] mock-oidc-server[908]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 14.555256] mock-oidc-server[908]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 14.768761] envoy[907]: [2026-09-22 16:58:15.106][907][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 14.772880] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 14.774303] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 14.775862] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 14.779584] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 14.781964] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 14.783591] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 14.785201] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 14.787237] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 14.790426] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 14.793180] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 14.794990] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 14.796679] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 14.798674] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 14.801317] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 14.803492] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 14.807177] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 14.809089] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 14.811158] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 14.813060] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 14.815097] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 14.818087] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 14.819769] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 14.822044] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 14.836375] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 14.838763] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 14.842073] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 14.845089] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 14.847448] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 14.850037] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 14.851749] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 14.853864] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 14.856746] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 14.858491] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 14.861141] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 14.870112] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 14.874438] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 14.876524] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 14.878255] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 14.882457] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 14.889170] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 14.894202] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 14.896416] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 14.897945] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 14.899460] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 14.901157] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 14.928340] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 14.930635] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 14.932972] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 14.935315] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 14.937086] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 14.943377] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 14.945196] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 14.949282] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 14.951334] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 14.953122] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 14.955747] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 14.958504] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 14.960200] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 14.961730] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 14.963636] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 14.965350] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 14.968085] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 14.972567] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 14.975474] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 14.980972] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 14.983252] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 14.985825] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 14.988133] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 14.992115] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 14.993812] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 14.997841] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 14.999402] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 15.001755] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 15.003831] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 15.006936] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 15.009142] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 15.011965] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 15.013856] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 15.017630] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 15.019303] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 15.021676] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.023482] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 15.025725] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 15.027736] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 15.030220] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 15.032127] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 15.033986] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 15.038636] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 15.041089] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 15.043029] envoy[907]: [2026-09-22 16:58:15.110][907][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 15.049082] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 15.051718] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 15.053500] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 15.059676] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 15.061633] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 15.063740] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 15.065501] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 15.067047] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 15.078588] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 15.080544] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 15.084092] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 15.085802] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 15.088613] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 15.090824] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 15.092312] envoy[907]: [2026-09-22 16:58:15.111][907][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 15.093701] envoy[907]: [2026-09-22 16:58:15.170][907][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 15.095080] envoy[907]: [2026-09-22 16:58:15.171][907][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 15.109238] envoy[907]: [2026-09-22 16:58:15.171][907][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 15.110647] envoy[907]: [2026-09-22 16:58:15.171][907][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 15.118079] envoy[907]: [2026-09-22 16:58:15.171][907][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 15.121794] envoy[907]: [2026-09-22 16:58:15.460][907][info][main] [source/server/server.cc:968] runtime: {} lb # [ 15.124639] envoy[907]: [2026-09-22 16:58:15.462][907][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 15.126432] envoy[907]: [2026-09-22 16:58:15.464][907][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 15.128147] envoy[907]: [2026-09-22 16:58:15.466][907][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 15.130280] envoy[907]: [2026-09-22 16:58:15.468][907][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 15.132151] envoy[907]: [2026-09-22 16:58:15.470][907][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 15.133569] envoy[907]: [2026-09-22 16:58:15.470][907][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 15.152437] envoy[907]: [2026-09-22 16:58:15.490][907][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 15.167161] systemd[1]: Reached target Network is Online. lb # [ 15.157182] envoy[907]: [2026-09-22 16:58:15.495][907][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 15.159272] envoy[907]: [2026-09-22 16:58:15.497][907][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker2 # [ 15.173646] systemd[1]: Starting scheduler-token.service... lb # [ 15.162209] envoy[907]: [2026-09-22 16:58:15.500][907][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 15.181476] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 15.238455] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 15.241530] systemd[1]: Finished scheduler-token.service. worker2 # [ 15.244776] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 67ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 15.249492] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 15.297821] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 15.307163] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 15.309361] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 15.322819] nix-grpc-daemon[724]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 15.324370] nix-grpc-daemon[724]: E0000 00:00:1790096295.575081 724 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.330031] nix-grpc-daemon[724]: E0000 00:00:1790096295.582607 724 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.333054] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 15.336125] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 15.342296] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 15.351067] nix-grpc-daemon[724]: E0000 00:00:1790096295.603621 765 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.357278] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 15.352203] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 15.361280] dhcpcd[695]: eth0: adding route to 10.0.2.0/24 worker1 # [ 15.361969] dhcpcd[695]: eth0: adding default route via 10.0.2.2 worker2 # [ 15.354375] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 15.347404] envoy[907]: [2026-09-22 16:58:15.685][907][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 15.351337] envoy[907]: [2026-09-22 16:58:15.685][907][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 15.375065] nix-grpc-daemon[724]: E0000 00:00:1790096295.626766 765 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.368247] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR lb # [ 15.355301] envoy[907]: [2026-09-22 16:58:15.685][907][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 15.377126] nix-grpc-daemon[724]: E0000 00:00:1790096295.626934 765 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.369779] nix-grpc-daemon[783]: E0000 00:00:1790096295.661052 783 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 15.361441] envoy[907]: [2026-09-22 16:58:15.699][907][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 15.375687] nix-grpc-daemon[783]: E0000 00:00:1790096295.668699 783 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.378717] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 15.380289] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 15.391645] nix-grpc-daemon[724]: E0000 00:00:1790096295.643792 765 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.403825] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.395089] nix-grpc-daemon[783]: E0000 00:00:1790096295.687995 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.408062] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.413673] nix-grpc-daemon[783]: E0000 00:00:1790096295.706807 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.418100] nix-grpc-daemon[783]: E0000 00:00:1790096295.709046 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.428985] nix-grpc-daemon[783]: E0000 00:00:1790096295.722123 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.440177] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.441844] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.458823] systemd[1]: Started DHCP Client. worker1 # [ 15.460623] systemd[1]: Reached target Multi-User System. worker1 # [ 15.461727] systemd[1]: Startup finished in 856ms (kernel) + 4.543s (initrd) + 10.061s (userspace) = 15.461s. worker1 # [ 15.608945] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.613129] nix-grpc-daemon[724]: ts=2026-09-22T16:58:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.643528] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.647604] nix-grpc-daemon[783]: ts=2026-09-22T16:58:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.813257] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.814997] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.848944] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.852996] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.015586] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.017678] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.053964] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.057848] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.218375] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.220059] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.259060] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.262872] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.420775] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.422342] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.464997] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.468163] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.623283] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.627174] nix-grpc-daemon[724]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.666457] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.670376] nix-grpc-daemon[783]: ts=2026-09-22T16:58:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.827951] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.832673] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.871413] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.875273] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.033515] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.037415] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.076368] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.080190] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.237902] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.239941] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.281162] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.284998] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.440836] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.442519] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.485877] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.487479] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.643026] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.644718] nix-grpc-daemon[724]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.688693] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.692547] nix-grpc-daemon[783]: ts=2026-09-22T16:58:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.845278] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.847071] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.894091] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.897852] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.047573] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.049258] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.098666] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.102576] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.249937] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.251946] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.303754] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.307857] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.452721] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.454429] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.509598] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.513272] nix-grpc-daemon[783]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.655064] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.656798] nix-grpc-daemon[724]: ts=2026-09-22T16:58:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.714486] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.716423] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.857379] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.859098] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.917516] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.921303] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.059771] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.061467] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.122477] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.126293] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.262029] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.263743] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.327384] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 lb # [ 19.320769] rustfs-bucket-start[971]: mb s3://farm worker2 # [ 19.331384] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 19.331148] systemd[1]: Finished rustfs-bucket.service. lb # [ 19.338110] systemd[1]: Starting niks3 server... worker1 # [ 19.466530] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.469855] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 19.458408] postgres[987]: [987] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 19.460149] postgres[987]: [987] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 19.481473] niks3-server[980]: 2026/09/22 16:58:19 OK 20241026095416_initial_model.sql (12.49ms) lb # [ 19.484965] niks3-server[980]: 2026/09/22 16:58:19 OK 20251210153512_drop_unused_gin_index.sql (3.71ms) lb # [ 19.491432] niks3-server[980]: 2026/09/22 16:58:19 OK 20251218171726_add_pins.sql (6.41ms) lb # [ 19.495617] niks3-server[980]: 2026/09/22 16:58:19 OK 20260628120000_add_object_size_and_stats.sql (4.17ms) lb # [ 19.500296] niks3-server[980]: 2026/09/22 16:58:19 OK 20260905000000_add_claims.sql (4.63ms) lb # [ 19.504448] niks3-server[980]: 2026/09/22 16:58:19 OK 20260920000000_drop_claims.sql (4.05ms) lb # [ 19.505693] niks3-server[980]: 2026/09/22 16:58:19 goose: successfully migrated database to version: 20260920000000 lb # [ 19.509750] niks3-server[980]: 2026/09/22 16:58:19 OK 1_commit_pending_closure.sql (5.28ms) lb # [ 19.512359] niks3-server[980]: 2026/09/22 16:58:19 OK 2_object_stats_trigger.sql (2.65ms) lb # [ 19.513658] niks3-server[980]: 2026/09/22 16:58:19 goose: up to current file version: 2 lb # [ 19.517052] niks3-server[980]: 2026/09/22 16:58:19 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key worker2 # [ 19.533988] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.537361] nix-grpc-daemon[783]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 19.550913] niks3-server[980]: 2026/09/22 16:58:19 INFO Read proxy enabled — serving cache objects from S3 lb # [ 19.552593] niks3-server[980]: 2026/09/22 16:58:19 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 19.555594] niks3-server[980]: 2026/09/22 16:58:19 INFO systemd watchdog enabled interval=15s lb # [ 19.556770] systemd[1]: Started niks3 server. lb # [ 19.557446] systemd[1]: Reached target Multi-User System. lb # [ 19.558930] niks3-server[980]: 2026/09/22 16:58:19 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 19.560872] systemd[1]: Startup finished in 877ms (kernel) + 3.674s (initrd) + 15.008s (userspace) = 19.560s. worker1 # [ 19.667543] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.671417] nix-grpc-daemon[724]: ts=2026-09-22T16:58:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.734811] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.738719] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.872448] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.876521] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.939433] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.941412] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 10.79 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! worker1 # [ 20.077348] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds) lb: waiting for unit envoy.service worker1 # [ 20.081217] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 20.103661] envoy[907]: conn peer=[::1]:43080 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker2 # [ 20.142143] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.143825] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.204502] systemd[1]: Starting scheduler-token.service... worker2 # [ 20.240446] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 20.241993] systemd[1]: Finished scheduler-token.service. worker2 # [ 20.243546] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 37ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 20.282189] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.286101] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 20.344865] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.348279] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.487657] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.491358] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.550838] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.553859] nix-grpc-daemon[783]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.692386] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.696306] nix-grpc-daemon[724]: ts=2026-09-22T16:58:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.751956] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.755717] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.897061] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.900840] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.956992] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.961082] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.101356] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.103114] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.161880] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.165753] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.303663] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.305477] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 21.366831] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.370617] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 21.506431] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.508227] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.572590] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.576180] nix-grpc-daemon[783]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.709323] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.713153] nix-grpc-daemon[724]: ts=2026-09-22T16:58:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.777338] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.781211] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.914068] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.917960] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.982196] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.985981] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.118718] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.122593] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.186653] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.188397] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.323530] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.327505] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 22.389382] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.393155] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 22.529792] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.532899] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.595455] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.599326] nix-grpc-daemon[783]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.730882] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.734838] nix-grpc-daemon[724]: ts=2026-09-22T16:58:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.800370] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.804732] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.935727] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.939634] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.005876] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.010211] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.140539] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.144448] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.211154] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.214900] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.345144] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.348963] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.415844] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.419552] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 23.550698] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.554469] nix-grpc-daemon[724]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.621478] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.623366] nix-grpc-daemon[783]: ts=2026-09-22T16:58:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.754835] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.756575] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.824161] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.825866] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.957266] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.958980] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.026577] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.028380] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.159483] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.161257] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.229698] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.233713] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.362164] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.365975] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.435806] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.439241] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 24.567540] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.571279] nix-grpc-daemon[724]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.641175] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.644802] nix-grpc-daemon[783]: ts=2026-09-22T16:58:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.772375] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.776315] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.845935] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.849839] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.976978] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.980923] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.051074] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.054868] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.181864] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.185847] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.255927] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.259773] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.386650] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.394116] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.460778] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.464528] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 25.594726] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.597792] nix-grpc-daemon[724]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.666342] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.670115] nix-grpc-daemon[783]: ts=2026-09-22T16:58:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.795585] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.799379] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.871527] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.875367] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.000312] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.004214] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.076438] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.080273] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.204864] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.208850] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.281368] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.285271] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.409657] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.413327] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.486068] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.489906] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 26.619223] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.622308] nix-grpc-daemon[724]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.692387] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.695982] nix-grpc-daemon[783]: ts=2026-09-22T16:58:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.819943] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.823801] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.893385] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.897770] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.024593] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.028442] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.098917] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.103340] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.229374] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.233162] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.304276] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.308659] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.433732] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.437867] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.509663] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.514096] nix-grpc-daemon[783]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 27.638710] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.640388] nix-grpc-daemon[724]: ts=2026-09-22T16:58:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.716302] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.719962] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.841043] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.842774] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.917526] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.921854] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.043735] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.047631] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.122795] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.126622] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.248469] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.252363] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.327782] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.331646] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.453213] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.456955] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.532675] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.536472] nix-grpc-daemon[783]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 28.658625] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.662142] nix-grpc-daemon[724]: ts=2026-09-22T16:58:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.738843] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.741903] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.862963] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.866871] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.939894] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.943642] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.067863] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.071810] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.144784] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.148663] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.272674] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.276752] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.349677] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.354118] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.477399] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.481159] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.554938] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.559523] nix-grpc-daemon[783]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.567413] niks3-server[980]: 2026/09/22 16:58:29 INFO lead: acquired remote=192.168.1.3:40164 worker1 # [ 29.587958] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_take_over lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 29.682735] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.686365] nix-grpc-daemon[724]: ts=2026-09-22T16:58:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.761687] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.765412] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.887381] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.891188] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.966469] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.970726] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.091962] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.095889] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.171791] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.176153] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.296695] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.300532] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.377220] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.380977] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.501115] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.512836] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48666 worker1 # [ 30.517217] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 30.582148] nix-grpc-daemon[783]: ts=2026-09-22T16:58:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.600172] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 30.603494] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48666 worker1 # [ 30.607423] nix-grpc-daemon[724]: ts=2026-09-22T16:58:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.81 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 31.279268] nix-grpc-daemon[724]: ts=2026-09-22T16:58:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 31.289505] systemd[1]: Started Nix Daemon. worker1 # [ 31.402904] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 31.415126] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 1/5) worker1 # [ 31.451124] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 2/5) worker1 # [ 31.457744] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 218 ms (attempt 3/5) worker1 # [ 31.680548] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 374 ms (attempt 4/5) worker1 # [ 32.062861] nix-grpc-daemon[724]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 32.071497] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 32.090426] nix-grpc-daemon[724]: ts=2026-09-22T16:58:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 32.103169] nix-grpc-daemon[724]: ts=2026-09-22T16:58:32Z level=debug event=path_info_miss path=zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test error="error: path '/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 32.113672] nix-grpc-daemon[783]: ts=2026-09-22T16:58:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 32.122723] systemd[1]: Started Nix Daemon. worker2 # [ 32.225343] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 32.241701] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5) worker2 # [ 32.329529] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 2/5) worker2 # [ 32.340885] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 3/5) worker2 # [ 32.384864] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 470 ms (attempt 4/5) worker2 # [ 32.858113] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 32.861388] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 32.873777] nix-grpc-daemon[783]: ts=2026-09-22T16:58:33Z level=debug event=path_info_miss path=zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test error="error: path '/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 33.094757] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48678 worker1 # [ 33.101471] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48678 worker1 # [ 33.105565] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=path_info_miss path=zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test error="error: path '/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 33.107792] nix-grpc-daemon[783]: ts=2026-09-22T16:58:33Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 33.111870] nix-grpc-daemon[783]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46786 worker2 # [ 33.120666] nix-grpc-daemon[783]: ts=2026-09-22T16:58:33Z level=debug event=path_info_miss path=zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test error="error: path '/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker2 # [ 33.260760] nix-grpc-daemon[783]: ts=2026-09-22T16:58:33Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 33.387854] nix-grpc-daemon[783]: ts=2026-09-22T16:58:33Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.29 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 33.529131] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48678 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 33.538487] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 33.566262] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker1 # [ 33.568325] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 33.615928] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 33.628822] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 33.640767] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 33.653359] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 33.680484] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=info event=niks3_push_started pid=876 worker1 # [ 33.823300] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.075Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 33.912688] nix-daemon[861]: accepted connection from pid 889, user nix-grpc-daemon (trusted) worker1 # [ 33.926223] nix-daemon[861]: reaped child process 892, status = succeeded lb # [ 33.914861] niks3-server[980]: 2026/09/22 16:58:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 33.949643] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.202Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 33.951441] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.204Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 33.962190] niks3-server[980]: 2026/09/22 16:58:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 33.977995] niks3-server[980]: 2026/09/22 16:58:34 INFO Signed narinfos id=1 count=1 worker1 # [ 34.003221] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.255Z level=INFO msg="Uploading 1 narinfos" lb # [ 33.996484] niks3-server[980]: 2026/09/22 16:58:34 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 34.000899] niks3-server[980]: 2026/09/22 16:58:34 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 34.012211] niks3-server[980]: 2026/09/22 16:58:34 INFO Completed upload id=1 worker1 # [ 34.033059] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.285Z level=INFO msg="Upload complete. (204ms)" lb # [ 34.018827] niks3-server[980]: 2026/09/22 16:58:34 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst worker1 # [ 34.038942] nix-grpc-daemon[724]: ts=2026-09-22T16:58:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 34.046122] nix-grpc-daemon[724]: ts=2026-09-22T16:58:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 34.058975] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 34.070228] nix-daemon[861]: reaped child process 874, status = succeeded worker1 # [ 34.074060] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 35.156617] envoy[907]: conn peer=[2001:db8:1::1]:51788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=1633 client # farm-a> LOG-farm-a-t1 lb # [ 35.161338] envoy[907]: conn peer=[2001:db8:1::1]:59404 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=39 lb # [ 35.164731] envoy[907]: conn peer=[2001:db8:1::1]:59418 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=9 lb # [ 35.168587] envoy[907]: conn peer=[2001:db8:1::1]:59426 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 worker1 # [ 35.307965] nix-daemon[861]: reaped child process 896, status = succeeded worker1 # [ 35.386731] nix-daemon[861]: accepted connection from pid 913, user nix-grpc-daemon (trusted) worker1 # [ 35.397618] nix-daemon[861]: reaped child process 916, status = succeeded lb # [ 35.384683] niks3-server[980]: 2026/09/22 16:58:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.412269] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.664Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 35.415953] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.666Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 35.408632] niks3-server[980]: 2026/09/22 16:58:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker1 # [ 35.434781] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.687Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.414933] niks3-server[980]: 2026/09/22 16:58:35 INFO Signed narinfos id=2 count=1 lb # [ 35.418268] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 35.420763] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 35.426395] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 35.428460] niks3-server[980]: 2026/09/22 16:58:35 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 35.433978] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 35.437853] niks3-server[980]: 2026/09/22 16:58:35 INFO Completed upload id=2 worker1 # [ 35.458385] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.710Z level=INFO msg="Upload complete. (175ms)" worker1 # [ 35.462553] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 35.469392] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker1 # [ 35.471316] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 35.475211] nix-daemon[861]: reaped child process 894, status = succeeded worker1 # [ 35.512944] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 35.529519] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 35.543292] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.795Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 35.551662] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 35.570430] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 35.666500] nix-daemon[861]: accepted connection from pid 922, user nix-grpc-daemon (trusted) worker1 # [ 35.678990] nix-daemon[861]: reaped child process 925, status = succeeded lb # [ 35.665503] niks3-server[980]: 2026/09/22 16:58:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.695147] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.947Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 35.696646] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.949Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 35.699848] niks3-server[980]: 2026/09/22 16:58:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 35.706864] niks3-server[980]: 2026/09/22 16:58:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 35.712282] niks3-server[980]: 2026/09/22 16:58:36 INFO Signed narinfos id=3 count=1 worker1 # [ 35.736385] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.988Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.728501] niks3-server[980]: 2026/09/22 16:58:36 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 35.735796] niks3-server[980]: 2026/09/22 16:58:36 INFO Completed upload id=3 worker1 # [ 35.759341] nix-grpc-daemon[876]: time=2026-09-22T16:58:36.011Z level=INFO msg="Upload complete. (176ms)" lb # [ 35.739740] niks3-server[980]: 2026/09/22 16:58:36 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 35.744391] niks3-server[980]: 2026/09/22 16:58:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 35.763960] nix-grpc-daemon[724]: ts=2026-09-22T16:58:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 35.771315] nix-grpc-daemon[724]: ts=2026-09-22T16:58:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 35.779135] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 35.790254] nix-daemon[861]: reaped child process 920, status = succeeded worker1 # [ 35.794268] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 37.224447] nix-daemon[861]: reaped child process 929, status = succeeded worker1 # [ 37.310260] nix-daemon[861]: accepted connection from pid 945, user nix-grpc-daemon (trusted) worker1 # [ 37.322317] nix-daemon[861]: reaped child process 948, status = succeeded lb # [ 37.311628] niks3-server[980]: 2026/09/22 16:58:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.342952] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.595Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 37.344691] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.597Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 37.359127] niks3-server[980]: 2026/09/22 16:58:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 37.363155] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 37.368261] niks3-server[980]: 2026/09/22 16:58:37 INFO Signed narinfos id=4 count=1 worker1 # [ 37.391641] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.643Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.375456] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 37.380816] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 37.388412] niks3-server[980]: 2026/09/22 16:58:37 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 37.394076] niks3-server[980]: 2026/09/22 16:58:37 INFO Completed upload id=4 lb # [ 37.395471] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 37.416125] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.668Z level=INFO msg="Upload complete. (214ms)" worker1 # [ 37.424601] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 37.435416] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker1 # [ 37.439198] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 37.448072] nix-daemon[861]: reaped child process 927, status = succeeded worker1 # [ 37.478524] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 37.490604] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 37.506119] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.758Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 37.514835] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 37.524348] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 37.618111] nix-daemon[861]: accepted connection from pid 954, user nix-grpc-daemon (trusted) worker1 # [ 37.630303] nix-daemon[861]: reaped child process 957, status = succeeded lb # [ 37.617332] niks3-server[980]: 2026/09/22 16:58:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.647033] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.899Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 37.648517] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.901Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 37.651659] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 37.659275] niks3-server[980]: 2026/09/22 16:58:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 37.664232] niks3-server[980]: 2026/09/22 16:58:38 INFO Signed narinfos id=5 count=1 worker1 # [ 37.687688] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.940Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.676612] niks3-server[980]: 2026/09/22 16:58:38 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 37.693185] niks3-server[980]: 2026/09/22 16:58:38 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 37.698690] niks3-server[980]: 2026/09/22 16:58:38 INFO Completed upload id=5 worker1 # [ 37.719291] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.971Z level=INFO msg="Upload complete. (183ms)" lb # [ 37.700788] niks3-server[980]: 2026/09/22 16:58:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 37.724146] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 37.731108] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 37.740661] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 37.751266] nix-daemon[861]: reaped child process 952, status = succeeded client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... worker1 # [ 37.758671] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 39.006758] nix-daemon[861]: reaped child process 961, status = succeeded worker1 # [ 39.080430] nix-daemon[861]: accepted connection from pid 978, user nix-grpc-daemon (trusted) worker1 # [ 39.093076] nix-daemon[861]: reaped child process 981, status = succeeded lb # [ 39.078443] niks3-server[980]: 2026/09/22 16:58:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.111559] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.363Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 39.114566] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.365Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 39.121172] niks3-server[980]: 2026/09/22 16:58:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 39.125138] niks3-server[980]: 2026/09/22 16:58:39 INFO Signed narinfos id=6 count=1 worker1 # [ 39.148925] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.401Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.137301] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 39.142857] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 39.151313] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 39.155438] niks3-server[980]: 2026/09/22 16:58:39 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 39.158358] niks3-server[980]: 2026/09/22 16:58:39 INFO Completed upload id=6 worker1 # [ 39.180586] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.433Z level=INFO msg="Upload complete. (213ms)" lb # [ 39.162077] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 39.188492] nix-grpc-daemon[724]: ts=2026-09-22T16:58:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 39.202717] nix-daemon[861]: reaped child process 959, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.81 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.14 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 39.974948] nix-grpc-daemon[783]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 39.986712] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 39.992495] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.245Z level=INFO msg="All 2 paths already cached" worker1 # [ 40.002038] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.15 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.74 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 40.502261] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48678 worker2 # [ 40.497411] nix-grpc-daemon[783]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 40.526474] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker1 # [ 40.533328] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 40.537865] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 40.545716] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 40.558756] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.810Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 40.566386] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 40.577292] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 40.668424] nix-daemon[861]: accepted connection from pid 1010, user nix-grpc-daemon (trusted) worker1 # [ 40.680609] nix-daemon[861]: reaped child process 1013, status = succeeded lb # [ 40.667785] niks3-server[980]: 2026/09/22 16:58:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.696809] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.949Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.698483] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.950Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 40.700728] niks3-server[980]: 2026/09/22 16:58:41 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 40.710378] niks3-server[980]: 2026/09/22 16:58:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 40.715736] niks3-server[980]: 2026/09/22 16:58:41 INFO Signed narinfos id=7 count=1 worker1 # [ 40.739292] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.991Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.724194] niks3-server[980]: 2026/09/22 16:58:41 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 40.734067] niks3-server[980]: 2026/09/22 16:58:41 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 40.741224] niks3-server[980]: 2026/09/22 16:58:41 INFO Completed upload id=7 worker1 # [ 40.761878] nix-grpc-daemon[876]: time=2026-09-22T16:58:41.014Z level=INFO msg="Upload complete. (173ms)" lb # [ 40.744354] niks3-server[980]: 2026/09/22 16:58:41 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 40.766595] nix-grpc-daemon[724]: ts=2026-09-22T16:58:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 40.772168] nix-grpc-daemon[724]: ts=2026-09-22T16:58:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 40.782142] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 40.791911] nix-daemon[861]: reaped child process 1008, status = succeeded client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... worker1 # [ 40.794827] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 41.609413] nix-daemon[861]: reaped child process 1017, status = succeeded worker1 # [ 41.684133] nix-daemon[861]: accepted connection from pid 1034, user nix-grpc-daemon (trusted) worker1 # [ 41.697047] nix-daemon[861]: reaped child process 1037, status = succeeded lb # [ 41.684996] niks3-server[980]: 2026/09/22 16:58:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.715323] nix-grpc-daemon[876]: time=2026-09-22T16:58:41.967Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 41.717437] nix-grpc-daemon[876]: time=2026-09-22T16:58:41.969Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 41.730238] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 41.738060] niks3-server[980]: 2026/09/22 16:58:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 41.768307] nix-grpc-daemon[876]: time=2026-09-22T16:58:42.020Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.747707] niks3-server[980]: 2026/09/22 16:58:42 INFO Signed narinfos id=8 count=1 lb # [ 41.751605] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 41.756127] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 41.766517] niks3-server[980]: 2026/09/22 16:58:42 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 41.769451] niks3-server[980]: 2026/09/22 16:58:42 INFO Completed upload id=8 worker1 # [ 41.791218] nix-grpc-daemon[876]: time=2026-09-22T16:58:42.043Z level=INFO msg="Upload complete. (190ms)" lb # [ 41.774069] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 41.799301] nix-grpc-daemon[724]: ts=2026-09-22T16:58:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 41.812424] nix-daemon[861]: reaped child process 1015, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.47 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 1.72 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 worker2 # [ 42.107187] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46786 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 42.115575] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 42.144260] nix-grpc-daemon[724]: ts=2026-09-22T16:58:42Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker1 # [ 42.148337] nix-grpc-daemon[724]: ts=2026-09-22T16:58:42Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 42.148248] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 42.159732] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker2 # [ 42.170965] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 42.182190] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 42.201798] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=info event=niks3_push_started pid=877 worker2 # [ 42.323501] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.616Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 42.412828] nix-daemon[851]: accepted connection from pid 890, user nix-grpc-daemon (trusted) worker2 # [ 42.426177] nix-daemon[851]: reaped child process 893, status = succeeded lb # [ 42.418868] niks3-server[980]: 2026/09/22 16:58:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.440372] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 42.441838] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.735Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 42.460371] niks3-server[980]: 2026/09/22 16:58:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 42.465558] niks3-server[980]: 2026/09/22 16:58:42 INFO Signed narinfos id=9 count=1 worker2 # [ 42.482716] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.775Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.471793] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 42.484503] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 42.492700] niks3-server[980]: 2026/09/22 16:58:42 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 42.499608] niks3-server[980]: 2026/09/22 16:58:42 INFO Completed upload id=9 worker2 # [ 42.514455] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.807Z level=INFO msg="Upload complete. (186ms)" lb # [ 42.504109] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker2 # [ 42.517759] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 42.525297] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 42.535321] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 42.539132] nix-daemon[851]: reaped child process 875, status = succeeded worker2 # [ 42.542684] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker2 # [ 43.576091] nix-daemon[851]: reaped child process 897, status = succeeded worker2 # [ 43.645419] nix-daemon[851]: accepted connection from pid 913, user nix-grpc-daemon (trusted) worker2 # [ 43.656790] nix-daemon[851]: reaped child process 916, status = succeeded lb # [ 43.652837] niks3-server[980]: 2026/09/22 16:58:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 43.678148] nix-grpc-daemon[877]: time=2026-09-22T16:58:43.971Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 43.679875] nix-grpc-daemon[877]: time=2026-09-22T16:58:43.972Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 43.698633] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 43.704609] niks3-server[980]: 2026/09/22 16:58:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 43.713224] niks3-server[980]: 2026/09/22 16:58:44 INFO Signed narinfos id=10 count=1 worker2 # [ 43.726346] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.019Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.717822] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 43.729149] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 43.736518] niks3-server[980]: 2026/09/22 16:58:44 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 43.741198] niks3-server[980]: 2026/09/22 16:58:44 INFO Completed upload id=10 lb # [ 43.743414] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 43.755396] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.048Z level=INFO msg="Upload complete. (205ms)" worker2 # [ 43.761920] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker1 # [ 43.775458] nix-grpc-daemon[724]: ts=2026-09-22T16:58:44Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker1 # [ 43.779589] nix-grpc-daemon[724]: ts=2026-09-22T16:58:44Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 43.777338] nix-daemon[851]: reaped child process 895, status = succeeded worker2 # [ 43.811636] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 43.824430] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 43.838476] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.131Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker2 # [ 43.847194] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 43.857131] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 43.954796] nix-daemon[851]: accepted connection from pid 920, user nix-grpc-daemon (trusted) worker2 # [ 43.967598] nix-daemon[851]: reaped child process 923, status = succeeded lb # [ 43.963602] niks3-server[980]: 2026/09/22 16:58:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 43.985547] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.278Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 43.987225] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.280Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 43.996587] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 44.006100] niks3-server[980]: 2026/09/22 16:58:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker2 # [ 44.024918] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.318Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.012529] niks3-server[980]: 2026/09/22 16:58:44 INFO Signed narinfos id=11 count=1 lb # [ 44.016812] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 44.032750] niks3-server[980]: 2026/09/22 16:58:44 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 44.041322] niks3-server[980]: 2026/09/22 16:58:44 INFO Completed upload id=11 worker2 # [ 44.054094] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.347Z level=INFO msg="Upload complete. (185ms)" lb # [ 44.044670] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 44.058520] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 44.064351] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 44.077820] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 44.085215] nix-daemon[851]: reaped child process 918, status = succeeded client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker2 # [ 44.089252] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 45.157357] envoy[907]: conn peer=[2001:db8:1::1]:59440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=4416 ms=5677 lb # [ 45.161450] envoy[907]: conn peer=[2001:db8:1::1]:59448 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=32 lb # [ 45.165072] envoy[907]: conn peer=[2001:db8:1::1]:59456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4178 tx=1902 ms=1306 client # farm-b> LOG-farm-b-sig worker2 # [ 45.303453] nix-daemon[851]: reaped child process 927, status = succeeded worker2 # [ 45.380258] nix-daemon[851]: accepted connection from pid 943, user nix-grpc-daemon (trusted) worker2 # [ 45.392756] nix-daemon[851]: reaped child process 946, status = succeeded lb # [ 45.388411] niks3-server[980]: 2026/09/22 16:58:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.410676] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.703Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 45.412228] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.705Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 45.431483] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 45.441573] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 45.451450] niks3-server[980]: 2026/09/22 16:58:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 45.456839] niks3-server[980]: 2026/09/22 16:58:45 INFO Signed narinfos id=12 count=1 worker2 # [ 45.470263] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.763Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.463379] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 45.473059] niks3-server[980]: 2026/09/22 16:58:45 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 45.475749] niks3-server[980]: 2026/09/22 16:58:45 INFO Completed upload id=12 worker2 # [ 45.490073] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.783Z level=INFO msg="Upload complete. (193ms)" lb # [ 45.478714] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 45.497146] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker1 # [ 45.510733] nix-grpc-daemon[724]: ts=2026-09-22T16:58:45Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 45.514896] nix-grpc-daemon[724]: ts=2026-09-22T16:58:45Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.511734] nix-daemon[851]: reaped child process 925, status = succeeded worker2 # [ 45.546727] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 45.560311] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 45.573266] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.866Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker2 # [ 45.583300] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 45.595529] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 45.694708] nix-daemon[851]: accepted connection from pid 950, user nix-grpc-daemon (trusted) worker2 # [ 45.707458] nix-daemon[851]: reaped child process 953, status = succeeded lb # [ 45.702432] niks3-server[980]: 2026/09/22 16:58:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.723225] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.016Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.724642] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.017Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 45.736380] niks3-server[980]: 2026/09/22 16:58:46 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 45.743928] niks3-server[980]: 2026/09/22 16:58:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker2 # [ 45.762228] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.055Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.750805] niks3-server[980]: 2026/09/22 16:58:46 INFO Signed narinfos id=13 count=1 lb # [ 45.759265] niks3-server[980]: 2026/09/22 16:58:46 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 45.772816] niks3-server[980]: 2026/09/22 16:58:46 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 45.778148] niks3-server[980]: 2026/09/22 16:58:46 INFO Completed upload id=13 worker2 # [ 45.790836] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.083Z level=INFO msg="Upload complete. (181ms)" lb # [ 45.783453] niks3-server[980]: 2026/09/22 16:58:46 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 45.794762] nix-grpc-daemon[783]: ts=2026-09-22T16:58:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 45.799926] nix-grpc-daemon[783]: ts=2026-09-22T16:58:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 45.812246] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 45.820148] nix-daemon[851]: reaped child process 948, status = succeeded worker2 # [ 45.824463] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker2 # [ 46.841323] nix-daemon[851]: reaped child process 957, status = succeeded worker2 # [ 46.918272] nix-daemon[851]: accepted connection from pid 973, user nix-grpc-daemon (trusted) worker2 # [ 46.931197] nix-daemon[851]: reaped child process 976, status = succeeded lb # [ 46.926438] niks3-server[980]: 2026/09/22 16:58:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.943792] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.236Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 46.945304] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.238Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 46.958697] niks3-server[980]: 2026/09/22 16:58:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 46.966915] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls worker2 # [ 46.985571] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.278Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.973111] niks3-server[980]: 2026/09/22 16:58:47 INFO Signed narinfos id=14 count=1 lb # [ 46.975176] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 46.985148] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 46.989517] niks3-server[980]: 2026/09/22 16:58:47 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 46.993534] niks3-server[980]: 2026/09/22 16:58:47 INFO Completed upload id=14 worker2 # [ 47.006304] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.299Z level=INFO msg="Upload complete. (175ms)" lb # [ 46.995695] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker2 # [ 47.009251] nix-grpc-daemon[783]: ts=2026-09-22T16:58:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker2 # [ 47.017391] nix-daemon[851]: reaped child process 955, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.05 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 47.265731] nix-grpc-daemon[724]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43710 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 47.309525] nix-grpc-daemon[724]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43710 worker1 # [ 47.316131] nix-grpc-daemon[724]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 47.330630] nix-grpc-daemon[724]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 47.342794] nix-grpc-daemon[724]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.22 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 47.486917] nix-grpc-daemon[783]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:51802 worker2 # [ 47.528290] nix-grpc-daemon[783]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:51802 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.22 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/841" client # removing stale temporary roots file "/nix/var/nix/temproots/862" client # removing stale temporary roots file "/nix/var/nix/temproots/898" client # removing stale temporary roots file "/nix/var/nix/temproots/883" client # removing stale temporary roots file "/nix/var/nix/temproots/854" client # removing stale temporary roots file "/nix/var/nix/temproots/875" client # removing stale temporary roots file "/nix/var/nix/temproots/803" client # removing stale temporary roots file "/nix/var/nix/temproots/820" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker1 # [ 47.834553] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48678 worker2 # [ 47.835074] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 47.844094] nix-grpc-daemon[877]: time=2026-09-22T16:58:48.137Z level=INFO msg="All 1 paths already cached" worker2 # [ 47.850275] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 47.864333] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 client # copying 3 paths... worker1 # [ 47.873706] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 47.887329] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 worker2 # [ 47.884210] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 47.892849] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 47.889900] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 47.896191] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 47.899798] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.38 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 5.97 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 47.999863] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 3f937a7ac9d240c4a4321e35b5536574 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 48.125140] nix[951]: don't know how to build these paths: client # [ 48.126684] nix[951]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 48.119439] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 48.136319] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 48.141631] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 48.184156] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 48.196438] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 client # [ 48.204278] nix[951]: copying 1 paths to 'lb:50051'... worker1 # [ 48.207601] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 client # [ 48.206483] nix[951]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 48.220102] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 48.325098] nix-daemon[861]: accepted connection from pid 1057, user nix-grpc-daemon (trusted) worker1 # [ 48.339392] nix-daemon[861]: reaped child process 1060, status = succeeded lb # [ 48.325243] niks3-server[980]: 2026/09/22 16:58:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.353827] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.355752] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.607Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 48.355370] niks3-server[980]: 2026/09/22 16:58:48 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 48.364098] niks3-server[980]: 2026/09/22 16:58:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 48.369448] niks3-server[980]: 2026/09/22 16:58:48 INFO Signed narinfos id=15 count=1 worker1 # [ 48.393091] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.645Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.375285] niks3-server[980]: 2026/09/22 16:58:48 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 48.390326] niks3-server[980]: 2026/09/22 16:58:48 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 48.397199] niks3-server[980]: 2026/09/22 16:58:48 INFO Completed upload id=15 worker1 # [ 48.417641] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.670Z level=INFO msg="Upload complete. (186ms)" lb # [ 48.399831] niks3-server[980]: 2026/09/22 16:58:48 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 48.422073] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 48.427966] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 48.437195] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 48.447143] nix-daemon[861]: reaped child process 1055, status = succeeded worker1 # [ 48.450434] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) client # [ 48.447685] nix[951]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 49.050733] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 1bcb4381bd244da7981d0b262066bbe3 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.06 seconds) client # [ 49.212413] nix[967]: don't know how to build these paths: client # [ 49.213240] nix[967]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 49.205071] nix-grpc-daemon[783]: ts=2026-09-22T16:58:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 49.220698] nix-grpc-daemon[724]: ts=2026-09-22T16:58:49Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 49.224477] nix-grpc-daemon[724]: ts=2026-09-22T16:58:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 client # [ 49.224463] nix[967]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.03 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 52.480547] nix-daemon[861]: reaped child process 1064, status = succeeded worker1 # [ 52.564794] nix-daemon[861]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) worker1 # [ 52.576521] nix-daemon[861]: reaped child process 1099, status = succeeded lb # [ 52.564841] niks3-server[980]: 2026/09/22 16:58:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.594961] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.847Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.596409] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.849Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 52.610155] niks3-server[980]: 2026/09/22 16:58:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 52.617876] niks3-server[980]: 2026/09/22 16:58:52 INFO Signed narinfos id=16 count=1 worker1 # [ 52.641786] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.894Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.629531] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 52.639783] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 52.647113] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 52.652934] niks3-server[980]: 2026/09/22 16:58:52 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 52.656670] niks3-server[980]: 2026/09/22 16:58:52 INFO Completed upload id=16 worker1 # [ 52.677354] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.929Z level=INFO msg="Upload complete. (218ms)" lb # [ 52.661178] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker1 # [ 52.683801] nix-grpc-daemon[724]: ts=2026-09-22T16:58:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 52.692660] nix-grpc-daemon[724]: ts=2026-09-22T16:58:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 52.706072] nix-daemon[861]: reaped child process 1062, status = succeeded client # [ 52.729969] systemd[1]: dedup2.service: Deactivated successfully. client # [ 52.733617] systemd[1]: dedup2.service: Consumed 136ms CPU time over 3.682s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.6K outgoing IP traffic. client # [ 52.740742] systemd[1]: dedup1.service: Deactivated successfully. client # [ 52.744243] systemd[1]: dedup1.service: Consumed 113ms CPU time over 4.743s wall clock time, 41.5M memory peak, 7K incoming IP traffic, 8.3K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.74 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 53.862955] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 53.884669] nix-grpc-daemon[724]: ts=2026-09-22T16:58:54Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 53.878901] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 53.888726] nix-grpc-daemon[724]: ts=2026-09-22T16:58:54Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 53.891346] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 53.902240] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 53.913128] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 54.015663] nix-daemon[851]: accepted connection from pid 1001, user nix-grpc-daemon (trusted) worker2 # [ 54.029305] nix-daemon[851]: reaped child process 1004, status = succeeded lb # [ 54.023512] niks3-server[980]: 2026/09/22 16:58:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 54.043523] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.336Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 54.045404] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.338Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 54.041609] niks3-server[980]: 2026/09/22 16:58:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 54.045544] niks3-server[980]: 2026/09/22 16:58:54 INFO Signed narinfos id=17 count=1 worker2 # [ 54.058703] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.351Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.051192] niks3-server[980]: 2026/09/22 16:58:54 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 54.053806] niks3-server[980]: 2026/09/22 16:58:54 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 54.058734] niks3-server[980]: 2026/09/22 16:58:54 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 54.066191] niks3-server[980]: 2026/09/22 16:58:54 INFO Completed upload id=17 worker2 # [ 54.078848] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.372Z level=INFO msg="Upload complete. (153ms)" lb # [ 54.068949] niks3-server[980]: 2026/09/22 16:58:54 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 54.081068] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 54.084432] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 54.092159] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 54.093471] nix-daemon[851]: reaped child process 999, status = succeeded worker2 # [ 54.098815] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) lb # [ 55.158183] envoy[907]: conn peer=[2001:db8:1::1]:59458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9468 tx=4356 ms=4920 lb # [ 55.161919] envoy[907]: conn peer=[2001:db8:1::1]:36676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=75 lb # [ 55.165599] envoy[907]: conn peer=[2001:db8:1::1]:36686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=71 lb # [ 55.169112] envoy[907]: conn peer=[2001:db8:1::1]:36698 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=65 lb # [ 55.173159] envoy[907]: conn peer=[2001:db8:1::1]:36674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2887 ms=131 lb # [ 55.176665] envoy[907]: conn peer=[2001:db8:1::1]:36724 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1194 ms=3488 lb # [ 55.180362] envoy[907]: conn peer=[2001:db8:1::1]:36710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2994 tx=1519 ms=4576 worker2 # [ 60.112870] nix-grpc-daemon[783]: ts=2026-09-22T16:59:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker2 # [ 60.137849] nix-daemon[851]: reaped child process 1006, status = succeeded worker2 # [ 60.140635] nix-daemon[851]: reaped child process 1008, status = succeeded worker2 # [ 60.310965] nix-grpc-daemon[783]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 60.334303] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker1 # [ 60.338835] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 60.343663] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 60.355987] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 60.368100] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 60.378645] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 60.483063] nix-daemon[861]: accepted connection from pid 1116, user nix-grpc-daemon (trusted) worker1 # [ 60.497479] nix-daemon[861]: reaped child process 1119, status = succeeded lb # [ 60.482516] niks3-server[980]: 2026/09/22 16:59:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.513386] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.765Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.514782] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.765Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 60.510194] niks3-server[980]: 2026/09/22 16:59:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 60.517932] niks3-server[980]: 2026/09/22 16:59:00 INFO Signed narinfos id=18 count=1 worker1 # [ 60.541362] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.793Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.526908] niks3-server[980]: 2026/09/22 16:59:00 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 60.536642] niks3-server[980]: 2026/09/22 16:59:00 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 60.547362] niks3-server[980]: 2026/09/22 16:59:00 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 60.557909] niks3-server[980]: 2026/09/22 16:59:00 INFO Completed upload id=18 worker1 # [ 60.578837] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.831Z level=INFO msg="Upload complete. (189ms)" lb # [ 60.560514] niks3-server[980]: 2026/09/22 16:59:00 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 60.582967] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 60.589600] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 60.600133] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 60.611269] nix-daemon[861]: reaped child process 1114, status = succeeded worker1 # [ 60.614424] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) lb # [ 65.158574] envoy[907]: conn peer=[2001:db8:1::1]:52398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=936 ms=6303 worker1 # [ 66.425944] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker1 # [ 66.438112] nix-daemon[861]: reaped child process 1123, status = succeeded worker1 # [ 66.439141] nix-daemon[861]: reaped child process 1121, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 12.78 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 66.518657] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: f6bc588787e7468fba88b0719a779f8c client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share worker1 # [ 66.648314] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48678 client # [ 66.652569] nix[1040]: don't know how to build these paths: client # [ 66.653577] nix[1040]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 66.661843] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 66.657742] nix-grpc-daemon[783]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 66.666426] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 66.665606] nix-grpc-daemon[783]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 client # [ 66.678067] nix[1040]: copying 1 paths to 'lb:50051'... client # [ 66.678874] nix[1040]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 66.673444] nix-grpc-daemon[783]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 66.677658] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 66.764687] nix-daemon[851]: accepted connection from pid 1031, user nix-grpc-daemon (trusted) worker2 # [ 66.778097] nix-daemon[851]: reaped child process 1034, status = succeeded lb # [ 66.771992] niks3-server[980]: 2026/09/22 16:59:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 66.793410] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.086Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 66.795290] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.088Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 66.808745] niks3-server[980]: 2026/09/22 16:59:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 66.815138] niks3-server[980]: 2026/09/22 16:59:07 INFO Signed narinfos id=19 count=1 worker2 # [ 66.831070] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.124Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.825485] niks3-server[980]: 2026/09/22 16:59:07 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 66.833622] niks3-server[980]: 2026/09/22 16:59:07 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 66.842594] niks3-server[980]: 2026/09/22 16:59:07 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 66.850907] niks3-server[980]: 2026/09/22 16:59:07 INFO Completed upload id=19 worker2 # [ 66.863835] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.156Z level=INFO msg="Upload complete. (180ms)" lb # [ 66.852660] niks3-server[980]: 2026/09/22 16:59:07 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 66.868442] nix-grpc-daemon[783]: ts=2026-09-22T16:59:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 66.874313] nix-grpc-daemon[783]: ts=2026-09-22T16:59:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 66.885669] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 66.893740] nix-daemon[851]: reaped child process 1029, status = succeeded worker2 # [ 66.902937] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # [ 66.907310] nix[1040]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 67.570561] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 72c7e36e245e48448a9bb7000c15a669 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) client # [ 67.712740] nix[1056]: don't know how to build these paths: worker1 # [ 67.714137] nix-grpc-daemon[724]: ts=2026-09-22T16:59:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48678 client # [ 67.713643] nix[1056]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 67.719973] nix-grpc-daemon[724]: ts=2026-09-22T16:59:07Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 67.716390] nix-grpc-daemon[783]: ts=2026-09-22T16:59:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 client # [ 67.726650] nix[1056]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 70.795748] systemd[1]: share1.service: Sent signal SIGINT to main process 1040 (nix) on client request. client # [ 70.798923] nix[1040]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 70.801676] nix[1040]: error: interrupted by the user client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.05 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 70.833187] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 70.834742] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 70.836895] systemd[1]: share1.service: Consumed 104ms CPU time over 4.317s wall clock time, 43.4M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.07 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 72.122267] nix-daemon[851]: reaped child process 1038, status = succeeded worker2 # [ 72.195662] nix-daemon[851]: accepted connection from pid 1072, user nix-grpc-daemon (trusted) worker2 # [ 72.207511] nix-daemon[851]: reaped child process 1075, status = succeeded lb # [ 72.203629] niks3-server[980]: 2026/09/22 16:59:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.225321] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.518Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 72.227524] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.519Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 72.250430] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 72.257344] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 72.265584] niks3-server[980]: 2026/09/22 16:59:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 72.272405] niks3-server[980]: 2026/09/22 16:59:12 INFO Signed narinfos id=20 count=1 worker2 # [ 72.288270] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.581Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.278112] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 72.288920] niks3-server[980]: 2026/09/22 16:59:12 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 72.294373] niks3-server[980]: 2026/09/22 16:59:12 INFO Completed upload id=20 worker2 # [ 72.307530] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.600Z level=INFO msg="Upload complete. (194ms)" lb # [ 72.297152] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 72.313619] nix-grpc-daemon[783]: ts=2026-09-22T16:59:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 72.321456] nix-grpc-daemon[783]: ts=2026-09-22T16:59:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 72.333409] nix-daemon[851]: reaped child process 1036, status = succeeded client # [ 72.390438] systemd[1]: share2.service: Deactivated successfully. client # [ 72.394216] systemd[1]: share2.service: Consumed 119ms CPU time over 4.822s wall clock time, 35.4M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.66 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 73.237814] systemd[1]: Started Nix Daemon. client # [ 73.325857] nix-daemon[1108]: accepted connection from pid 1105, user root (trusted) worker2 # [ 73.434601] nix-grpc-daemon[783]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 73.439889] nix-grpc-daemon[783]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 73.455952] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 73.458289] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 73.461453] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 73.466851] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 73.475384] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 73.483843] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 73.582913] nix-daemon[861]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 73.595590] nix-daemon[861]: reaped child process 1171, status = succeeded lb # [ 73.583557] niks3-server[980]: 2026/09/22 16:59:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.612388] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.864Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 73.614285] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.866Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 73.616162] niks3-server[980]: 2026/09/22 16:59:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 73.644975] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.897Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.624706] niks3-server[980]: 2026/09/22 16:59:13 INFO Signed narinfos id=21 count=1 lb # [ 73.635128] niks3-server[980]: 2026/09/22 16:59:13 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 73.641817] niks3-server[980]: 2026/09/22 16:59:13 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 73.651867] niks3-server[980]: 2026/09/22 16:59:13 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 73.657781] niks3-server[980]: 2026/09/22 16:59:13 INFO Completed upload id=21 lb # [ 73.660063] niks3-server[980]: 2026/09/22 16:59:13 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 73.681138] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.932Z level=INFO msg="Upload complete. (183ms)" worker1 # [ 73.685762] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 73.692379] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 73.704110] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 73.712764] nix-daemon[861]: reaped child process 1166, status = succeeded worker1 # [ 73.717480] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) lb # [ 75.159531] envoy[907]: conn peer=[2001:db8:1::1]:52410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=933 ms=6120 lb # [ 75.163411] envoy[907]: conn peer=[2001:db8:1::1]:56896 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=794 ms=4164 lb # [ 75.166919] envoy[907]: conn peer=[2001:db8:1::1]:56904 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1220 ms=4657 worker1 # [ 75.356801] nix-daemon[861]: reaped child process 1175, status = succeeded worker1 # [ 75.439375] nix-daemon[861]: accepted connection from pid 1191, user nix-grpc-daemon (trusted) worker1 # [ 75.452123] nix-daemon[861]: reaped child process 1194, status = succeeded lb # [ 75.439363] niks3-server[980]: 2026/09/22 16:59:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.469413] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.721Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 75.470886] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.723Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 75.485324] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 75.492091] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 75.500533] niks3-server[980]: 2026/09/22 16:59:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 75.507127] niks3-server[980]: 2026/09/22 16:59:15 INFO Signed narinfos id=22 count=1 worker1 # [ 75.527743] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.780Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.513567] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 75.522108] niks3-server[980]: 2026/09/22 16:59:15 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 75.525633] niks3-server[980]: 2026/09/22 16:59:15 INFO Completed upload id=22 worker1 # [ 75.546460] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.798Z level=INFO msg="Upload complete. (220ms)" lb # [ 75.528747] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 75.553213] nix-grpc-daemon[724]: ts=2026-09-22T16:59:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker1 # [ 75.562567] nix-grpc-daemon[724]: ts=2026-09-22T16:59:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 75.572108] nix-daemon[861]: reaped child process 1173, status = succeeded worker2 # [ 75.571172] nix-grpc-daemon[783]: ts=2026-09-22T16:59:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 75.580674] nix-grpc-daemon[783]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 75.593848] nix-grpc-daemon[783]: ts=2026-09-22T16:59:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 75.801891] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48678 worker2 # [ 75.797325] nix-grpc-daemon[783]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 75.806292] nix-grpc-daemon[877]: time=2026-09-22T16:59:16.098Z level=INFO msg="All 1 paths already cached" worker1 # [ 75.827429] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 75.832409] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.837148] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 75.846766] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 75.856795] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.109Z level=INFO msg="All 1 paths already cached" worker1 # [ 75.863321] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 75.873168] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 75.968405] nix-daemon[861]: accepted connection from pid 1200, user nix-grpc-daemon (trusted) worker1 # [ 75.982655] nix-daemon[861]: reaped child process 1203, status = succeeded lb # [ 75.967671] niks3-server[980]: 2026/09/22 16:59:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.992452] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.245Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 75.993893] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.246Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 75.982787] niks3-server[980]: 2026/09/22 16:59:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 75.984913] niks3-server[980]: 2026/09/22 16:59:16 INFO Signed narinfos id=23 count=1 worker1 # [ 76.005496] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.258Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.991914] niks3-server[980]: 2026/09/22 16:59:16 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 75.995122] niks3-server[980]: 2026/09/22 16:59:16 INFO Completed upload id=23 worker1 # [ 76.016776] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.269Z level=INFO msg="Upload complete. (133ms)" lb # [ 75.998112] niks3-server[980]: 2026/09/22 16:59:16 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst worker1 # [ 76.019091] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 76.001716] niks3-server[980]: 2026/09/22 16:59:16 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo lb # [ 76.003479] niks3-server[980]: 2026/09/22 16:59:16 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls worker1 # [ 76.025410] nix-daemon[861]: reaped child process 1198, status = succeeded worker1 # [ 76.026872] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 76.030338] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 76.036818] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 77.454481] nix-daemon[861]: reaped child process 1207, status = succeeded worker1 # [ 77.529381] nix-daemon[861]: accepted connection from pid 1223, user nix-grpc-daemon (trusted) worker1 # [ 77.542168] nix-daemon[861]: reaped child process 1226, status = succeeded lb # [ 77.529195] niks3-server[980]: 2026/09/22 16:59:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 77.558785] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.811Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 77.561057] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.812Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 77.574508] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 77.581418] niks3-server[980]: 2026/09/22 16:59:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 77.586439] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 77.591304] niks3-server[980]: 2026/09/22 16:59:17 INFO Signed narinfos id=24 count=1 worker1 # [ 77.611519] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.863Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.599484] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 77.604484] niks3-server[980]: 2026/09/22 16:59:17 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 77.607494] niks3-server[980]: 2026/09/22 16:59:17 INFO Completed upload id=24 worker1 # [ 77.628209] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.880Z level=INFO msg="Upload complete. (182ms)" lb # [ 77.610374] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 77.634580] nix-grpc-daemon[724]: ts=2026-09-22T16:59:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker1 # [ 77.642518] nix-grpc-daemon[724]: ts=2026-09-22T16:59:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 77.651122] nix-daemon[861]: reaped child process 1205, status = succeeded worker2 # [ 77.650141] nix-grpc-daemon[783]: ts=2026-09-22T16:59:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 77.659662] nix-grpc-daemon[783]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 77.669588] nix-grpc-daemon[783]: ts=2026-09-22T16:59:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 77.883369] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 77.885973] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 77.891735] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.144Z level=INFO msg="All 2 paths already cached" worker1 # [ 77.901324] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 77.903534] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 77.906125] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 77.914154] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 77.922548] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.175Z level=INFO msg="All 2 paths already cached" worker1 # [ 77.926815] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 77.931592] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 78.013203] nix-daemon[861]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 78.028138] nix-daemon[861]: reaped child process 1235, status = succeeded lb # [ 78.012189] niks3-server[980]: 2026/09/22 16:59:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.040658] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.293Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 78.042269] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.294Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 78.043355] niks3-server[980]: 2026/09/22 16:59:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign worker1 # [ 78.071065] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.323Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.050873] niks3-server[980]: 2026/09/22 16:59:18 INFO Signed narinfos id=25 count=1 lb # [ 78.055711] niks3-server[980]: 2026/09/22 16:59:18 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 78.068415] niks3-server[980]: 2026/09/22 16:59:18 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 78.073629] niks3-server[980]: 2026/09/22 16:59:18 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls worker1 # [ 78.100421] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.352Z level=INFO msg="Upload complete. (164ms)" lb # [ 78.079652] niks3-server[980]: 2026/09/22 16:59:18 INFO Completed upload id=25 worker1 # [ 78.102903] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 78.084210] niks3-server[980]: 2026/09/22 16:59:18 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 78.109970] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 78.111665] nix-daemon[861]: reaped child process 1230, status = succeeded worker1 # [ 78.114429] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 78.120767] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 79.356710] nix-daemon[861]: reaped child process 1239, status = succeeded worker1 # [ 79.441738] nix-daemon[861]: accepted connection from pid 1255, user nix-grpc-daemon (trusted) worker1 # [ 79.453097] nix-daemon[861]: reaped child process 1258, status = succeeded lb # [ 79.441334] niks3-server[980]: 2026/09/22 16:59:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.471154] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.723Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 79.472821] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.725Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 79.481671] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 79.490105] niks3-server[980]: 2026/09/22 16:59:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 79.496632] niks3-server[980]: 2026/09/22 16:59:19 INFO Signed narinfos id=26 count=1 worker1 # [ 79.519915] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.772Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.503484] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 79.506311] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 79.511704] niks3-server[980]: 2026/09/22 16:59:19 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 79.515467] niks3-server[980]: 2026/09/22 16:59:19 INFO Completed upload id=26 lb # [ 79.519223] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 79.537509] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.789Z level=INFO msg="Upload complete. (209ms)" worker1 # [ 79.545333] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker1 # [ 79.551290] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 79.561151] nix-daemon[861]: reaped child process 1237, status = succeeded worker1 # [ 79.566931] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 79.570972] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=232 client # [ 79.676800] nix-daemon[1108]: reaped child process 1110, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.54 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.60 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.12 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 80.331897] nix-daemon[1108]: accepted connection from pid 1191, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 80.445545] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46786 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 80.450698] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 client # copying 1 paths... client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 80.463237] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 80.471935] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 80.584133] nix-daemon[851]: accepted connection from pid 1084, user nix-grpc-daemon (trusted) worker2 # [ 80.597460] nix-daemon[851]: reaped child process 1087, status = succeeded lb # [ 80.592715] niks3-server[980]: 2026/09/22 16:59:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 80.614243] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.907Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 80.616084] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.908Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 80.621115] niks3-server[980]: 2026/09/22 16:59:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker2 # [ 80.643846] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.936Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.630701] niks3-server[980]: 2026/09/22 16:59:20 INFO Signed narinfos id=27 count=1 lb # [ 80.639519] niks3-server[980]: 2026/09/22 16:59:20 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 80.643681] niks3-server[980]: 2026/09/22 16:59:20 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 80.654830] niks3-server[980]: 2026/09/22 16:59:20 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 80.657925] niks3-server[980]: 2026/09/22 16:59:20 INFO Completed upload id=27 worker2 # [ 80.670820] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.964Z level=INFO msg="Upload complete. (186ms)" lb # [ 80.660440] niks3-server[980]: 2026/09/22 16:59:20 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 80.673691] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 80.684569] nix-daemon[851]: reaped child process 1082, status = succeeded worker1 # [ 80.696768] nix-grpc-daemon[724]: ts=2026-09-22T16:59:20Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker1 # [ 80.701433] nix-grpc-daemon[724]: ts=2026-09-22T16:59:20Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 80.732605] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 80.744863] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 80.760519] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 80.770158] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 80.869746] nix-daemon[851]: accepted connection from pid 1091, user nix-grpc-daemon (trusted) worker2 # [ 80.883392] nix-daemon[851]: reaped child process 1094, status = succeeded lb # [ 80.876923] niks3-server[980]: 2026/09/22 16:59:21 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 80.885950] niks3-server[980]: 2026/09/22 16:59:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 80.908036] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.201Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 80.909542] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.202Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker2 # [ 80.911264] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.204Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 80.933234] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 80.945944] niks3-server[980]: 2026/09/22 16:59:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 80.950787] niks3-server[980]: 2026/09/22 16:59:21 INFO Signed narinfos id=28 count=1 lb # [ 80.956167] niks3-server[980]: 2026/09/22 16:59:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 80.959183] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 80.962291] niks3-server[980]: 2026/09/22 16:59:21 INFO Signed narinfos id=29 count=2 lb # [ 80.963987] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls worker2 # [ 80.976190] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.268Z level=INFO msg="Uploading 3 narinfos" lb # [ 80.965467] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 80.979843] niks3-server[980]: 2026/09/22 16:59:21 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 80.983327] niks3-server[980]: 2026/09/22 16:59:21 INFO Completed upload id=28 lb # [ 80.986282] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 80.988197] niks3-server[980]: 2026/09/22 16:59:21 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 80.990476] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 80.993786] niks3-server[980]: 2026/09/22 16:59:21 INFO Completed upload id=29 worker2 # [ 81.006886] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.299Z level=INFO msg="Upload complete. (223ms)" lb # [ 80.997595] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo worker2 # [ 81.012405] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 81.017930] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 81.028401] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 81.041263] nix-daemon[851]: reaped child process 1089, status = succeeded client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 81.048802] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 82.479314] nix-daemon[851]: reaped child process 1098, status = succeeded worker2 # [ 82.557642] nix-daemon[851]: accepted connection from pid 1114, user nix-grpc-daemon (trusted) worker2 # [ 82.570113] nix-daemon[851]: reaped child process 1117, status = succeeded lb # [ 82.564626] niks3-server[980]: 2026/09/22 16:59:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 82.584230] nix-grpc-daemon[877]: time=2026-09-22T16:59:22.877Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 82.595611] niks3-server[980]: 2026/09/22 16:59:22 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 82.602435] niks3-server[980]: 2026/09/22 16:59:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 82.610251] niks3-server[980]: 2026/09/22 16:59:22 INFO Signed narinfos id=30 count=1 worker2 # [ 82.626034] nix-grpc-daemon[877]: time=2026-09-22T16:59:22.919Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.616711] niks3-server[980]: 2026/09/22 16:59:22 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 82.631973] niks3-server[980]: 2026/09/22 16:59:22 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 82.637595] niks3-server[980]: 2026/09/22 16:59:22 INFO Completed upload id=30 worker2 # [ 82.649987] nix-grpc-daemon[877]: time=2026-09-22T16:59:22.943Z level=INFO msg="Upload complete. (190ms)" lb # [ 82.639669] niks3-server[980]: 2026/09/22 16:59:22 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo client # copying 1 paths... worker2 # [ 82.654900] nix-grpc-daemon[783]: ts=2026-09-22T16:59:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 worker1 # [ 82.668906] nix-grpc-daemon[724]: ts=2026-09-22T16:59:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 worker2 # [ 82.669203] nix-daemon[851]: reaped child process 1096, status = succeeded worker1 # [ 82.677687] nix-grpc-daemon[724]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 82.689627] nix-grpc-daemon[783]: ts=2026-09-22T16:59:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 82.694320] nix-grpc-daemon[783]: ts=2026-09-22T16:59:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=120 client # [ 82.810368] nix-daemon[1108]: reaped child process 1194, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.60 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 82.911092] nix-daemon[1108]: accepted connection from pid 1213, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 83.017425] nix-grpc-daemon[783]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46786 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 83.023259] nix-grpc-daemon[783]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 83.028605] nix-grpc-daemon[877]: time=2026-09-22T16:59:23.320Z level=INFO msg="All 1 paths already cached" worker1 # [ 83.044691] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 83.050801] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 83.056794] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 83.066951] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48678 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 83.079971] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 83.090862] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 83.105159] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5) worker1 # [ 83.174089] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5) worker1 # [ 83.208714] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 325 ms (attempt 3/5) worker1 # [ 83.535706] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 4/5) worker1 # [ 83.729863] nix-grpc-daemon[724]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 83.733723] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 83.739215] nix-grpc-daemon[724]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 83.853969] nix-daemon[861]: accepted connection from pid 1277, user nix-grpc-daemon (trusted) worker1 # [ 83.868916] nix-daemon[861]: reaped child process 1280, status = succeeded lb # [ 83.854559] niks3-server[980]: 2026/09/22 16:59:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 83.883201] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.135Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 83.884652] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.137Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 83.886264] niks3-server[980]: 2026/09/22 16:59:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker1 # [ 83.915929] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.168Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.896737] niks3-server[980]: 2026/09/22 16:59:24 INFO Signed narinfos id=31 count=1 lb # [ 83.900975] niks3-server[980]: 2026/09/22 16:59:24 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 83.906670] niks3-server[980]: 2026/09/22 16:59:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 83.917613] niks3-server[980]: 2026/09/22 16:59:24 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 83.925102] niks3-server[980]: 2026/09/22 16:59:24 INFO Completed upload id=31 worker1 # [ 83.945419] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.197Z level=INFO msg="Upload complete. (187ms)" worker1 # [ 83.949307] nix-grpc-daemon[724]: ts=2026-09-22T16:59:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 83.932061] niks3-server[980]: 2026/09/22 16:59:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 83.954783] nix-grpc-daemon[724]: ts=2026-09-22T16:59:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 83.966126] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) worker1 # [ 83.970822] nix-daemon[861]: reaped child process 1270, status = succeeded worker1 # [ 83.975980] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 84.791120] nix-daemon[861]: reaped child process 1284, status = succeeded worker1 # [ 84.862172] nix-daemon[861]: accepted connection from pid 1301, user nix-grpc-daemon (trusted) worker1 # [ 84.874618] nix-daemon[861]: reaped child process 1304, status = succeeded lb # [ 84.861724] niks3-server[980]: 2026/09/22 16:59:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.890311] nix-grpc-daemon[876]: time=2026-09-22T16:59:25.142Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 84.893151] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 84.899204] niks3-server[980]: 2026/09/22 16:59:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 84.907291] niks3-server[980]: 2026/09/22 16:59:25 INFO Signed narinfos id=32 count=1 worker1 # [ 84.931091] nix-grpc-daemon[876]: time=2026-09-22T16:59:25.183Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.915560] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 84.926690] niks3-server[980]: 2026/09/22 16:59:25 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 84.933481] niks3-server[980]: 2026/09/22 16:59:25 INFO Completed upload id=32 worker1 # [ 84.954084] nix-grpc-daemon[876]: time=2026-09-22T16:59:25.206Z level=INFO msg="Upload complete. (171ms)" worker1 # [ 84.959476] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 client # copying 1 paths... worker2 # [ 84.959996] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46786 worker1 # [ 84.971747] nix-daemon[861]: reaped child process 1282, status = succeeded worker2 # [ 84.965118] nix-grpc-daemon[783]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 84.987659] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 84.991966] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=120 client # [ 85.098351] nix-daemon[1108]: reaped child process 1216, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.29 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 lb # [ 85.160310] envoy[907]: conn peer=[2001:db8:1::1]:46852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3410 tx=1920 ms=2212 lb # [ 85.162366] envoy[907]: conn peer=[2001:db8:1::1]:46862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=75 lb # [ 85.164293] envoy[907]: conn peer=[2001:db8:1::1]:46872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=2140 ms=1925 lb # [ 85.166258] envoy[907]: conn peer=[2001:db8:1::1]:46884 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=70 lb # [ 85.168168] envoy[907]: conn peer=[2001:db8:1::1]:46894 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4324 tx=2366 ms=1738 lb # [ 85.170114] envoy[907]: conn peer=[2001:db8:1::1]:46898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=55 lb # [ 85.172214] envoy[907]: conn peer=[2001:db8:1::1]:46912 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4235 tx=2057 ms=2302 lb # [ 85.174179] envoy[907]: conn peer=[2001:db8:1::1]:46916 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=55 lb # [ 85.176138] envoy[907]: conn peer=[2001:db8:1::1]:48840 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=54 lb # [ 85.178092] envoy[907]: conn peer=[2001:db8:1::1]:48828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3732 tx=2124 ms=2018 client # [ 85.203072] nix-daemon[1108]: accepted connection from pid 1235, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 85.308480] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 85.312714] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 85.317940] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.610Z level=INFO msg="All 1 paths already cached" worker1 # [ 85.336270] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker1 # [ 85.340628] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 85.371379] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 85.377663] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 85.383841] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.677Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 85.387719] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 85.393936] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 85.479416] nix-daemon[851]: accepted connection from pid 1122, user nix-grpc-daemon (trusted) worker2 # [ 85.491546] nix-daemon[851]: reaped child process 1125, status = succeeded lb # [ 85.487108] niks3-server[980]: 2026/09/22 16:59:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.508251] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 85.509838] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.802Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 85.514102] niks3-server[980]: 2026/09/22 16:59:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 85.516894] niks3-server[980]: 2026/09/22 16:59:25 INFO Signed narinfos id=33 count=1 worker2 # [ 85.532417] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.825Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.523233] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 85.532256] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 85.535507] niks3-server[980]: 2026/09/22 16:59:25 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 85.538466] niks3-server[980]: 2026/09/22 16:59:25 INFO Completed upload id=33 worker2 # [ 85.551296] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.844Z level=INFO msg="Upload complete. (151ms)" worker2 # [ 85.553189] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 85.543326] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 85.556230] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 worker2 # [ 85.563221] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 85.565526] nix-daemon[851]: reaped child process 1120, status = succeeded worker2 # [ 85.570661] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 86.797437] nix-daemon[851]: reaped child process 1129, status = succeeded worker2 # [ 86.874398] nix-daemon[851]: accepted connection from pid 1145, user nix-grpc-daemon (trusted) worker2 # [ 86.886624] nix-daemon[851]: reaped child process 1148, status = succeeded lb # [ 86.883731] niks3-server[980]: 2026/09/22 16:59:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.902733] nix-grpc-daemon[877]: time=2026-09-22T16:59:27.195Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 86.912738] niks3-server[980]: 2026/09/22 16:59:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 86.921100] niks3-server[980]: 2026/09/22 16:59:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 86.926617] niks3-server[980]: 2026/09/22 16:59:27 INFO Signed narinfos id=34 count=1 worker2 # [ 86.942630] nix-grpc-daemon[877]: time=2026-09-22T16:59:27.235Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.933821] niks3-server[980]: 2026/09/22 16:59:27 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 86.946926] niks3-server[980]: 2026/09/22 16:59:27 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 86.953508] niks3-server[980]: 2026/09/22 16:59:27 INFO Completed upload id=34 worker2 # [ 86.966383] nix-grpc-daemon[877]: time=2026-09-22T16:59:27.259Z level=INFO msg="Upload complete. (187ms)" lb # [ 86.955989] niks3-server[980]: 2026/09/22 16:59:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo client # copying 1 paths... worker2 # [ 86.971338] nix-grpc-daemon[783]: ts=2026-09-22T16:59:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker2 # [ 86.977908] nix-grpc-daemon[783]: ts=2026-09-22T16:59:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46786 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 86.987807] nix-daemon[851]: reaped child process 1127, status = succeeded worker1 # [ 87.000920] nix-grpc-daemon[724]: ts=2026-09-22T16:59:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 87.009198] nix-grpc-daemon[724]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... worker1 # [ 87.019722] nix-grpc-daemon[724]: ts=2026-09-22T16:59:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=120 client # [ 87.125411] nix-daemon[1108]: reaped child process 1238, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.03 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.38 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.12 seconds) worker2 # [ 87.843930] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 88.413164] nix-grpc-daemon[783]: ts=2026-09-22T16:59:28Z level=info event=signal_exit worker1 # [ 89.596487] nix-grpc-daemon[724]: ts=2026-09-22T16:59:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48666 worker1 # [ 89.600607] nix-grpc-daemon[724]: ts=2026-09-22T16:59:29Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 89.590913] nix-grpc-daemon[783]: ts=2026-09-22T16:59:29Z level=info event=scheduler_restarting worker2 # [ 89.604845] nix-grpc-daemon[783]: ts=2026-09-22T16:59:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 89.625262] nix-daemon[851]: reaped child process 853, status = succeeded worker2 # [ 89.772181] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 89.775161] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 89.778610] systemd[1]: nix-grpc-daemon.service: Consumed 1.815s CPU time over 1min 14.521s wall clock time, 60.5M memory peak, 84.3K incoming IP traffic, 201.9K outgoing IP traffic. worker2 # [ 89.790498] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 89.794791] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 89.798455] systemd[1]: nix-grpc-daemon.socket: Consumed 292us CPU time over 1min 22.292s wall clock time, 256K memory peak, 87.2K incoming IP traffic, 77.1K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 89.956677] nix-grpc-daemon[724]: ts=2026-09-22T16:59:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48678 worker1 # [ 89.963639] nix-grpc-daemon[724]: ts=2026-09-22T16:59:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48678 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.14 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 90.035745] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 90.088082] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 90.363057] nix-grpc-daemon[724]: ts=2026-09-22T16:59:30Z level=info event=signal_exit worker2 # [ 90.548661] systemd[1]: Starting scheduler-token.service... lb # [ 90.570838] niks3-server[980]: 2026/09/22 16:59:30 INFO lead: released remote=192.168.1.3:40164 worker2 # [ 90.608598] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 90.613345] systemd[1]: Finished scheduler-token.service. worker2 # [ 90.615342] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 62ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 90.623153] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 90.701332] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 90.703375] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 90.706518] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 90.710822] nix-grpc-daemon[1172]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 90.712150] nix-grpc-daemon[1172]: E0000 00:00:1790096371.003560 1172 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 90.716478] nix-grpc-daemon[1172]: E0000 00:00:1790096371.008871 1172 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 90.720609] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 90.724925] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 90.728063] nix-grpc-daemon[1172]: E0000 00:00:1790096371.020900 1211 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 90.732696] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_take_over lb # [ 90.719948] niks3-server[980]: 2026/09/22 16:59:31 INFO lead: acquired remote=192.168.1.4:38610 worker2 # [ 90.743616] nix-grpc-daemon[1172]: E0000 00:00:1790096371.036767 1211 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 90.747132] nix-grpc-daemon[1172]: E0000 00:00:1790096371.038971 1211 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 90.757574] nix-grpc-daemon[1172]: E0000 00:00:1790096371.050721 1211 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 90.768550] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.770605] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.971949] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.975890] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.176941] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.181409] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.382328] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.386752] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.593696] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=scheduler_restarting worker2 # [ 91.587845] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.599681] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 91.592268] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.602894] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48666 worker1 # [ 91.606336] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 91.625218] nix-daemon[861]: reaped child process 863, status = succeeded worker2 # [ 91.793938] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.806665] nix-grpc-daemon[724]: ts=2026-09-22T16:59:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 91.807149] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 91.810740] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36630 worker2 # [ 91.814594] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 92.505362] nix-grpc-daemon[724]: E0000 00:00:1790096372.757577 769 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker1 # [ 92.510445] nix-grpc-daemon[724]: E0000 00:00:1790096372.758149 769 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 93.741243] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 93.744909] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 93.749360] systemd[1]: nix-grpc-daemon.service: Consumed 2.388s CPU time over 1min 18.565s wall clock time, 69.8M memory peak, 111.7K incoming IP traffic, 244.8K outgoing IP traffic. worker1 # [ 93.761154] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 93.765436] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 93.768620] systemd[1]: nix-grpc-daemon.socket: Consumed 306us CPU time over 1min 25.322s wall clock time, 256K memory peak, 121.3K incoming IP traffic, 106K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 93.962469] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 93.973708] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 93.989808] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5) worker2 # [ 94.066137] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 2/5) worker2 # [ 94.186091] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 3/5) worker2 # [ 94.522252] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 378 ms (attempt 4/5) worker2 # [ 94.902609] nix-grpc-daemon[1172]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 94.906271] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 94.925969] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 94.935908] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 94.946722] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=niks3_push_started pid=1232 worker2 # [ 95.035505] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.328Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 95.120383] nix-daemon[851]: accepted connection from pid 1245, user nix-grpc-daemon (trusted) worker2 # [ 95.132354] nix-daemon[851]: reaped child process 1248, status = succeeded lb # [ 95.130565] niks3-server[980]: 2026/09/22 16:59:35 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 95.141692] niks3-server[980]: 2026/09/22 16:59:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.161645] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.454Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 95.163447] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.456Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 95.166046] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.458Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" lb # [ 95.161802] envoy[907]: conn peer=[2001:db8:1::1]:48846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=2081 ms=1753 lb # [ 95.166516] envoy[907]: conn peer=[2001:db8:1::1]:48852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=72 lb # [ 95.169985] envoy[907]: conn peer=[2001:db8:1::4]:53266 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=63563 tx=3260 ms=74154 lb # [ 95.173650] envoy[907]: conn peer=[2001:db8:1::1]:48862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=19 lb # [ 95.178190] envoy[907]: conn peer=[2001:db8:1::3]:39780 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17299 tx=3700 ms=76398 lb # [ 95.211849] niks3-server[980]: 2026/09/22 16:59:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 95.215605] niks3-server[980]: 2026/09/22 16:59:35 INFO Signed narinfos id=35 count=1 lb # [ 95.216669] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 95.221524] niks3-server[980]: 2026/09/22 16:59:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 95.223713] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 95.226222] niks3-server[980]: 2026/09/22 16:59:35 INFO Signed narinfos id=36 count=2 worker2 # [ 95.240129] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.532Z level=INFO msg="Uploading 3 narinfos" lb # [ 95.231310] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 95.234666] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 95.248483] niks3-server[980]: 2026/09/22 16:59:35 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 95.251446] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 95.254363] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 95.258241] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 95.264991] niks3-server[980]: 2026/09/22 16:59:35 INFO Completed upload id=35 lb # [ 95.266641] niks3-server[980]: 2026/09/22 16:59:35 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 95.271543] niks3-server[980]: 2026/09/22 16:59:35 INFO Completed upload id=36 worker2 # [ 95.284696] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.577Z level=INFO msg="Upload complete. (245ms)" worker2 # [ 95.290940] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 95.305443] nix-daemon[851]: reaped child process 1230, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.50 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 95.395980] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 95.402941] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 95.490348] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 95.494609] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 95.498128] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 95.502271] nix-grpc-daemon[1330]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 95.507498] nix-grpc-daemon[1330]: E0000 00:00:1790096375.750156 1330 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 95.510631] nix-grpc-daemon[1330]: E0000 00:00:1790096375.753891 1330 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 95.515067] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 95.518115] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 95.518941] nix-grpc-daemon[1330]: E0000 00:00:1790096375.766546 1369 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 95.530060] nix-grpc-daemon[1330]: E0000 00:00:1790096375.782398 1369 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 95.534103] nix-grpc-daemon[1330]: E0000 00:00:1790096375.782529 1369 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 95.544499] nix-grpc-daemon[1330]: E0000 00:00:1790096375.797085 1369 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 95.552255] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.546233] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36630 worker2 # [ 95.550514] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.08 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.48 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 96.669453] systemd[1]: Stopping niks3 server... lb # [ 96.672780] niks3-server[980]: 2026/09/22 16:59:37 INFO Shutdown signal received, draining in-flight requests timeout=10s worker2 # [ 96.688056] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:36Z level=info event=scheduler_lock_lost status=200 lb # [ 96.675184] niks3-server[980]: 2026/09/22 16:59:37 INFO lead: released remote=192.168.1.4:38610 worker1 # [ 96.696360] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:36Z level=info event=scheduler_lock_lost status=200 lb # [ 96.691651] systemd[1]: niks3.service: Deactivated successfully. lb # [ 96.693359] systemd[1]: Stopped niks3 server. lb # [ 96.694609] systemd[1]: niks3.service: Consumed 736ms CPU time over 1min 17.355s wall clock time, 28.9M memory peak, 94K incoming IP traffic, 136.5K outgoing IP traffic. lb # [ 96.702033] systemd[1]: Starting niks3 server... lb # [ 96.756304] niks3-server[1120]: 2026/09/22 16:59:37 goose: no migrations to run. current version: 20260920000000 lb # [ 96.762551] niks3-server[1120]: 2026/09/22 16:59:37 OK 1_commit_pending_closure.sql (4.28ms) lb # [ 96.766276] niks3-server[1120]: 2026/09/22 16:59:37 OK 2_object_stats_trigger.sql (1.9ms) lb # [ 96.767396] niks3-server[1120]: 2026/09/22 16:59:37 goose: up to current file version: 2 lb # [ 96.768650] niks3-server[1120]: 2026/09/22 16:59:37 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 96.780397] niks3-server[1120]: 2026/09/22 16:59:37 INFO Read proxy enabled — serving cache objects from S3 lb # [ 96.781756] niks3-server[1120]: 2026/09/22 16:59:37 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 96.784323] systemd[1]: Started niks3 server. lb # [ 96.786209] niks3-server[1120]: 2026/09/22 16:59:37 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 96.787687] niks3-server[1120]: 2026/09/22 16:59:37 INFO systemd watchdog enabled interval=15s lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.02 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 97.054983] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 97.065988] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 97.072813] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 97.092914] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 97.098438] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 97.137121] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 97.147880] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34878 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 97.158456] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 97.169153] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 97.267411] nix-daemon[851]: accepted connection from pid 1265, user nix-grpc-daemon (trusted) worker2 # [ 97.281168] nix-daemon[851]: reaped child process 1268, status = succeeded lb # [ 97.273124] niks3-server[1120]: 2026/09/22 16:59:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.291715] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.584Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 97.294170] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.586Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 97.292713] niks3-server[1120]: 2026/09/22 16:59:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 97.296505] niks3-server[1120]: 2026/09/22 16:59:37 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 97.307847] niks3-server[1120]: 2026/09/22 16:59:37 INFO Signed narinfos id=37 count=1 worker2 # [ 97.322867] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.615Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.315446] niks3-server[1120]: 2026/09/22 16:59:37 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 97.318622] niks3-server[1120]: 2026/09/22 16:59:37 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 97.326545] niks3-server[1120]: 2026/09/22 16:59:37 INFO Completed upload id=37 worker2 # [ 97.339333] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.632Z level=INFO msg="Upload complete. (158ms)" worker2 # [ 97.341323] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=1 nar_bytes_in=536 lb # [ 97.330763] niks3-server[1120]: 2026/09/22 16:59:37 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker2 # [ 97.345685] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 97.352449] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 97.353770] nix-daemon[851]: reaped child process 1263, status = succeeded client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker2 # [ 97.358825] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) lb # [ 97.679950] niks3-server[1120]: 2026/09/22 16:59:38 INFO lead: acquired remote=192.168.1.4:44614 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 98.191880] nix-daemon[851]: reaped child process 1272, status = succeeded worker2 # [ 98.278912] nix-daemon[851]: accepted connection from pid 1290, user nix-grpc-daemon (trusted) worker2 # [ 98.291571] nix-daemon[851]: reaped child process 1293, status = succeeded lb # [ 98.286480] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.305158] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 98.306623] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.599Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 98.308383] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker2 # [ 98.325553] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.618Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.313704] niks3-server[1120]: 2026/09/22 16:59:38 INFO Signed narinfos id=38 count=1 lb # [ 98.315937] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 98.319766] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 98.323797] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 98.328309] niks3-server[1120]: 2026/09/22 16:59:38 INFO Completed upload id=38 worker2 # [ 98.341140] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.634Z level=INFO msg="Upload complete. (175ms)" lb # [ 98.330779] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls worker2 # [ 98.343986] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 lb # [ 98.333648] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 98.353568] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 98.355523] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 98.358731] nix-daemon[851]: reaped child process 1270, status = succeeded worker2 # [ 98.395883] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 98.404587] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 98.413670] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.706Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 98.419262] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 98.425857] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 98.512653] nix-daemon[851]: accepted connection from pid 1299, user nix-grpc-daemon (trusted) worker2 # [ 98.525367] nix-daemon[851]: reaped child process 1302, status = succeeded lb # [ 98.520093] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.537249] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.830Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 98.538742] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.831Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 98.535275] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 98.539428] niks3-server[1120]: 2026/09/22 16:59:38 INFO Signed narinfos id=39 count=1 worker2 # [ 98.551969] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.845Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.546094] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 98.551113] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 98.556497] niks3-server[1120]: 2026/09/22 16:59:38 INFO Completed upload id=39 worker2 # [ 98.569230] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.862Z level=INFO msg="Upload complete. (136ms)" worker2 # [ 98.571246] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=1 nar_bytes_in=656 lb # [ 98.559752] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 98.575360] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 lb # [ 98.563628] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst worker2 # [ 98.581591] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 98.583969] nix-daemon[851]: reaped child process 1297, status = succeeded worker2 # [ 98.589170] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 99.603323] nix-daemon[851]: reaped child process 1306, status = succeeded worker2 # [ 99.679384] nix-daemon[851]: accepted connection from pid 1322, user nix-grpc-daemon (trusted) worker2 # [ 99.691384] nix-daemon[851]: reaped child process 1325, status = succeeded lb # [ 99.685660] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.709568] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.002Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 99.711045] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.004Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 99.727377] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 99.736747] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 99.757805] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.050Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.745090] niks3-server[1120]: 2026/09/22 16:59:40 INFO Signed narinfos id=40 count=1 lb # [ 99.751992] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 99.760783] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 99.766426] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 99.770160] niks3-server[1120]: 2026/09/22 16:59:40 INFO Completed upload id=40 worker2 # [ 99.782937] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.076Z level=INFO msg="Upload complete. (187ms)" lb # [ 99.773417] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 99.786357] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 99.791649] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 99.794095] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 99.798825] nix-daemon[851]: reaped child process 1304, status = succeeded worker2 # [ 99.836254] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 99.848510] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 99.860937] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.153Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 99.870154] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 99.881166] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 99.974199] nix-daemon[851]: accepted connection from pid 1331, user nix-grpc-daemon (trusted) worker2 # [ 99.988976] nix-daemon[851]: reaped child process 1334, status = succeeded lb # [ 99.982143] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.002924] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.296Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 100.004400] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.297Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 100.015232] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 100.020351] niks3-server[1120]: 2026/09/22 16:59:40 INFO Signed narinfos id=41 count=1 worker2 # [ 100.036025] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.329Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.029520] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 100.039709] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 100.050304] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 100.057124] niks3-server[1120]: 2026/09/22 16:59:40 INFO Completed upload id=41 worker2 # [ 100.069802] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.362Z level=INFO msg="Upload complete. (178ms)" lb # [ 100.060480] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 100.074940] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 100.081360] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 worker2 # [ 100.095112] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 100.104150] nix-daemon[851]: reaped child process 1329, status = succeeded client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... worker2 # [ 100.107928] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 101.524303] nix-daemon[851]: reaped child process 1338, status = succeeded worker2 # [ 101.596886] nix-daemon[851]: accepted connection from pid 1354, user nix-grpc-daemon (trusted) worker2 # [ 101.609975] nix-daemon[851]: reaped child process 1357, status = succeeded lb # [ 101.604638] niks3-server[1120]: 2026/09/22 16:59:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.626753] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.919Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 101.628429] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.921Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 101.632089] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 101.636149] niks3-server[1120]: 2026/09/22 16:59:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 101.638563] niks3-server[1120]: 2026/09/22 16:59:41 INFO Signed narinfos id=42 count=1 worker2 # [ 101.651465] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.944Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.643713] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 101.646914] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 101.650464] niks3-server[1120]: 2026/09/22 16:59:41 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 101.654246] niks3-server[1120]: 2026/09/22 16:59:41 INFO Completed upload id=42 worker2 # [ 101.668313] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.961Z level=INFO msg="Upload complete. (152ms)" lb # [ 101.657629] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 101.670948] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 101.678908] nix-daemon[851]: reaped child process 1336, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 4.76 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.10 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 5.18 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 101.954771] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 102.724138] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:43Z level=info event=signal_exit lb # [ 103.684772] niks3-server[1120]: 2026/09/22 16:59:44 INFO lead: released remote=192.168.1.4:44614 worker2 # [ 104.695407] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=scheduler_restarting worker2 # [ 104.698329] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 104.706768] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:44Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 104.701830] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36630 worker2 # [ 104.705927] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 104.709884] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36630 worker2 # [ 104.713361] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 104.735443] nix-daemon[851]: reaped child process 1224, status = succeeded worker2 # [ 104.773658] nix-grpc-daemon[1172]: E0000 00:00:1790096385.066616 1217 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 104.779008] nix-grpc-daemon[1172]: E0000 00:00:1790096385.071957 1217 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 104.906465] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.911151] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.911454] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 105.112398] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.116417] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 105.162238] envoy[907]: conn peer=[2001:db8:1::1]:35296 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1008 tx=282 ms=1341 lb # [ 105.167746] envoy[907]: conn peer=[2001:db8:1::1]:35304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9718 tx=4376 ms=4641 lb # [ 105.171395] envoy[907]: conn peer=[2001:db8:1::4]:38140 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5880 tx=625 ms=14138 worker1 # [ 105.317277] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.321321] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.521882] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.525811] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.727465] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.731389] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.932267] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.936357] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.137134] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.141156] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.341983] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.345952] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.546757] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.550761] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.752841] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.757091] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.904674] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 106.908812] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 106.913154] systemd[1]: nix-grpc-daemon.service: Consumed 840ms CPU time over 16.284s wall clock time, 37.8M memory peak, 46.5K incoming IP traffic, 85.3K outgoing IP traffic. worker2 # [ 106.925556] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 106.929970] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 106.933607] systemd[1]: nix-grpc-daemon.socket: Consumed 314us CPU time over 16.896s wall clock time, 256K memory peak, 37.7K incoming IP traffic, 28K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 106.957991] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.963216] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 107.163939] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.168154] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.368856] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.373105] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.573795] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.577672] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.702208] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_take_over lb # [ 107.682731] niks3-server[1120]: 2026/09/22 16:59:48 INFO lead: acquired remote=192.168.1.3:35992 worker1 # [ 107.779088] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.786130] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48658 worker1 # [ 107.790687] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker1 # [ 108.224562] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47074 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 108.233900] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 108.244384] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5) worker1 # [ 108.262891] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 2/5) worker1 # [ 108.290269] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 3/5) worker1 # [ 108.423249] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 4/5) worker1 # [ 108.706457] nix-grpc-daemon[1330]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 108.708269] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 108.724076] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 108.726727] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 108.768428] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 108.778165] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47074 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 108.787449] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 108.792382] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 108.804503] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=info event=niks3_push_started pid=1406 worker1 # [ 108.893592] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.145Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 108.976624] nix-daemon[861]: accepted connection from pid 1419, user nix-grpc-daemon (trusted) worker1 # [ 108.990380] nix-daemon[861]: reaped child process 1422, status = succeeded lb # [ 108.977262] niks3-server[1120]: 2026/09/22 16:59:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 109.004994] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.257Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 109.006561] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.259Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 109.019160] niks3-server[1120]: 2026/09/22 16:59:49 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 109.025983] niks3-server[1120]: 2026/09/22 16:59:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker1 # [ 109.053198] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.305Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.033080] niks3-server[1120]: 2026/09/22 16:59:49 INFO Signed narinfos id=43 count=1 lb # [ 109.047142] niks3-server[1120]: 2026/09/22 16:59:49 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 109.056879] niks3-server[1120]: 2026/09/22 16:59:49 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 109.062590] niks3-server[1120]: 2026/09/22 16:59:49 INFO Completed upload id=43 worker1 # [ 109.085181] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.337Z level=INFO msg="Upload complete. (188ms)" lb # [ 109.066933] niks3-server[1120]: 2026/09/22 16:59:49 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 109.090274] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 109.096669] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 109.107112] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 109.114608] nix-daemon[861]: reaped child process 1404, status = succeeded worker1 # [ 109.119336] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 110.352084] nix-daemon[861]: reaped child process 1426, status = succeeded worker1 # [ 110.438469] nix-daemon[861]: accepted connection from pid 1442, user nix-grpc-daemon (trusted) worker1 # [ 110.451903] nix-daemon[861]: reaped child process 1445, status = succeeded lb # [ 110.436867] niks3-server[1120]: 2026/09/22 16:59:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.466483] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.718Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 110.468159] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.720Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 110.480989] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 110.487952] niks3-server[1120]: 2026/09/22 16:59:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 110.513334] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.765Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.493357] niks3-server[1120]: 2026/09/22 16:59:50 INFO Signed narinfos id=44 count=1 lb # [ 110.502538] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 110.511335] niks3-server[1120]: 2026/09/22 16:59:50 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 110.521337] niks3-server[1120]: 2026/09/22 16:59:50 INFO Completed upload id=44 worker1 # [ 110.542100] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.794Z level=INFO msg="Upload complete. (214ms)" lb # [ 110.523880] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker1 # [ 110.549158] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 lb # [ 110.535318] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker1 # [ 110.561835] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 110.565357] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 110.572821] nix-daemon[861]: reaped child process 1424, status = succeeded worker1 # [ 110.605645] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 110.619327] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 110.633564] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.886Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 110.642878] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 110.652351] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 110.746721] nix-daemon[861]: accepted connection from pid 1451, user nix-grpc-daemon (trusted) worker1 # [ 110.759358] nix-daemon[861]: reaped child process 1454, status = succeeded lb # [ 110.746950] niks3-server[1120]: 2026/09/22 16:59:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.783490] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.036Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 110.784979] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.037Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 110.789269] niks3-server[1120]: 2026/09/22 16:59:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 110.791642] niks3-server[1120]: 2026/09/22 16:59:51 INFO Signed narinfos id=45 count=1 worker1 # [ 110.812146] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.064Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.795114] niks3-server[1120]: 2026/09/22 16:59:51 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 110.798365] niks3-server[1120]: 2026/09/22 16:59:51 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 110.805896] niks3-server[1120]: 2026/09/22 16:59:51 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 110.810243] niks3-server[1120]: 2026/09/22 16:59:51 INFO Completed upload id=45 worker1 # [ 110.830092] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.082Z level=INFO msg="Upload complete. (166ms)" lb # [ 110.813054] niks3-server[1120]: 2026/09/22 16:59:51 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 110.834061] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 110.839445] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 110.847568] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 110.852210] nix-daemon[861]: reaped child process 1449, status = succeeded worker1 # [ 110.856407] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 112.073605] nix-daemon[861]: reaped child process 1458, status = succeeded worker1 # [ 112.148377] nix-daemon[861]: accepted connection from pid 1474, user nix-grpc-daemon (trusted) worker1 # [ 112.159920] nix-daemon[861]: reaped child process 1477, status = succeeded lb # [ 112.146255] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.172375] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.424Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 112.173937] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.426Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 112.169381] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 112.172327] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 112.174618] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 112.178053] niks3-server[1120]: 2026/09/22 16:59:52 INFO Signed narinfos id=46 count=1 worker1 # [ 112.199907] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.181254] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 112.187178] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 112.191128] niks3-server[1120]: 2026/09/22 16:59:52 INFO Completed upload id=46 worker1 # [ 112.211257] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.463Z level=INFO msg="Upload complete. (146ms)" lb # [ 112.192637] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 112.213872] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 112.222374] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 112.224108] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 112.227175] nix-daemon[861]: reaped child process 1456, status = succeeded worker1 # [ 112.265147] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 112.273956] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 112.282651] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.535Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 112.288596] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 112.296886] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 112.380775] nix-daemon[861]: accepted connection from pid 1483, user nix-grpc-daemon (trusted) worker1 # [ 112.394059] nix-daemon[861]: reaped child process 1486, status = succeeded lb # [ 112.378612] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.403406] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.656Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 112.404925] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.657Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 112.395504] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 112.419673] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.672Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.400050] niks3-server[1120]: 2026/09/22 16:59:52 INFO Signed narinfos id=47 count=1 lb # [ 112.402905] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 112.405050] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 112.409439] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 112.413168] niks3-server[1120]: 2026/09/22 16:59:52 INFO Completed upload id=47 worker1 # [ 112.433557] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.686Z level=INFO msg="Upload complete. (129ms)" worker1 # [ 112.435743] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 112.416310] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 112.439295] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 112.446797] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 112.448228] nix-daemon[861]: reaped child process 1481, status = succeeded client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... worker1 # [ 112.453284] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 113.490818] nix-daemon[861]: reaped child process 1490, status = succeeded worker1 # [ 113.573743] nix-daemon[861]: accepted connection from pid 1506, user nix-grpc-daemon (trusted) worker1 # [ 113.585641] nix-daemon[861]: reaped child process 1509, status = succeeded lb # [ 113.571393] niks3-server[1120]: 2026/09/22 16:59:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 113.597117] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.849Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 113.600288] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.851Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 113.593811] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 113.596608] niks3-server[1120]: 2026/09/22 16:59:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 113.598581] niks3-server[1120]: 2026/09/22 16:59:53 INFO Signed narinfos id=48 count=1 worker1 # [ 113.620623] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.600183] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 113.606781] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 113.609317] niks3-server[1120]: 2026/09/22 16:59:53 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 113.612630] niks3-server[1120]: 2026/09/22 16:59:53 INFO Completed upload id=48 worker1 # [ 113.633204] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.885Z level=INFO msg="Upload complete. (173ms)" lb # [ 113.616922] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 113.636289] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 113.645360] nix-daemon[861]: reaped child process 1488, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.60 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.12 seconds) worker2 # [ 113.811887] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 113.815161] systemd[1]: Starting scheduler-token.service... worker2 # [ 113.851779] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 113.853426] systemd[1]: Finished scheduler-token.service. worker2 # [ 113.855258] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 38ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 113.859064] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 113.937116] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 113.939126] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 113.942354] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 113.946721] nix-grpc-daemon[1378]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 113.948092] nix-grpc-daemon[1378]: E0000 00:00:1790096394.239533 1378 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 113.954234] nix-grpc-daemon[1378]: E0000 00:00:1790096394.244939 1378 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.957970] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 113.960837] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 113.962923] nix-grpc-daemon[1378]: E0000 00:00:1790096394.256124 1419 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 113.977066] nix-grpc-daemon[1378]: E0000 00:00:1790096394.270007 1419 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.980222] nix-grpc-daemon[1378]: E0000 00:00:1790096394.270122 1419 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 113.991112] nix-grpc-daemon[1378]: E0000 00:00:1790096394.284244 1419 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 114.002832] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.019191] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 114.024712] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48658 worker1 # [ 114.029404] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.35 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 114.171652] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: e389dd8a68954c73afdf71171879ebc0 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.03 seconds) worker1 # [ 114.298765] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47074 client # [ 114.302910] nix[1361]: don't know how to build these paths: client # [ 114.303839] nix[1361]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 114.312292] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 114.316300] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 114.364660] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 114.376161] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47074 client # [ 114.383263] nix[1361]: copying 1 paths to 'lb:50051'... worker1 # [ 114.386531] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 client # [ 114.385529] nix[1361]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 114.395902] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 114.495514] nix-daemon[861]: accepted connection from pid 1522, user nix-grpc-daemon (trusted) worker1 # [ 114.508267] nix-daemon[861]: reaped child process 1525, status = succeeded lb # [ 114.494129] niks3-server[1120]: 2026/09/22 16:59:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.519125] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.771Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 114.520688] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.773Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 114.510540] niks3-server[1120]: 2026/09/22 16:59:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 114.514231] niks3-server[1120]: 2026/09/22 16:59:54 INFO Signed narinfos id=49 count=1 worker1 # [ 114.534839] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.516787] niks3-server[1120]: 2026/09/22 16:59:54 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 114.521600] niks3-server[1120]: 2026/09/22 16:59:54 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 114.524773] niks3-server[1120]: 2026/09/22 16:59:54 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 114.527712] niks3-server[1120]: 2026/09/22 16:59:54 INFO Completed upload id=49 worker1 # [ 114.549492] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.802Z level=INFO msg="Upload complete. (140ms)" lb # [ 114.529765] niks3-server[1120]: 2026/09/22 16:59:54 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 114.551597] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 114.554446] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 worker1 # [ 114.560537] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 114.564375] nix-daemon[861]: reaped child process 1520, status = succeeded worker1 # [ 114.568777] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) client # [ 114.566332] nix[1361]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb # [ 115.163183] envoy[907]: conn peer=[2001:db8:1::1]:51594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9586 tx=4395 ms=5427 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 116.807927] systemd-journald[283]: Received client request to rotate journal, rotating. worker2 # [ 116.826079] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/1d0a62af5b194d4dbe4a770d60074cbf. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 116.744404] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker1 # [ 117.509625] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:57Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 121.989363] nix-daemon[861]: reaped child process 1529, status = succeeded worker1 # [ 122.062870] nix-daemon[861]: accepted connection from pid 1570, user nix-grpc-daemon (trusted) worker1 # [ 122.075460] nix-daemon[861]: reaped child process 1573, status = succeeded lb # [ 122.063610] niks3-server[1120]: 2026/09/22 17:00:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 122.091912] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.344Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 122.093785] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.346Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 122.107621] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 122.122417] niks3-server[1120]: 2026/09/22 17:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 122.128231] niks3-server[1120]: 2026/09/22 17:00:02 INFO Signed narinfos id=50 count=1 worker1 # [ 122.148756] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.401Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.133693] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 122.145238] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 122.149669] niks3-server[1120]: 2026/09/22 17:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 122.154375] niks3-server[1120]: 2026/09/22 17:00:02 INFO Completed upload id=50 lb # [ 122.156554] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 122.176320] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.428Z level=INFO msg="Upload complete. (193ms)" worker1 # [ 122.184976] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 122.199533] nix-daemon[861]: reaped child process 1527, status = succeeded client # [ 122.210353] systemd[1]: rs.service: Deactivated successfully. client # [ 122.213878] systemd[1]: rs.service: Consumed 126ms CPU time over 8.041s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 122.510225] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:02Z level=info event=signal_exit lb # [ 122.681907] niks3-server[1120]: 2026/09/22 17:00:03 INFO lead: released remote=192.168.1.3:35992 worker2 # [ 123.697410] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:03Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 123.707895] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=scheduler_restarting worker1 # [ 123.712186] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 123.716166] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48658 worker1 # [ 123.719782] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 123.723107] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48658 worker1 # [ 123.726735] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 123.741759] nix-daemon[861]: reaped child process 1382, status = succeeded worker1 # [ 123.795152] nix-grpc-daemon[1330]: E0000 00:00:1790096404.047465 1375 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker1 # [ 123.800502] nix-grpc-daemon[1330]: E0000 00:00:1790096404.047948 1375 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 123.897647] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.901873] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 123.917800] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" lb # [ 123.952397] niks3-server[1120]: 2026/09/22 17:00:04 INFO lead: acquired remote=192.168.1.4:42090 worker2 # [ 123.968070] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_take_over worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.11 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker1 # [ 124.106255] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 124.108871] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 124.102834] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 124.111469] systemd[1]: nix-grpc-daemon.service: Consumed 1.001s CPU time over 28.703s wall clock time, 37.3M memory peak, 48.2K incoming IP traffic, 95.5K outgoing IP traffic. worker2 # [ 124.106694] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker1 # [ 124.127368] systemd[1]: Starting Nix worker-protocol over gRPC... client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 124.221078] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 124.226050] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 124.230207] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 124.232309] nix-grpc-daemon[1580]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 124.233604] nix-grpc-daemon[1580]: E0000 00:00:1790096404.481375 1580 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 124.241065] nix-grpc-daemon[1580]: E0000 00:00:1790096404.489144 1580 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.244101] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 124.247185] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 124.247945] nix-grpc-daemon[1580]: E0000 00:00:1790096404.496228 1621 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 124.257813] nix-grpc-daemon[1580]: E0000 00:00:1790096404.510352 1621 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.262052] nix-grpc-daemon[1580]: E0000 00:00:1790096404.512625 1621 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 124.271731] nix-grpc-daemon[1580]: E0000 00:00:1790096404.524282 1621 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.279281] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 124.280789] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.307868] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.311814] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 124.481358] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 124.483214] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.512573] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.514386] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 124.683696] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 124.685516] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.716482] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.720156] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 124.886633] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.883774] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53816 worker2 # [ 124.888476] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 124.920898] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.930139] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 124.933849] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53816 worker2 # [ 124.937747] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb # [ 125.163642] envoy[907]: conn peer=[2001:db8:1::1]:33334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=1498 ms=7895 lb # [ 125.168499] envoy[907]: conn peer=[2001:db8:1::3]:43162 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4382 tx=1078 ms=28358 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 11.12 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 125.317162] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 844a42eb682c46bfaf562152b2e68c48 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker2 # [ 125.452800] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53826 worker2 # [ 125.463596] nix-daemon[851]: accepted connection from pid 1378, user nix-grpc-daemon (trusted) client # [ 125.481349] nix[1397]: don't know how to build these paths: client # [ 125.482231] nix[1397]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 125.481950] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 125.486392] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 125.546383] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 worker1 # [ 125.557496] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker1 # [ 125.574159] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5) worker1 # [ 125.654946] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 2/5) worker1 # [ 125.680347] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 3/5) worker1 # [ 125.760470] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 527 ms (attempt 4/5) worker1 # [ 126.290255] nix-grpc-daemon[1580]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 126.293176] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 126.309827] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47672 client # [ 126.318116] nix[1397]: copying 1 paths to 'lb:50051'... client # [ 126.321997] nix[1397]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 126.324504] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47672 worker1 # [ 126.333310] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker1 # [ 126.354936] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=info event=niks3_push_started pid=1644 worker1 # [ 126.459226] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.711Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 126.551546] nix-daemon[861]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1 # [ 126.563814] nix-daemon[861]: reaped child process 1663, status = succeeded lb # [ 126.550433] niks3-server[1120]: 2026/09/22 17:00:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 126.579098] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.831Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 126.580560] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.833Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 126.589377] niks3-server[1120]: 2026/09/22 17:00:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 126.595711] niks3-server[1120]: 2026/09/22 17:00:06 INFO Signed narinfos id=51 count=1 worker1 # [ 126.620877] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.603292] niks3-server[1120]: 2026/09/22 17:00:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 126.622435] niks3-server[1120]: 2026/09/22 17:00:06 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 126.635505] niks3-server[1120]: 2026/09/22 17:00:06 INFO Completed upload id=51 worker1 # [ 126.656264] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.908Z level=INFO msg="Upload complete. (193ms)" lb # [ 126.638336] niks3-server[1120]: 2026/09/22 17:00:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo lb # [ 126.641950] niks3-server[1120]: 2026/09/22 17:00:06 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst worker1 # [ 126.662168] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 126.667984] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 worker1 # [ 126.678936] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker1 # [ 126.684691] nix-daemon[861]: reaped child process 1642, status = succeeded worker1 # [ 126.692453] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) client # [ 126.690469] nix[1397]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 127.809798] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1378 (nix-grpc-daemon) on client request. lb # [ 127.812488] niks3-server[1120]: 2026/09/22 17:00:08 INFO lead: released remote=192.168.1.4:42090 worker2 # [ 127.829123] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. worker1 # [ 127.841509] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:08Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" client # [ 127.839880] nix[1397]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 127.838766] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 127.844298] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 127.847863] systemd[1]: nix-grpc-daemon.service: Consumed 199ms CPU time over 13.983s wall clock time, 13.4M memory peak, 10.5K incoming IP traffic, 21K outgoing IP traffic. worker2 # [ 127.864708] systemd[1]: Starting scheduler-token.service... worker2 # [ 127.867459] nix-daemon[851]: reaped child process 1487, status = succeeded worker2 # [ 127.901084] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 127.903116] systemd[1]: Finished scheduler-token.service. worker2 # [ 127.903959] systemd[1]: scheduler-token.service: Consumed 15ms CPU time over 35ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 127.905759] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 127.908586] systemd[1]: Starting scheduler-token.service... worker2 # [ 127.941512] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 127.943097] systemd[1]: Finished scheduler-token.service. worker2 # [ 127.945103] systemd[1]: scheduler-token.service: Consumed 15ms CPU time over 34ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 127.948568] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 128.023802] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 128.025736] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 128.028842] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 128.033051] nix-grpc-daemon[1517]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 128.041703] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.034807] nix-grpc-daemon[1517]: E0000 00:00:1790096408.326204 1517 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 128.040543] nix-grpc-daemon[1517]: E0000 00:00:1790096408.331962 1517 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 128.047109] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 128.050121] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 128.054899] nix-grpc-daemon[1517]: E0000 00:00:1790096408.348097 1556 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 128.043910] niks3-server[1120]: 2026/09/22 17:00:08 INFO lead: acquired remote=192.168.1.4:49284 worker2 # [ 128.058813] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=scheduler_take_over worker2 # [ 128.062096] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53852 worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds) client: must succeed: sleep 5.0 worker2 # [ 128.065105] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=1 worker2 # [ 128.075817] nix-grpc-daemon[1517]: E0000 00:00:1790096408.368931 1556 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 128.081053] nix-grpc-daemon[1517]: E0000 00:00:1790096408.371278 1556 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 128.089903] nix-grpc-daemon[1517]: E0000 00:00:1790096408.383062 1556 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 128.099259] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.104569] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 128.106265] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53852 worker2 # [ 128.107940] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 133.315364] nix-daemon[861]: reaped child process 1667, status = succeeded worker1 # [ 133.381084] nix-daemon[861]: accepted connection from pid 1700, user nix-grpc-daemon (trusted) worker1 # [ 133.394695] nix-daemon[861]: reaped child process 1703, status = succeeded lb # [ 133.376338] niks3-server[1120]: 2026/09/22 17:00:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.406066] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.658Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.407548] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.660Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 133.418995] niks3-server[1120]: 2026/09/22 17:00:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 133.444956] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.697Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.424859] niks3-server[1120]: 2026/09/22 17:00:13 INFO Signed narinfos id=52 count=1 lb # [ 133.438479] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 133.444144] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 133.447977] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 133.456935] niks3-server[1120]: 2026/09/22 17:00:13 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 133.461737] niks3-server[1120]: 2026/09/22 17:00:13 INFO Completed upload id=52 worker1 # [ 133.482453] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.734Z level=INFO msg="Upload complete. (178ms)" lb # [ 133.466556] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 133.488593] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=6 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 133.502370] nix-daemon[861]: reaped child process 1665, status = succeeded client # [ 133.519539] systemd[1]: mid.service: Deactivated successfully. client # [ 133.522968] systemd[1]: mid.service: Consumed 133ms CPU time over 8.205s wall clock time, 41.4M memory peak, 7.6K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.11 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 134.401458] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: dcc8a9c7b95a42e28088988d1737d79e client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) client # [ 134.521153] nix[1433]: don't know how to build these paths: client # [ 134.521970] nix[1433]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 134.522334] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47672 worker2 # [ 134.524994] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:14Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 134.529870] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:14Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 134.570859] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 134.581936] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 134.597805] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5) worker2 # [ 134.650399] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5) worker2 # [ 134.788804] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 212 ms (attempt 3/5) worker2 # [ 135.002875] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 542 ms (attempt 4/5) lb # [ 135.163994] envoy[907]: conn peer=[2001:db8:1::4]:57650 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6128 tx=495 ms=13837 lb # [ 135.168058] envoy[907]: conn peer=[2001:db8:1::1]:47992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3031 tx=1590 ms=8049 worker2 # [ 135.549832] nix-grpc-daemon[1517]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 135.554895] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 135.576189] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 client # [ 135.594619] nix[1433]: copying 1 paths to 'lb:50051'... client # [ 135.598098] nix[1433]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 135.592932] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 135.605735] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 135.625835] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:15Z level=info event=niks3_push_started pid=1595 worker2 # [ 135.714918] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.007Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 135.799088] nix-daemon[851]: accepted connection from pid 1608, user nix-grpc-daemon (trusted) worker2 # [ 135.810380] nix-daemon[851]: reaped child process 1611, status = succeeded lb # [ 135.805108] niks3-server[1120]: 2026/09/22 17:00:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.821908] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.115Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 135.823369] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.116Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 135.827340] niks3-server[1120]: 2026/09/22 17:00:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 135.831200] niks3-server[1120]: 2026/09/22 17:00:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 135.833260] niks3-server[1120]: 2026/09/22 17:00:16 INFO Signed narinfos id=53 count=1 worker2 # [ 135.845790] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.138Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.843622] niks3-server[1120]: 2026/09/22 17:00:16 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 135.850564] niks3-server[1120]: 2026/09/22 17:00:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo lb # [ 135.853789] niks3-server[1120]: 2026/09/22 17:00:16 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 135.857217] niks3-server[1120]: 2026/09/22 17:00:16 INFO Completed upload id=53 worker2 # [ 135.870128] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.163Z level=INFO msg="Upload complete. (152ms)" worker2 # [ 135.872234] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 135.875552] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 135.882118] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 135.884427] nix-daemon[851]: reaped child process 1593, status = succeeded worker2 # [ 135.889525] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) client # [ 135.894711] nix[1433]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 137.852778] systemd[1]: intr.service: Sent signal SIGINT to main process 1433 (nix) on client request. worker2 # [ 137.853734] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 137.858767] nix[1433]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds) client # [ 137.865553] nix[1433]: error: interrupted by the user client # [ 137.900515] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 137.904254] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 137.908611] systemd[1]: intr.service: Consumed 118ms CPU time over 3.502s wall clock time, 39.5M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 137.907759] nix-daemon[851]: reaped child process 1613, status = succeeded worker2 # [ 137.909402] nix-daemon[1615]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 137.916686] nix-daemon[851]: reaped child process 1615, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.56 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 137.960369] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 4341feeffb5d4b4b9142e35a9ddfd9f5 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.03 seconds) worker2 # [ 138.078531] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42300 client # [ 138.090136] nix[1454]: don't know how to build these paths: client # [ 138.090978] nix[1454]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 138.094704] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 138.098814] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 138.146876] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 worker1 # [ 138.160150] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47672 client # [ 138.168409] nix[1454]: copying 1 paths to 'lb:50051'... worker1 # [ 138.172156] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47672 client # [ 138.171157] nix[1454]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 138.185154] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker1 # [ 138.285985] nix-daemon[861]: accepted connection from pid 1731, user nix-grpc-daemon (trusted) worker1 # [ 138.299130] nix-daemon[861]: reaped child process 1734, status = succeeded lb # [ 138.284338] niks3-server[1120]: 2026/09/22 17:00:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.310928] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.563Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.312881] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.564Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 138.313808] niks3-server[1120]: 2026/09/22 17:00:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 138.324275] niks3-server[1120]: 2026/09/22 17:00:18 INFO Signed narinfos id=54 count=1 worker1 # [ 138.348797] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.601Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.330857] niks3-server[1120]: 2026/09/22 17:00:18 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 138.335522] niks3-server[1120]: 2026/09/22 17:00:18 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 138.351108] niks3-server[1120]: 2026/09/22 17:00:18 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 138.357439] niks3-server[1120]: 2026/09/22 17:00:18 INFO Completed upload id=54 lb # [ 138.359299] niks3-server[1120]: 2026/09/22 17:00:18 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 138.378284] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.630Z level=INFO msg="Upload complete. (181ms)" worker1 # [ 138.383421] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 138.389646] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 worker1 # [ 138.399602] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker1 # [ 138.409424] nix-daemon[861]: reaped child process 1729, status = succeeded client # [ 138.410837] nix[1454]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1 # [ 138.413844] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 140.307177] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 140.332806] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 140.510665] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 140.517425] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 140.532613] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 140.538200] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 140.575933] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 140.586965] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 client # copying 1 paths to 'lb:50051'... worker2 # [ 140.597816] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 140.616801] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 140.724463] nix-daemon[851]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 140.737266] nix-daemon[851]: reaped child process 1669, status = succeeded lb # [ 140.731907] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 140.753513] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.045Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 140.754937] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.046Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 140.763661] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker2 # [ 140.782973] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.075Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.770101] niks3-server[1120]: 2026/09/22 17:00:21 INFO Signed narinfos id=55 count=1 lb # [ 140.777978] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 140.784701] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 140.801807] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 140.804310] niks3-server[1120]: 2026/09/22 17:00:21 INFO Completed upload id=55 worker2 # [ 140.817280] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.110Z level=INFO msg="Upload complete. (185ms)" lb # [ 140.808694] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 140.821758] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 140.827990] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 140.838461] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 140.847567] nix-daemon[851]: reaped child process 1664, status = succeeded worker2 # [ 140.851637] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 141.243117] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:21Z level=info event=draining client # farm-a> LOG-farm-a-during-drain worker2 # [ 141.482862] nix-daemon[851]: reaped child process 1673, status = succeeded worker2 # [ 141.561340] nix-daemon[851]: accepted connection from pid 1689, user nix-grpc-daemon (trusted) worker2 # [ 141.573398] nix-daemon[851]: reaped child process 1692, status = succeeded lb # [ 141.568253] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.590207] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.883Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 141.591656] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.884Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 141.608700] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 141.612625] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 141.621904] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker2 # [ 141.639304] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.932Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.626374] niks3-server[1120]: 2026/09/22 17:00:21 INFO Signed narinfos id=56 count=1 lb # [ 141.634493] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 141.638919] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 141.641486] niks3-server[1120]: 2026/09/22 17:00:21 INFO Completed upload id=56 worker2 # [ 141.655685] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.948Z level=INFO msg="Upload complete. (198ms)" lb # [ 141.644221] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 141.661484] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=1 worker2 # [ 141.671767] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 141.675774] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 141.683928] nix-daemon[851]: reaped child process 1671, status = succeeded worker2 # [ 141.715447] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 141.731727] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 141.743804] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.036Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 141.751212] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 141.766127] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 141.861496] nix-daemon[851]: accepted connection from pid 1698, user nix-grpc-daemon (trusted) worker2 # [ 141.873811] nix-daemon[851]: reaped child process 1701, status = succeeded lb # [ 141.870310] niks3-server[1120]: 2026/09/22 17:00:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.892772] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.185Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 141.894272] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.187Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 141.906251] niks3-server[1120]: 2026/09/22 17:00:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 141.911661] niks3-server[1120]: 2026/09/22 17:00:22 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls worker2 # [ 141.933621] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.226Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.920228] niks3-server[1120]: 2026/09/22 17:00:22 INFO Signed narinfos id=57 count=1 lb # [ 141.923445] niks3-server[1120]: 2026/09/22 17:00:22 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 141.936740] niks3-server[1120]: 2026/09/22 17:00:22 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 141.940041] niks3-server[1120]: 2026/09/22 17:00:22 INFO Completed upload id=57 worker2 # [ 141.952826] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.245Z level=INFO msg="Upload complete. (175ms)" lb # [ 141.942263] niks3-server[1120]: 2026/09/22 17:00:22 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 141.957185] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 141.962775] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 141.974138] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 141.983293] nix-daemon[851]: reaped child process 1696, status = succeeded client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... worker2 # [ 141.985720] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 143.223523] nix-daemon[851]: reaped child process 1705, status = succeeded worker2 # [ 143.305954] nix-daemon[851]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker2 # [ 143.318595] nix-daemon[851]: reaped child process 1724, status = succeeded lb # [ 143.311714] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.333723] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 143.335383] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.628Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 143.354832] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 143.361329] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 143.365142] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 143.369773] niks3-server[1120]: 2026/09/22 17:00:23 INFO Signed narinfos id=58 count=1 worker2 # [ 143.385617] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.384736] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 143.389718] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 143.396318] niks3-server[1120]: 2026/09/22 17:00:23 INFO Completed upload id=58 worker2 # [ 143.409259] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.702Z level=INFO msg="Upload complete. (215ms)" lb # [ 143.399872] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 143.411872] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=1 worker2 # [ 143.417850] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 143.420227] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 143.425068] nix-daemon[851]: reaped child process 1703, status = succeeded worker2 # [ 143.461844] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 143.469484] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 143.477075] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.770Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 143.483336] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 143.493723] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 143.579365] nix-daemon[851]: accepted connection from pid 1730, user nix-grpc-daemon (trusted) worker2 # [ 143.592041] nix-daemon[851]: reaped child process 1733, status = succeeded lb # [ 143.587068] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.607346] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.900Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 143.608828] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.902Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 143.620363] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 143.629571] niks3-server[1120]: 2026/09/22 17:00:23 INFO Signed narinfos id=59 count=1 worker2 # [ 143.645611] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.938Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.635621] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 143.642982] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 143.654739] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete worker2 # [ 143.672934] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.966Z level=INFO msg="Upload complete. (173ms)" lb # [ 143.660795] niks3-server[1120]: 2026/09/22 17:00:23 INFO Completed upload id=59 worker2 # [ 143.674937] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 143.664713] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 143.681413] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 143.685188] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 143.687392] nix-daemon[851]: reaped child process 1728, status = succeeded worker2 # [ 143.692474] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 144.307246] nix-daemon[851]: reaped child process 1737, status = succeeded worker2 # [ 144.381067] nix-daemon[851]: accepted connection from pid 1753, user nix-grpc-daemon (trusted) worker2 # [ 144.393742] nix-daemon[851]: reaped child process 1756, status = succeeded lb # [ 144.388389] niks3-server[1120]: 2026/09/22 17:00:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 144.405345] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.698Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 144.406823] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.700Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 144.407910] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 144.411507] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 144.415054] niks3-server[1120]: 2026/09/22 17:00:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 144.418616] niks3-server[1120]: 2026/09/22 17:00:24 INFO Signed narinfos id=60 count=1 worker2 # [ 144.431587] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.724Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.423958] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 144.426409] niks3-server[1120]: 2026/09/22 17:00:24 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 144.429780] niks3-server[1120]: 2026/09/22 17:00:24 INFO Completed upload id=60 worker2 # [ 144.442365] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.735Z level=INFO msg="Upload complete. (144ms)" lb # [ 144.431772] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 144.444909] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=1 worker2 # [ 144.451631] nix-daemon[851]: reaped child process 1735, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.16 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 144.834672] nix-daemon[861]: reaped child process 1738, status = succeeded worker1 # [ 144.902457] nix-daemon[861]: accepted connection from pid 1779, user nix-grpc-daemon (trusted) worker1 # [ 144.916055] nix-daemon[861]: reaped child process 1782, status = succeeded lb # [ 144.894283] niks3-server[1120]: 2026/09/22 17:00:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.923534] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.175Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.924961] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.177Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 144.937415] niks3-server[1120]: 2026/09/22 17:00:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 144.942909] niks3-server[1120]: 2026/09/22 17:00:25 INFO Signed narinfos id=61 count=1 worker1 # [ 144.967610] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.220Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.954874] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 144.960154] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 144.964734] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 144.975871] niks3-server[1120]: 2026/09/22 17:00:25 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 144.979489] niks3-server[1120]: 2026/09/22 17:00:25 INFO Completed upload id=61 worker1 # [ 145.000153] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.252Z level=INFO msg="Upload complete. (174ms)" lb # [ 144.981151] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 145.007365] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=6 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=1 worker1 # [ 145.021392] nix-daemon[861]: reaped child process 1736, status = succeeded client # [ 145.033449] systemd[1]: sw.service: Deactivated successfully. client # [ 145.037655] systemd[1]: sw.service: Consumed 118ms CPU time over 7.075s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.5K outgoing IP traffic. lb # [ 145.166168] envoy[907]: conn peer=[2001:db8:1::1]:53788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3006 tx=853 ms=3361 lb # [ 145.169771] envoy[907]: conn peer=[2001:db8:1::1]:53808 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9551 tx=4366 ms=3992 lb # [ 145.173359] envoy[907]: conn peer=[2001:db8:1::1]:53792 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2945 tx=1498 ms=6931 worker1 # [ 145.246490] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:25Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 147.243368] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53852 worker2 # [ 147.247107] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:27Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 147.254398] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:27Z level=info event=scheduler_restarting worker1 # [ 147.264499] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 147.283663] nix-daemon[861]: reaped child process 1636, status = succeeded worker1 # [ 148.145327] nix-grpc-daemon[1580]: E0000 00:00:1790096428.397598 1625 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 148.150286] nix-grpc-daemon[1580]: E0000 00:00:1790096428.397812 1625 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 148.277255] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 148.281572] systemd[1]: nix-grpc-daemon.service: Consumed 614ms CPU time over 24.152s wall clock time, 35.6M memory peak, 24.9K incoming IP traffic, 35.2K outgoing IP traffic. worker1 # [ 148.295838] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 148.385805] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 148.387842] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 148.391042] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 148.395051] nix-grpc-daemon[1796]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 148.396755] nix-grpc-daemon[1796]: E0000 00:00:1790096428.647619 1796 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.403106] nix-grpc-daemon[1796]: E0000 00:00:1790096428.653042 1796 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.407577] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 148.410346] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 148.412132] nix-grpc-daemon[1796]: E0000 00:00:1790096428.664104 1837 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.425056] nix-grpc-daemon[1796]: E0000 00:00:1790096428.677609 1837 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.428159] nix-grpc-daemon[1796]: E0000 00:00:1790096428.679852 1837 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.66 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 148.440035] nix-grpc-daemon[1796]: E0000 00:00:1790096428.692600 1837 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.452023] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.448201] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:28Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53852 worker2 # [ 148.452098] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 11.64 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 149.722141] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 149.732906] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker2 # [ 149.739113] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 149.776848] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 149.781438] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 149.786086] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 149.789979] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 149.829804] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 149.840799] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5) worker1 # [ 149.864896] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 175 ms (attempt 2/5) worker1 # [ 150.041963] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 3/5) worker1 # [ 150.053424] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 747 ms (attempt 4/5) worker1 # [ 150.808837] nix-grpc-daemon[1796]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 150.812755] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 150.828349] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 150.839923] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 150.851073] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 150.870137] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=info event=niks3_push_started pid=1856 worker1 # [ 150.972495] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.224Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 151.054865] nix-daemon[861]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker1 # [ 151.068468] nix-daemon[861]: reaped child process 1872, status = succeeded lb # [ 151.053580] niks3-server[1120]: 2026/09/22 17:00:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.083530] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.336Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.085070] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.337Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 151.098797] niks3-server[1120]: 2026/09/22 17:00:31 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 151.104881] niks3-server[1120]: 2026/09/22 17:00:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 151.135093] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.387Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.114710] niks3-server[1120]: 2026/09/22 17:00:31 INFO Signed narinfos id=62 count=1 lb # [ 151.125729] niks3-server[1120]: 2026/09/22 17:00:31 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 151.134059] niks3-server[1120]: 2026/09/22 17:00:31 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 151.141212] niks3-server[1120]: 2026/09/22 17:00:31 INFO Completed upload id=62 worker1 # [ 151.161896] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.414Z level=INFO msg="Upload complete. (185ms)" lb # [ 151.143081] niks3-server[1120]: 2026/09/22 17:00:31 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 151.166555] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 151.173324] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 151.183187] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 151.191853] nix-daemon[861]: reaped child process 1854, status = succeeded worker1 # [ 151.195869] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 152.031650] nix-daemon[861]: reaped child process 1876, status = succeeded worker1 # [ 152.113981] nix-daemon[861]: accepted connection from pid 1892, user nix-grpc-daemon (trusted) worker1 # [ 152.126890] nix-daemon[861]: reaped child process 1895, status = succeeded lb # [ 152.111668] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.142159] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.394Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.143859] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.396Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 152.158677] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 152.162103] niks3-server[1120]: 2026/09/22 17:00:32 INFO Signed narinfos id=63 count=1 worker1 # [ 152.182860] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.435Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.164376] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 152.166248] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 152.169137] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 152.176684] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 152.179979] niks3-server[1120]: 2026/09/22 17:00:32 INFO Completed upload id=63 worker1 # [ 152.200317] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.452Z level=INFO msg="Upload complete. (197ms)" lb # [ 152.181706] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker2 # [ 152.197492] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:32Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.204586] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=1 worker2 # [ 152.202189] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:32Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 152.211423] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 152.220315] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 152.222799] nix-daemon[861]: reaped child process 1874, status = succeeded worker1 # [ 152.225911] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 152.229429] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 152.307518] nix-daemon[861]: accepted connection from pid 1899, user nix-grpc-daemon (trusted) worker1 # [ 152.319737] nix-daemon[861]: reaped child process 1902, status = succeeded lb # [ 152.304901] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.334730] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.587Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.336660] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.588Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 152.335757] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 152.339487] niks3-server[1120]: 2026/09/22 17:00:32 INFO Signed narinfos id=64 count=1 worker1 # [ 152.363401] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.615Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.346945] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 152.353640] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 152.362450] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 152.365454] niks3-server[1120]: 2026/09/22 17:00:32 INFO Completed upload id=64 worker1 # [ 152.385983] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.638Z level=INFO msg="Upload complete. (151ms)" lb # [ 152.367873] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 152.388353] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 152.392304] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 152.399088] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 152.400483] nix-daemon[861]: reaped child process 1897, status = succeeded worker1 # [ 152.405711] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 153.632929] nix-daemon[861]: reaped child process 1906, status = succeeded worker1 # [ 153.709181] nix-daemon[861]: accepted connection from pid 1922, user nix-grpc-daemon (trusted) worker1 # [ 153.721281] nix-daemon[861]: reaped child process 1925, status = succeeded lb # [ 153.708789] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.738294] nix-grpc-daemon[1856]: time=2026-09-22T17:00:33.990Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.739891] nix-grpc-daemon[1856]: time=2026-09-22T17:00:33.992Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 153.752130] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 153.759450] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 153.766397] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker1 # [ 153.794103] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.046Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.774102] niks3-server[1120]: 2026/09/22 17:00:34 INFO Signed narinfos id=65 count=1 lb # [ 153.779043] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 153.789223] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 153.796717] niks3-server[1120]: 2026/09/22 17:00:34 INFO Completed upload id=65 lb # [ 153.799060] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 153.818992] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.071Z level=INFO msg="Upload complete. (206ms)" worker2 # [ 153.818285] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:34Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 153.823173] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:34Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 153.826703] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=1 worker1 # [ 153.834538] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 153.845296] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 153.853739] nix-daemon[861]: reaped child process 1904, status = succeeded worker1 # [ 153.856436] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 153.862983] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 153.941887] nix-daemon[861]: accepted connection from pid 1929, user nix-grpc-daemon (trusted) worker1 # [ 153.954806] nix-daemon[861]: reaped child process 1932, status = succeeded lb # [ 153.939311] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.967656] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.969217] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.221Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 153.970753] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 153.976626] niks3-server[1120]: 2026/09/22 17:00:34 INFO Signed narinfos id=66 count=1 worker1 # [ 154.000502] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.252Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.985348] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 153.996152] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 154.005197] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 154.011229] niks3-server[1120]: 2026/09/22 17:00:34 INFO Completed upload id=66 worker1 # [ 154.031559] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.284Z level=INFO msg="Upload complete. (161ms)" lb # [ 154.012922] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 154.035505] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 154.040644] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 154.048546] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 154.055023] nix-daemon[861]: reaped child process 1927, status = succeeded worker1 # [ 154.058993] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 154.897586] nix-daemon[861]: reaped child process 1936, status = succeeded worker1 # [ 154.975588] nix-daemon[861]: accepted connection from pid 1952, user nix-grpc-daemon (trusted) worker1 # [ 154.986985] nix-daemon[861]: reaped child process 1955, status = succeeded lb # [ 154.972466] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.001128] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.253Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.002660] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.255Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 155.015715] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 155.019809] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 155.026461] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 155.033372] niks3-server[1120]: 2026/09/22 17:00:35 INFO Signed narinfos id=67 count=1 worker1 # [ 155.056592] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.308Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.041256] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 155.051852] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 155.054313] niks3-server[1120]: 2026/09/22 17:00:35 INFO Completed upload id=67 worker1 # [ 155.076062] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.328Z level=INFO msg="Upload complete. (210ms)" lb # [ 155.057433] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 155.078748] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=1 worker2 # [ 155.073221] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:35Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.082778] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker2 # [ 155.077854] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:35Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 155.090088] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 155.092320] nix-daemon[861]: reaped child process 1934, status = succeeded worker1 # [ 155.095745] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.348Z level=INFO msg="All 1 paths already cached" worker1 # [ 155.099485] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 155.104192] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 155.186187] nix-daemon[861]: accepted connection from pid 1959, user nix-grpc-daemon (trusted) lb # [ 155.166539] envoy[907]: conn peer=[2001:db8:1::3]:58004 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1762 tx=503 ms=22975 worker1 # [ 155.198721] nix-daemon[861]: reaped child process 1962, status = succeeded lb # [ 155.184596] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.212932] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.465Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.214973] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.467Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 155.214148] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker1 # [ 155.241300] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.493Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.220513] niks3-server[1120]: 2026/09/22 17:00:35 INFO Signed narinfos id=68 count=1 lb # [ 155.228685] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 155.232943] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 155.243651] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 155.250062] niks3-server[1120]: 2026/09/22 17:00:35 INFO Completed upload id=68 worker1 # [ 155.270332] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.522Z level=INFO msg="Upload complete. (161ms)" worker1 # [ 155.272431] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 155.255303] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 155.276338] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 155.286130] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 155.289377] nix-daemon[861]: reaped child process 1957, status = succeeded worker1 # [ 155.294437] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 156.511636] nix-daemon[861]: reaped child process 1966, status = succeeded worker1 # [ 156.582978] nix-daemon[861]: accepted connection from pid 1982, user nix-grpc-daemon (trusted) worker1 # [ 156.597681] nix-daemon[861]: reaped child process 1985, status = succeeded lb # [ 156.581249] niks3-server[1120]: 2026/09/22 17:00:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.609828] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.862Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.611496] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.863Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 156.623146] niks3-server[1120]: 2026/09/22 17:00:36 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 156.630364] niks3-server[1120]: 2026/09/22 17:00:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker1 # [ 156.661339] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.913Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.641118] niks3-server[1120]: 2026/09/22 17:00:36 INFO Signed narinfos id=69 count=1 lb # [ 156.644956] niks3-server[1120]: 2026/09/22 17:00:36 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 156.648662] niks3-server[1120]: 2026/09/22 17:00:36 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 156.661396] niks3-server[1120]: 2026/09/22 17:00:36 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 156.664537] niks3-server[1120]: 2026/09/22 17:00:37 INFO Completed upload id=69 worker1 # [ 156.685281] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.937Z level=INFO msg="Upload complete. (183ms)" lb # [ 156.668026] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 156.690945] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=1 worker2 # [ 156.684709] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:36Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 156.694168] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:36Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 156.705816] nix-daemon[861]: reaped child process 1964, status = succeeded worker1 # [ 156.743334] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 156.756439] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 156.770347] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.022Z level=INFO msg="All 1 paths already cached" worker1 # [ 156.777788] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 156.785886] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 156.883261] nix-daemon[861]: accepted connection from pid 1989, user nix-grpc-daemon (trusted) worker1 # [ 156.895885] nix-daemon[861]: reaped child process 1992, status = succeeded lb # [ 156.881662] niks3-server[1120]: 2026/09/22 17:00:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.909738] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.162Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.911304] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.163Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 156.913072] niks3-server[1120]: 2026/09/22 17:00:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 156.938251] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.190Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.918126] niks3-server[1120]: 2026/09/22 17:00:37 INFO Signed narinfos id=70 count=1 lb # [ 156.925638] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 156.935543] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 156.945055] niks3-server[1120]: 2026/09/22 17:00:37 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 156.950301] niks3-server[1120]: 2026/09/22 17:00:37 INFO Completed upload id=70 worker1 # [ 156.970882] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.223Z level=INFO msg="Upload complete. (171ms)" lb # [ 156.954816] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 156.975546] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 156.981755] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 156.993108] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 157.000362] nix-daemon[861]: reaped child process 1987, status = succeeded worker1 # [ 157.005576] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 158.439814] nix-daemon[861]: reaped child process 1996, status = succeeded worker1 # [ 158.506081] nix-daemon[861]: accepted connection from pid 2012, user nix-grpc-daemon (trusted) worker1 # [ 158.517392] nix-daemon[861]: reaped child process 2015, status = succeeded lb # [ 158.505768] niks3-server[1120]: 2026/09/22 17:00:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.533628] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.786Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.535116] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.787Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 158.542263] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 158.551906] niks3-server[1120]: 2026/09/22 17:00:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 158.557247] niks3-server[1120]: 2026/09/22 17:00:38 INFO Signed narinfos id=71 count=1 worker1 # [ 158.580296] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.832Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.562445] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 158.570879] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 158.574609] niks3-server[1120]: 2026/09/22 17:00:38 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 158.579284] niks3-server[1120]: 2026/09/22 17:00:38 INFO Completed upload id=71 worker1 # [ 158.600045] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.852Z level=INFO msg="Upload complete. (186ms)" lb # [ 158.583437] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker2 # [ 158.599662] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:38Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 158.607121] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=1 worker2 # [ 158.604463] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:38Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 158.613500] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 158.623541] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 158.629933] nix-daemon[861]: reaped child process 1994, status = succeeded worker1 # [ 158.634067] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.886Z level=INFO msg="All 1 paths already cached" worker1 # [ 158.638190] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 158.642910] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 158.727962] nix-daemon[861]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker1 # [ 158.741795] nix-daemon[861]: reaped child process 2022, status = succeeded lb # [ 158.726915] niks3-server[1120]: 2026/09/22 17:00:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.757719] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.010Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.759668] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.011Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 158.759629] niks3-server[1120]: 2026/09/22 17:00:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 158.763812] niks3-server[1120]: 2026/09/22 17:00:39 INFO Signed narinfos id=72 count=1 worker1 # [ 158.786751] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.039Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.768104] niks3-server[1120]: 2026/09/22 17:00:39 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 158.774636] niks3-server[1120]: 2026/09/22 17:00:39 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 158.783550] niks3-server[1120]: 2026/09/22 17:00:39 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 158.787104] niks3-server[1120]: 2026/09/22 17:00:39 INFO Completed upload id=72 worker1 # [ 158.807449] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.060Z level=INFO msg="Upload complete. (159ms)" lb # [ 158.789533] niks3-server[1120]: 2026/09/22 17:00:39 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 158.809587] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 158.812402] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 158.820718] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 158.822131] nix-daemon[861]: reaped child process 2017, status = succeeded worker1 # [ 158.827213] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 159.652420] nix-daemon[861]: reaped child process 2026, status = succeeded worker1 # [ 159.731758] nix-daemon[861]: accepted connection from pid 2042, user nix-grpc-daemon (trusted) worker1 # [ 159.744056] nix-daemon[861]: reaped child process 2045, status = succeeded lb # [ 159.732688] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.761482] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.013Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.762906] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.015Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 159.774396] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign worker1 # [ 159.801491] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.053Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.780764] niks3-server[1120]: 2026/09/22 17:00:40 INFO Signed narinfos id=73 count=1 lb # [ 159.789980] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 159.799111] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 159.804947] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 159.811484] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 159.817176] niks3-server[1120]: 2026/09/22 17:00:40 INFO Completed upload id=73 worker1 # [ 159.837850] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.090Z level=INFO msg="Upload complete. (204ms)" lb # [ 159.819578] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 159.843864] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=1 worker2 # [ 159.837888] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:40Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.852416] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker2 # [ 159.847972] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:40Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 159.866335] nix-daemon[861]: reaped child process 2024, status = succeeded worker1 # [ 159.894094] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 159.906816] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.159Z level=INFO msg="All 2 paths already cached" worker1 # [ 159.914536] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 159.924157] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 160.017407] nix-daemon[861]: accepted connection from pid 2049, user nix-grpc-daemon (trusted) worker1 # [ 160.029801] nix-daemon[861]: reaped child process 2052, status = succeeded lb # [ 160.016759] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.045623] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.298Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.047182] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.299Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 160.050248] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 160.059488] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker1 # [ 160.085160] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.337Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.064937] niks3-server[1120]: 2026/09/22 17:00:40 INFO Signed narinfos id=74 count=1 lb # [ 160.070809] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 160.083360] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 160.089539] niks3-server[1120]: 2026/09/22 17:00:40 INFO Completed upload id=74 worker1 # [ 160.110317] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.362Z level=INFO msg="Upload complete. (174ms)" lb # [ 160.095064] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 160.115499] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 160.121527] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 160.132529] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 160.142286] nix-daemon[861]: reaped child process 2047, status = succeeded worker1 # [ 160.146503] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 160.983344] nix-daemon[861]: reaped child process 2056, status = succeeded worker1 # [ 161.056167] nix-daemon[861]: accepted connection from pid 2072, user nix-grpc-daemon (trusted) worker1 # [ 161.069025] nix-daemon[861]: reaped child process 2075, status = succeeded lb # [ 161.055602] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.084371] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.336Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.085862] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.338Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 161.102373] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 161.107138] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 161.114064] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 161.119351] niks3-server[1120]: 2026/09/22 17:00:41 INFO Signed narinfos id=75 count=1 worker1 # [ 161.140724] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.392Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.125083] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 161.130456] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 161.134751] niks3-server[1120]: 2026/09/22 17:00:41 INFO Completed upload id=75 worker1 # [ 161.155379] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.407Z level=INFO msg="Upload complete. (201ms)" lb # [ 161.136648] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker2 # [ 161.154920] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:41Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.161645] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=1 worker1 # [ 161.169986] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 161.182117] nix-daemon[861]: reaped child process 2054, status = succeeded worker1 # [ 161.211936] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 161.224600] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.477Z level=INFO msg="All 2 paths already cached" worker1 # [ 161.232532] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 161.242157] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 161.337799] nix-daemon[861]: accepted connection from pid 2079, user nix-grpc-daemon (trusted) worker1 # [ 161.351926] nix-daemon[861]: reaped child process 2082, status = succeeded lb # [ 161.336623] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.364701] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.617Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.366690] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.618Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 161.365244] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 161.375150] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 161.401776] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.654Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.381092] niks3-server[1120]: 2026/09/22 17:00:41 INFO Signed narinfos id=76 count=1 lb # [ 161.389632] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 161.398748] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 161.404382] niks3-server[1120]: 2026/09/22 17:00:41 INFO Completed upload id=76 worker1 # [ 161.427215] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.679Z level=INFO msg="Upload complete. (174ms)" lb # [ 161.410550] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 161.431672] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 161.436465] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 161.447108] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 161.451589] nix-daemon[861]: reaped child process 2077, status = succeeded worker1 # [ 161.456584] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 162.688570] nix-daemon[861]: reaped child process 2086, status = succeeded worker1 # [ 162.761548] nix-daemon[861]: accepted connection from pid 2102, user nix-grpc-daemon (trusted) worker1 # [ 162.774281] nix-daemon[861]: reaped child process 2105, status = succeeded lb # [ 162.759821] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.788477] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.040Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 162.789949] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.042Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 162.805855] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 162.809359] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 162.815843] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 162.820582] niks3-server[1120]: 2026/09/22 17:00:43 INFO Signed narinfos id=77 count=1 worker1 # [ 162.841456] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.093Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.833658] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 162.836791] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 162.840351] niks3-server[1120]: 2026/09/22 17:00:43 INFO Completed upload id=77 lb # [ 162.842150] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 162.860907] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.113Z level=INFO msg="Upload complete. (196ms)" worker2 # [ 162.861510] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:43Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.867859] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=1 worker1 # [ 162.883809] nix-daemon[861]: reaped child process 2084, status = succeeded worker1 # [ 162.911954] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 162.924595] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 162.936827] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.189Z level=INFO msg="All 2 paths already cached" worker1 # [ 162.944914] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 162.954157] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 163.046965] nix-daemon[861]: accepted connection from pid 2109, user nix-grpc-daemon (trusted) worker1 # [ 163.059859] nix-daemon[861]: reaped child process 2112, status = succeeded lb # [ 163.045901] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.074429] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.327Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.075892] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.328Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 163.077206] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 163.086345] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 163.090787] niks3-server[1120]: 2026/09/22 17:00:43 INFO Signed narinfos id=78 count=1 worker1 # [ 163.114306] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.366Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.100566] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 163.109474] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete lb # [ 163.115133] niks3-server[1120]: 2026/09/22 17:00:43 INFO Completed upload id=78 worker1 # [ 163.138599] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.391Z level=INFO msg="Upload complete. (173ms)" lb # [ 163.120987] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 163.142836] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 163.147487] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 worker1 # [ 163.157094] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 163.167467] nix-daemon[861]: reaped child process 2107, status = succeeded worker1 # [ 163.170297] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 164.385194] nix-daemon[861]: reaped child process 2116, status = succeeded worker1 # [ 164.459323] nix-daemon[861]: accepted connection from pid 2132, user nix-grpc-daemon (trusted) worker1 # [ 164.470978] nix-daemon[861]: reaped child process 2135, status = succeeded lb # [ 164.457952] niks3-server[1120]: 2026/09/22 17:00:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.487190] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.739Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.488679] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.741Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 164.503118] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 164.510907] niks3-server[1120]: 2026/09/22 17:00:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign worker1 # [ 164.538159] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.790Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.517082] niks3-server[1120]: 2026/09/22 17:00:44 INFO Signed narinfos id=79 count=1 lb # [ 164.524950] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 164.537527] niks3-server[1120]: 2026/09/22 17:00:44 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 164.541713] niks3-server[1120]: 2026/09/22 17:00:44 INFO Completed upload id=79 worker1 # [ 164.562320] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.814Z level=INFO msg="Upload complete. (185ms)" lb # [ 164.543539] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo lb # [ 164.545700] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst worker1 # [ 164.568708] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=1 worker1 # [ 164.581986] nix-daemon[861]: reaped child process 2114, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 164.690735] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: e20864de03324f23b1c664899d31fc26 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics client # [ 164.828398] nix[1534]: don't know how to build these paths: client # [ 164.829239] nix[1534]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 164.821756] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42300 worker1 # [ 164.834623] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2 # [ 164.850937] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:45Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 164.857083] nix[1534]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker lb # [ 165.166243] envoy[907]: conn peer=[2001:db8:1::1]:56068 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26999 tx=12334 ms=14863 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code client # [ 194.858561] nix[1534]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 194.868509] nix[1534]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 194.896367] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 194.899975] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 194.904504] systemd[1]: gpu.service: Consumed 146ms CPU time over 30.209s wall clock time, 37.6M memory peak, 5.2K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.28 seconds) client: must succeed: journalctl -u gpu -o cat lb # [ 195.168634] envoy[907]: conn peer=[2001:db8:1::1]:55728 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=562 ms=30053 client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.73 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.93 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 196.418342] nix-grpc-daemon[1796]: ts=2026-09-22T17:01:16Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 197.460942] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42300 worker1 # [ 197.473086] nix-grpc-daemon[1796]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48888 worker2 # [ 197.487600] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 197.492383] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 197.531767] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 197.544330] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 197.556928] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 197.567905] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 197.668044] nix-daemon[851]: accepted connection from pid 1790, user nix-grpc-daemon (trusted) worker2 # [ 197.680861] nix-daemon[851]: reaped child process 1793, status = succeeded lb # [ 197.674588] niks3-server[1120]: 2026/09/22 17:01:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 197.692473] nix-grpc-daemon[1595]: time=2026-09-22T17:01:17.985Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 197.694386] nix-grpc-daemon[1595]: time=2026-09-22T17:01:17.987Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 197.691145] niks3-server[1120]: 2026/09/22 17:01:18 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 197.698364] niks3-server[1120]: 2026/09/22 17:01:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign lb # [ 197.701109] niks3-server[1120]: 2026/09/22 17:01:18 INFO Signed narinfos id=80 count=1 worker2 # [ 197.716315] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.009Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.705878] niks3-server[1120]: 2026/09/22 17:01:18 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 197.713431] niks3-server[1120]: 2026/09/22 17:01:18 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 197.717083] niks3-server[1120]: 2026/09/22 17:01:18 INFO Completed upload id=80 worker2 # [ 197.729878] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.023Z level=INFO msg="Upload complete. (151ms)" worker2 # [ 197.732059] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 197.734962] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 lb # [ 197.724590] niks3-server[1120]: 2026/09/22 17:01:18 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 197.740583] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 197.745143] nix-daemon[851]: reaped child process 1788, status = succeeded worker2 # [ 197.749721] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 198.591113] nix-daemon[851]: reaped child process 1797, status = succeeded worker2 # [ 198.670337] nix-daemon[851]: accepted connection from pid 1813, user nix-grpc-daemon (trusted) worker2 # [ 198.681269] nix-daemon[851]: reaped child process 1816, status = succeeded lb # [ 198.676100] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 198.693509] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.986Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 198.695076] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.988Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 198.699282] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign worker2 # [ 198.716835] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.009Z level=INFO msg="Uploading 1 narinfos" lb # [ 198.704813] niks3-server[1120]: 2026/09/22 17:01:19 INFO Signed narinfos id=81 count=1 lb # [ 198.708850] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 198.711252] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 198.716069] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 198.718873] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst worker2 # [ 198.734794] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.027Z level=INFO msg="Upload complete. (178ms)" lb # [ 198.722433] niks3-server[1120]: 2026/09/22 17:01:19 INFO Completed upload id=81 lb # [ 198.725247] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 198.737261] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=1 worker2 # [ 198.744277] nix-daemon[851]: reaped child process 1795, status = succeeded worker2 # [ 198.784194] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 198.788590] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 198.793178] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 198.802232] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 198.812631] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.105Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 198.819776] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 198.826139] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 198.911638] nix-daemon[851]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker2 # [ 198.924904] nix-daemon[851]: reaped child process 1825, status = succeeded lb # [ 198.917818] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 198.939396] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.232Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 198.940799] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.234Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 198.948959] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 198.954670] niks3-server[1120]: 2026/09/22 17:01:19 INFO Signed narinfos id=82 count=1 worker2 # [ 198.973929] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.267Z level=INFO msg="Uploading 1 narinfos" lb # [ 198.962160] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 198.968648] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 198.980513] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 198.983896] niks3-server[1120]: 2026/09/22 17:01:19 INFO Completed upload id=82 worker2 # [ 198.996757] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.289Z level=INFO msg="Upload complete. (162ms)" lb # [ 198.986389] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 199.000427] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 199.005334] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 199.014354] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 199.019874] nix-daemon[851]: reaped child process 1820, status = succeeded worker2 # [ 199.024050] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 199.838211] nix-daemon[851]: reaped child process 1829, status = succeeded worker2 # [ 199.911684] nix-daemon[851]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker2 # [ 199.923387] nix-daemon[851]: reaped child process 1848, status = succeeded lb # [ 199.917508] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.938713] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.231Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 199.940494] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.233Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 199.960848] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 199.966798] niks3-server[1120]: 2026/09/22 17:01:20 INFO Signed narinfos id=83 count=1 worker2 # [ 199.983424] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.276Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.977492] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 199.983132] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 199.989245] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 200.000539] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 200.008539] niks3-server[1120]: 2026/09/22 17:01:20 INFO Completed upload id=83 lb # [ 200.009792] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 200.021445] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.314Z level=INFO msg="Upload complete. (191ms)" worker2 # [ 200.032293] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=1 worker2 # [ 200.040405] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 200.045296] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 200.054936] nix-daemon[851]: reaped child process 1827, status = succeeded worker2 # [ 200.083361] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 200.095848] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 200.109065] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.402Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 200.119417] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 200.127730] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 200.225155] nix-daemon[851]: accepted connection from pid 1854, user nix-grpc-daemon (trusted) worker2 # [ 200.239794] nix-daemon[851]: reaped child process 1857, status = succeeded lb # [ 200.232081] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.252678] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.545Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 200.254196] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.547Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 200.263101] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign worker2 # [ 200.286207] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.579Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.273692] niks3-server[1120]: 2026/09/22 17:01:20 INFO Signed narinfos id=84 count=1 lb # [ 200.278914] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 200.283941] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 200.297122] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 200.303699] niks3-server[1120]: 2026/09/22 17:01:20 INFO Completed upload id=84 worker2 # [ 200.316698] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.609Z level=INFO msg="Upload complete. (175ms)" worker2 # [ 200.320833] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 200.309371] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 200.326165] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 worker2 # [ 200.336137] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) worker2 # [ 200.344266] nix-daemon[851]: reaped child process 1852, status = succeeded worker2 # [ 200.349183] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 201.587272] nix-daemon[851]: reaped child process 1861, status = succeeded worker2 # [ 201.670074] nix-daemon[851]: accepted connection from pid 1877, user nix-grpc-daemon (trusted) worker2 # [ 201.683041] nix-daemon[851]: reaped child process 1880, status = succeeded lb # [ 201.676949] niks3-server[1120]: 2026/09/22 17:01:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 201.694239] nix-grpc-daemon[1595]: time=2026-09-22T17:01:21.987Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 201.695771] nix-grpc-daemon[1595]: time=2026-09-22T17:01:21.988Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 201.699073] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 201.701824] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 201.703842] niks3-server[1120]: 2026/09/22 17:01:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign lb # [ 201.706264] niks3-server[1120]: 2026/09/22 17:01:22 INFO Signed narinfos id=85 count=1 worker2 # [ 201.719267] nix-grpc-daemon[1595]: time=2026-09-22T17:01:22.012Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.709470] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 201.713757] niks3-server[1120]: 2026/09/22 17:01:22 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 201.718258] niks3-server[1120]: 2026/09/22 17:01:22 INFO Completed upload id=85 worker2 # [ 201.730937] nix-grpc-daemon[1595]: time=2026-09-22T17:01:22.024Z level=INFO msg="Upload complete. (173ms)" lb # [ 201.722054] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 201.734257] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=1 worker2 # [ 201.741287] nix-daemon[851]: reaped child process 1859, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 4.45 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 202.419637] nix-grpc-daemon[1796]: ts=2026-09-22T17:01:22Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.09 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 7.82 seconds) (finished: run the VM test script, in 204.02 seconds) test script finished in 204.17s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T17:01:24Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T17:01:24Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T17:01:24Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.07 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh