tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) client # Formatting '/build/vm-state-client/tmp.aMRXmqMcSt', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: 9015bf7c-119a-4136-b544-1ca8f2659424 client # Superblock backups stored on blocks: client # 32768, 98304, 163840, 229376 client # client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done client # client # Virtualisation disk image created. client # Starting virtiofs daemons... client # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 50) worker1 # Formatting '/build/vm-state-worker1/tmp.coeHc2uJCp', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 64106a2a-e6ea-4ade-9149-0aa75911ce23 worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. worker1 # Starting virtiofs daemons... worker1 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 51) lb # Formatting '/build/vm-state-lb/tmp.iA0XHVnSzH', fmt=raw size=1073741824 worker1 # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done worker1 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # Filesystem UUID: 07335991-04c2-49b5-b1b4-54c37da3080a worker1 # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Superblock backups stored on blocks: worker1 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # 32768, 98304, 163840, 229376 worker1 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # worker1 # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Allocating group tables: 0/8 done worker1 # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests lb # Writing inode tables: 0/8 done worker1 # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests lb # Creating journal (8192 blocks): done worker1 # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 52) worker2 # Formatting '/build/vm-state-worker2/tmp.x9OtHfwvN0', fmt=raw size=1073741824 lb # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Discarding device blocks: 0/262144 done lb # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # Filesystem UUID: f16a84ab-7980-4d0e-a794-679d69a5229f lb # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Superblock backups stored on blocks: lb # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # 32768, 98304, 163840, 229376 lb # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # lb # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests worker2 # Allocating group tables: 0/8 done lb # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests worker2 # Writing inode tables: 0/8 done lb # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests worker2 # Creating journal (8192 blocks): done (finished: start all VMs, in 0.29 seconds) worker2 # Writing superblocks and filesystem accounting information: 0/8 done client: waiting for unit network-addresses-eth1.service worker2 # client: waiting for the VM to finish booting worker2 # Virtualisation disk image created. worker2 # Starting virtiofs daemons... worker2 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-25T16:49:39Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-25T16:49:39Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-25T16:49:39Z INFO virtiofsd] Client connected, servicing requests worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # worker1 # lb # lb # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker2 # worker2 # lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # worker1 # Booting from ROM... lb # Booting from ROM... worker2 # Booting from ROM... client # Booting from ROM... worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xi6vvckx9rwwnrsyw13p0hn9l4ymyaqm-nixos-system-worker1-test/init regInfo=/nix/store/0crbgjyg4d9ilxgszl4bmvhb2biinlkn-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i0c2a3l8xkam6y95ah3pciy5d6i6rs74-nixos-system-worker2-test/init regInfo=/nix/store/5gpdilpnzviwpqhacyfc0v04nf2rz70p-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] kvm-clock: using sched offset of 475296145 cycles worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test/init regInfo=/nix/store/q8bf3j9221ah2d8xbgfry1x0xgb7nh6i-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000809] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.002738] Using GB pages for direct mapping client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.002861] RAMDISK: [mem 0x5e370000-0x5ffcffff] lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.002869] ACPI: Early table checksum verification disabled worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.002872] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.002875] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] kvm-clock: using sched offset of 487228444 cycles client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.002879] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.002886] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000004] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.002888] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.002890] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.002891] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.002717] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.002893] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.002729] Using GB pages for direct mapping client # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002874] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002894] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.002882] ACPI: Early table checksum verification disabled client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.002896] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.000000] kvm-clock: using sched offset of 462093309 cycles worker2 # [ 0.002885] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] kvm-clock: using sched offset of 475598181 cycles worker1 # [ 0.002897] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.002888] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002897] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.002892] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002898] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002898] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002899] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.002901] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.002899] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002902] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002899] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.002730] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.003123] No NUMA configuration found client # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002742] Using GB pages for direct mapping client # [ 0.002748] Using GB pages for direct mapping worker2 # [ 0.002904] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003124] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.002903] RAMDISK: [mem 0x5e36e000-0x5ffcffff] client # [ 0.002909] RAMDISK: [mem 0x5e370000-0x5ffcffff] lb # [ 0.002912] ACPI: Early table checksum verification disabled worker2 # [ 0.002906] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003126] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.002918] ACPI: Early table checksum verification disabled worker1 # [ 0.005796] Zone ranges: lb # [ 0.002915] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.002921] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002907] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005798] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.002919] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005799] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.002908] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.002925] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005801] Normal empty worker1 # [ 0.005801] Device empty lb # [ 0.002923] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002909] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.002928] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005802] Movable zone start for each node worker1 # [ 0.005803] Early memory node ranges worker2 # [ 0.002910] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.002930] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002935] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005803] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.002932] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.002910] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002937] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.005804] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.002911] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.002934] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002939] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005805] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.002911] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.002935] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005825] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.002941] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002912] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.006088] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.002937] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003130] No NUMA configuration found client # [ 0.002942] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.032724] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.003131] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.002938] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033174] ACPI: PM-Timer IO Port: 0x608 client # [ 0.002944] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003134] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.033185] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.002940] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.005455] Zone ranges: client # [ 0.002945] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.033212] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.005455] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.002941] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.002946] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.033214] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.005457] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.002941] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002946] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.005458] Normal empty worker1 # [ 0.033216] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.005459] Device empty lb # [ 0.002942] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002947] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.005459] Movable zone start for each node worker1 # [ 0.033217] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.005460] Early memory node ranges lb # [ 0.002942] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.002947] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.033218] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.005460] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.002943] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.002948] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.033219] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.005461] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.002943] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.002948] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.033221] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.005462] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.003182] No NUMA configuration found client # [ 0.003181] No NUMA configuration found worker1 # [ 0.033222] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.005481] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.003183] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.003182] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.033226] TSC deadline timer available worker2 # [ 0.005749] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.003184] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.003186] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.033230] CPU topo: Max. logical packages: 1 client # [ 0.005600] Zone ranges: lb # [ 0.005960] Zone ranges: worker1 # [ 0.033230] CPU topo: Max. logical dies: 1 worker2 # [ 0.032436] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.032897] ACPI: PM-Timer IO Port: 0x608 client # [ 0.005600] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.005961] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.033231] CPU topo: Max. dies per package: 1 worker1 # [ 0.033234] CPU topo: Max. threads per core: 1 worker2 # [ 0.032908] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.005963] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.005602] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.005603] Normal empty worker1 # [ 0.033235] CPU topo: Num. cores per package: 1 lb # [ 0.005964] Normal empty client # [ 0.005604] Device empty lb # [ 0.005965] Device empty worker2 # [ 0.032934] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.033235] CPU topo: Num. threads per package: 1 client # [ 0.005605] Movable zone start for each node lb # [ 0.005965] Movable zone start for each node worker2 # [ 0.032936] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.033235] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.005606] Early memory node ranges lb # [ 0.005966] Early memory node ranges worker2 # [ 0.032938] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.005606] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.005967] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.033253] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.032939] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.005968] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.005607] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.033283] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.032940] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.005608] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.005969] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.033284] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.005632] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.032941] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.005989] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.033286] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.005902] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.006276] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.032944] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.033287] Booting paravirtualized kernel on KVM client # [ 0.034053] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.032945] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.034488] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.032948] TSC deadline timer available lb # [ 0.034953] ACPI: PM-Timer IO Port: 0x608 client # [ 0.034520] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.033290] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.032952] CPU topo: Max. logical packages: 1 client # [ 0.034533] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.034964] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.032953] CPU topo: Max. logical dies: 1 worker1 # [ 0.037756] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.034570] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.034994] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.032953] CPU topo: Max. dies per package: 1 worker1 # [ 0.039851] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.034572] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.032956] CPU topo: Max. threads per core: 1 lb # [ 0.034996] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.039893] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.032957] CPU topo: Num. cores per package: 1 lb # [ 0.034998] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.034574] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.032957] CPU topo: Num. threads per package: 1 client # [ 0.034575] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.035000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.032958] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.034576] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.035001] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.032976] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.034577] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.035001] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.033005] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.034579] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.039895] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xi6vvckx9rwwnrsyw13p0hn9l4ymyaqm-nixos-system-worker1-test/init regInfo=/nix/store/0crbgjyg4d9ilxgszl4bmvhb2biinlkn-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.035004] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.034580] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.033007] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.035005] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.034584] TSC deadline timer available lb # [ 0.035008] TSC deadline timer available worker2 # [ 0.033008] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.034588] CPU topo: Max. logical packages: 1 lb # [ 0.035012] CPU topo: Max. logical packages: 1 worker1 # [ 0.039986] Unknown kernel command line parameters "regInfo=/nix/store/0crbgjyg4d9ilxgszl4bmvhb2biinlkn-closure-info/registration", will be passed to user space. worker2 # [ 0.033009] Booting paravirtualized kernel on KVM client # [ 0.034589] CPU topo: Max. logical dies: 1 worker1 # [ 0.039999] random: crng init done lb # [ 0.035013] CPU topo: Max. logical dies: 1 client # [ 0.034589] CPU topo: Max. dies per package: 1 lb # [ 0.035013] CPU topo: Max. dies per package: 1 worker1 # [ 0.040000] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.033012] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.034592] CPU topo: Max. threads per core: 1 lb # [ 0.035016] CPU topo: Max. threads per core: 1 client # [ 0.034593] CPU topo: Num. cores per package: 1 worker2 # [ 0.037484] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.042064] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.035017] CPU topo: Num. cores per package: 1 client # [ 0.034593] CPU topo: Num. threads per package: 1 lb # [ 0.035017] CPU topo: Num. threads per package: 1 worker2 # [ 0.039594] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.043096] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.034593] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.035017] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.039635] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.043126] Fallback order for Node 0: 0 client # [ 0.034613] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.035039] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.043129] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.043130] Policy zone: DMA32 client # [ 0.034645] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.035068] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.045710] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.034647] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.035070] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.048741] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.034648] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.051961] allocated 3145728 bytes of page_ext lb # [ 0.035071] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.034650] Booting paravirtualized kernel on KVM worker2 # [ 0.039636] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i0c2a3l8xkam6y95ah3pciy5d6i6rs74-nixos-system-worker2-test/init regInfo=/nix/store/5gpdilpnzviwpqhacyfc0v04nf2rz70p-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.061722] ftrace: allocating 48787 entries in 192 pages lb # [ 0.035073] Booting paravirtualized kernel on KVM worker1 # [ 0.061724] ftrace: allocated 192 pages with 2 groups client # [ 0.034653] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.062532] Dynamic Preempt: lazy lb # [ 0.035076] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.039728] Unknown kernel command line parameters "regInfo=/nix/store/5gpdilpnzviwpqhacyfc0v04nf2rz70p-closure-info/registration", will be passed to user space. worker1 # [ 0.062659] rcu: Preemptible hierarchical RCU implementation. client # [ 0.039137] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.039741] random: crng init done lb # [ 0.039560] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.062660] rcu: RCU event tracing is enabled. client # [ 0.041706] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.039741] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.041831] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.062661] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.041752] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.041877] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.041824] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.062662] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.062662] Rude variant of Tasks RCU enabled. worker1 # [ 0.062663] Tracing variant of Tasks RCU enabled. worker2 # [ 0.043079] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.043108] Fallback order for Node 0: 0 worker1 # [ 0.062663] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.043111] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.043112] Policy zone: DMA32 worker1 # [ 0.062664] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.041754] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test/init regInfo=/nix/store/q8bf3j9221ah2d8xbgfry1x0xgb7nh6i-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.045573] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.041879] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.062674] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.048602] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.051816] allocated 3145728 bytes of page_ext worker1 # [ 0.062676] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.041851] Unknown kernel command line parameters "regInfo=/nix/store/q8bf3j9221ah2d8xbgfry1x0xgb7nh6i-closure-info/registration", will be passed to user space. lb # [ 0.041975] Unknown kernel command line parameters "regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration", will be passed to user space. client # [ 0.041863] random: crng init done worker2 # [ 0.061414] ftrace: allocating 48787 entries in 192 pages lb # [ 0.041987] random: crng init done worker1 # [ 0.062677] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.061416] ftrace: allocated 192 pages with 2 groups client # [ 0.041864] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.062241] Dynamic Preempt: lazy lb # [ 0.041987] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.067069] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.062400] rcu: Preemptible hierarchical RCU implementation. client # [ 0.044103] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.067347] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.044226] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.062400] rcu: RCU event tracing is enabled. client # [ 0.045226] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.045351] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.062401] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.067353] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.045257] Fallback order for Node 0: 0 lb # [ 0.045383] Fallback order for Node 0: 0 worker2 # [ 0.062402] Trampoline variant of Tasks RCU enabled. client # [ 0.045260] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.062403] Rude variant of Tasks RCU enabled. client # [ 0.045261] Policy zone: DMA32 lb # [ 0.045386] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.067452] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.062403] Tracing variant of Tasks RCU enabled. lb # [ 0.045387] Policy zone: DMA32 worker1 # [ 0.070995] Console: colour VGA+ 80x25 client # [ 0.047898] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.070998] printk: legacy console [tty0] enabled lb # [ 0.048286] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.062404] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.051293] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.100374] printk: legacy console [ttyS0] enabled client # [ 0.055084] allocated 3145728 bytes of page_ext worker2 # [ 0.062404] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.051647] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.195858] ACPI: Core revision 20250807 lb # [ 0.055147] allocated 3145728 bytes of page_ext client # [ 0.065026] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.062426] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.065141] ftrace: allocating 48787 entries in 192 pages client # [ 0.065028] ftrace: allocated 192 pages with 2 groups client # [ 0.065880] Dynamic Preempt: lazy lb # [ 0.065143] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.196705] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.066015] Dynamic Preempt: lazy worker2 # [ 0.062427] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.066011] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.198177] APIC: Switch to symmetric I/O mode setup lb # [ 0.066151] rcu: Preemptible hierarchical RCU implementation. client # [ 0.066012] rcu: RCU event tracing is enabled. worker2 # [ 0.062428] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.066151] rcu: RCU event tracing is enabled. worker1 # [ 0.199102] x2apic enabled client # [ 0.066012] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.067026] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.066152] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.066014] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.199831] APIC: Switched APIC routing to: physical x2apic client # [ 0.066014] Rude variant of Tasks RCU enabled. worker2 # [ 0.067308] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.066153] Trampoline variant of Tasks RCU enabled. lb # [ 0.066154] Rude variant of Tasks RCU enabled. client # [ 0.066015] Tracing variant of Tasks RCU enabled. lb # [ 0.066154] Tracing variant of Tasks RCU enabled. worker2 # [ 0.067314] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.066015] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.201607] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.066155] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.066016] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.067413] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.070926] Console: colour VGA+ 80x25 lb # [ 0.066155] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.066077] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.202546] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.070929] printk: legacy console [tty0] enabled worker2 # [ 0.100326] printk: legacy console [ttyS0] enabled lb # [ 0.066216] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.066079] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.196032] ACPI: Core revision 20250807 worker1 # [ 0.204104] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.066218] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.066079] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.206187] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.066219] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.070513] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.196923] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.207234] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.070653] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.070792] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.198400] APIC: Switch to symmetric I/O mode setup lb # [ 0.070934] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.208101] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.199325] x2apic enabled client # [ 0.070800] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.070942] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.200050] APIC: Switched APIC routing to: physical x2apic client # [ 0.070906] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.209104] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.074436] Console: colour VGA+ 80x25 lb # [ 0.071052] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.074438] printk: legacy console [tty0] enabled lb # [ 0.074586] Console: colour VGA+ 80x25 worker1 # [ 0.210101] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.103870] printk: legacy console [ttyS0] enabled worker2 # [ 0.201830] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.074589] printk: legacy console [tty0] enabled lb # [ 0.104071] printk: legacy console [ttyS0] enabled client # [ 0.198604] ACPI: Core revision 20250807 worker1 # [ 0.212101] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.200139] ACPI: Core revision 20250807 worker2 # [ 0.202795] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.213101] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.199491] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.214101] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.204423] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.201039] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.200992] APIC: Switch to symmetric I/O mode setup client # [ 0.201923] x2apic enabled lb # [ 0.202545] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.206506] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.203508] x2apic enabled client # [ 0.202656] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.207531] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.204289] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.208414] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.215101] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.204423] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.217107] Spectre V2 : Enabling IBPB for BPF lb # [ 0.206130] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.209418] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.205371] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.218623] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.210414] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.219101] active return thunk: srso_alias_return_thunk lb # [ 0.207119] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.206942] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.211414] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.220726] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.208779] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.209028] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.212414] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.221964] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.210115] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.209864] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.213414] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.222827] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.210939] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.210954] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.223822] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.212474] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.224101] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.211943] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.225101] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.213533] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.212939] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.214414] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.226100] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.213939] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.216420] Spectre V2 : Enabling IBPB for BPF lb # [ 0.214776] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.227984] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.214939] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.215776] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.217415] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.228805] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.215939] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.217476] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.218414] active return thunk: srso_alias_return_thunk worker1 # [ 0.229801] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.218454] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.230100] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.219435] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.231100] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.220414] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.216939] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.222201] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.232100] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.218947] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.223154] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.218776] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.224170] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.220449] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.220784] Spectre V2 : Enabling IBPB for BPF client # [ 0.221939] active return thunk: srso_alias_return_thunk worker2 # [ 0.225152] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.221777] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.222783] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.226213] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.222776] active return thunk: srso_alias_return_thunk client # [ 0.223939] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.227414] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.224429] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.224939] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.228414] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.225682] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.225939] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.229352] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.226536] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.226939] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.230414] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.227776] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.227939] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.231414] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.228776] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.228939] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.232355] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.229776] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.229940] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.230776] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.230939] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.231939] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.231776] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.232939] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.232776] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.233939] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.233776] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.234775] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.234939] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.235776] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.236776] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.266016] Freeing SMP alternatives memory: 44K worker1 # [ 0.266662] pid_max: default: 32768 minimum: 301 worker1 # [ 0.267187] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.268204] landlock: Up and running. worker1 # [ 0.269101] Yama: becoming mindful. worker1 # [ 0.270196] LSM support for eBPF active worker1 # [ 0.270952] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.272145] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.274719] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.266490] Freeing SMP alternatives memory: 44K worker2 # [ 0.267299] pid_max: default: 32768 minimum: 301 worker1 # [ 0.275670] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.276106] ... version: 2 worker2 # [ 0.268068] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.276810] ... bit width: 48 worker2 # [ 0.268505] landlock: Up and running. worker1 # [ 0.277103] ... generic counters: 6 worker2 # [ 0.269874] Yama: becoming mindful. worker1 # [ 0.277788] ... generic bitmap: 000000000000003f worker2 # [ 0.270629] LSM support for eBPF active worker1 # [ 0.278108] ... fixed-purpose counters: 0 worker1 # [ 0.278811] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.271513] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.279103] ... value mask: 0000ffffffffffff client # [ 0.269836] Freeing SMP alternatives memory: 44K worker2 # [ 0.272460] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.279974] ... max period: 00007fffffffffff client # [ 0.270497] pid_max: default: 32768 minimum: 301 worker1 # [ 0.280743] ... global_ctrl mask: 000000000000003f client # [ 0.271059] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.281199] signal: max sigframe size: 3376 client # [ 0.272059] landlock: Up and running. worker2 # [ 0.275204] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.272761] Freeing SMP alternatives memory: 44K worker1 # [ 0.281961] rcu: Hierarchical SRCU implementation. client # [ 0.272939] Yama: becoming mindful. lb # [ 0.273329] pid_max: default: 32768 minimum: 301 worker1 # [ 0.282665] rcu: Max phase no-delay instances is 400. client # [ 0.273979] LSM support for eBPF active worker2 # [ 0.275944] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.273881] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.276419] ... version: 2 client # [ 0.274720] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.274883] landlock: Up and running. worker2 # [ 0.277104] ... bit width: 48 lb # [ 0.276219] Yama: becoming mindful. worker2 # [ 0.277416] ... generic counters: 6 client # [ 0.275818] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.276990] LSM support for eBPF active worker2 # [ 0.278138] ... generic bitmap: 000000000000003f worker2 # [ 0.278462] ... fixed-purpose counters: 0 lb # [ 0.277926] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.278223] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.279193] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.287650] smp: Bringing up secondary CPUs ... lb # [ 0.278823] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.288117] smp: Brought up 1 node, 1 CPU worker2 # [ 0.279417] ... value mask: 0000ffffffffffff client # [ 0.279530] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.280328] ... max period: 00007fffffffffff worker1 # [ 0.288780] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.279947] ... version: 2 worker2 # [ 0.281136] ... global_ctrl mask: 000000000000003f client # [ 0.280617] ... bit width: 48 worker2 # [ 0.281548] signal: max sigframe size: 3376 lb # [ 0.281876] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.280942] ... generic counters: 6 worker1 # [ 0.289259] Memory: 1454588K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) client # [ 0.281614] ... generic bitmap: 000000000000003f worker2 # [ 0.282333] rcu: Hierarchical SRCU implementation. worker1 # [ 0.290324] devtmpfs: initialized client # [ 0.281941] ... fixed-purpose counters: 0 worker2 # [ 0.283015] rcu: Max phase no-delay instances is 400. lb # [ 0.283375] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.291129] x86/mm: Memory block size: 128MB client # [ 0.282608] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.283785] ... version: 2 lb # [ 0.284529] ... bit width: 48 client # [ 0.282941] ... value mask: 0000ffffffffffff lb # [ 0.284779] ... generic counters: 6 client # [ 0.283806] ... max period: 00007fffffffffff worker1 # [ 0.292877] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.285511] ... generic bitmap: 000000000000003f client # [ 0.284586] ... global_ctrl mask: 000000000000003f lb # [ 0.285779] ... fixed-purpose counters: 0 worker1 # [ 0.293973] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.285053] signal: max sigframe size: 3376 lb # [ 0.286502] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.285866] rcu: Hierarchical SRCU implementation. worker1 # [ 0.295190] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.287974] smp: Bringing up secondary CPUs ... lb # [ 0.286778] ... value mask: 0000ffffffffffff client # [ 0.286488] rcu: Max phase no-delay instances is 400. worker2 # [ 0.288429] smp: Brought up 1 node, 1 CPU worker1 # [ 0.296333] PM: RTC time: 16:49:39, date: 2026-09-25 lb # [ 0.287632] ... max period: 00007fffffffffff worker2 # [ 0.289075] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.288457] ... global_ctrl mask: 000000000000003f lb # [ 0.288884] signal: max sigframe size: 3376 lb # [ 0.289702] rcu: Hierarchical SRCU implementation. worker2 # [ 0.289570] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) worker1 # [ 0.299756] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.290380] rcu: Max phase no-delay instances is 400. worker2 # [ 0.290659] devtmpfs: initialized worker2 # [ 0.291519] x86/mm: Memory block size: 128MB client # [ 0.291562] smp: Bringing up secondary CPUs ... worker1 # [ 0.300598] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.291954] smp: Brought up 1 node, 1 CPU worker1 # [ 0.301124] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.292604] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.293303] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.302375] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.303113] audit: initializing netlink subsys (disabled) worker2 # [ 0.294372] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.293107] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) lb # [ 0.295444] smp: Bringing up secondary CPUs ... worker2 # [ 0.295497] pinctrl core: initialized pinctrl subsystem client # [ 0.294210] devtmpfs: initialized worker1 # [ 0.304179] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.295801] smp: Brought up 1 node, 1 CPU client # [ 0.295026] x86/mm: Memory block size: 128MB worker1 # [ 0.304181] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.296635] PM: RTC time: 16:49:39, date: 2026-09-25 lb # [ 0.296498] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.305094] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.305802] thermal_sys: Registered thermal governor 'user_space' client # [ 0.296783] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.296933] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) worker1 # [ 0.306107] audit: type=2000 audit(1790354980.020:1): state=initialized audit_enabled=0 res=1 client # [ 0.297789] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.298052] devtmpfs: initialized worker2 # [ 0.300059] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.308097] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.298992] pinctrl core: initialized pinctrl subsystem lb # [ 0.298848] x86/mm: Memory block size: 128MB worker1 # [ 0.308116] cpuidle: using governor menu worker2 # [ 0.300913] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.300071] PM: RTC time: 16:49:39, date: 2026-09-25 worker1 # [ 0.310113] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.301438] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.300582] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.311326] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.302691] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.301695] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.303426] audit: initializing netlink subsys (disabled) worker1 # [ 0.312106] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.302859] pinctrl core: initialized pinctrl subsystem client # [ 0.303926] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.313115] PCI: Using configuration type 1 for base access lb # [ 0.304010] PM: RTC time: 16:49:39, date: 2026-09-25 worker2 # [ 0.304627] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.304629] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.305240] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.314248] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.305980] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.305435] audit: type=2000 audit(1790354980.030:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.307418] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.307697] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.307236] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.307420] thermal_sys: Registered thermal governor 'user_space' client # [ 0.307953] audit: initializing netlink subsys (disabled) worker2 # [ 0.308393] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.309021] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.309077] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.309174] cpuidle: using governor menu worker1 # [ 0.319342] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.309801] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.309079] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.320104] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.310629] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.309942] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.311068] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.310872] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.311789] audit: initializing netlink subsys (disabled) worker2 # [ 0.311645] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.311669] audit: type=2000 audit(1790354980.038:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.312419] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.312908] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.312944] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.313428] PCI: Using configuration type 1 for base access lb # [ 0.312911] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.312959] cpuidle: using governor menu lb # [ 0.313779] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.325104] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.314496] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.314692] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.326103] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.315222] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.315518] audit: type=2000 audit(1790354980.040:1): state=initialized audit_enabled=0 res=1 client # [ 0.316173] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.316781] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.316944] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.316794] cpuidle: using governor menu client # [ 0.317961] PCI: Using configuration type 1 for base access lb # [ 0.319043] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.319167] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.320032] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.321432] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.320782] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.322417] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.321792] PCI: Using configuration type 1 for base access lb # [ 0.322922] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.336530] ACPI: Added _OSI(Module Device) worker1 # [ 0.337106] ACPI: Added _OSI(Processor Device) client # [ 0.324177] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.337822] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.324943] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.327418] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.328417] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.328057] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.328779] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.329942] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.330941] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.346652] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.333780] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.334778] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.338741] ACPI: Added _OSI(Module Device) worker2 # [ 0.339418] ACPI: Added _OSI(Processor Device) worker1 # [ 0.350356] ACPI: Interpreter enabled worker2 # [ 0.340198] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.351033] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.351644] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.352162] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.341328] ACPI: Added _OSI(Module Device) client # [ 0.341943] ACPI: Added _OSI(Processor Device) worker1 # [ 0.353104] PCI: Using E820 reservations for host bridge windows client # [ 0.342666] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.356191] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.345172] ACPI: Added _OSI(Module Device) lb # [ 0.345780] ACPI: Added _OSI(Processor Device) worker2 # [ 0.348046] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.346563] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.348799] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.351674] ACPI: Interpreter enabled worker2 # [ 0.352341] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.352992] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.364776] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.353474] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.354417] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.365109] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.355344] ACPI: Interpreter enabled client # [ 0.355956] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.355340] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.366423] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.356634] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.367228] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.357563] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.356717] ACPI: Interpreter enabled worker1 # [ 0.368431] PCI host bridge to bus 0000:00 lb # [ 0.357229] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.369107] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.359003] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.370103] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.359779] ACPI: Using IOAPIC for interrupt routing client # [ 0.359942] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.371103] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.372103] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.360692] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.373103] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.363021] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.374103] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.363778] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.365708] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.375104] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.364844] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.366423] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.376071] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.367493] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.377567] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.368538] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.369754] PCI host bridge to bus 0000:00 client # [ 0.370392] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.370421] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.371417] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.370948] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.372417] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.372020] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.373542] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.373416] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.373065] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.374303] PCI host bridge to bus 0000:00 worker2 # [ 0.374417] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.380165] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.374516] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.374946] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.375417] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.381116] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.375857] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.375942] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.376417] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.382036] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.376913] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.376941] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.377372] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.378122] PCI host bridge to bus 0000:00 worker1 # [ 0.382980] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.377942] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.378872] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.378782] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.378941] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.379779] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.384791] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.379941] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.380778] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.380942] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.381779] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.381898] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.388121] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.382778] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.388941] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.383394] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.383779] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.389820] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.384778] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.390109] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.385824] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.381505] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.391600] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.382430] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.387263] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.383398] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.393120] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.384662] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.393962] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.394838] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.386009] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.386312] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.387022] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.395655] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.387965] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.388458] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.389302] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.389351] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.389890] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.390200] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.398122] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.390790] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.390650] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.399712] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.391258] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.391697] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.400125] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.392999] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.393102] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.393988] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.401670] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.394796] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.394457] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.395759] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.394524] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.403121] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.395323] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.403931] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.396740] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.396170] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.404814] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.405109] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.397820] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.398503] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.396952] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.398670] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.407207] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.399608] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.400982] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.400814] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.401851] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.409125] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.399615] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.402704] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.400423] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.410068] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.402366] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.401355] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.403585] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.411453] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.404758] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.402881] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.405400] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.413126] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.405800] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.414072] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.404424] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.406981] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.405277] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.407349] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.407817] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.406226] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.415478] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.408641] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.407244] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.418116] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.409534] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.419054] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.408999] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.409822] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.410747] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.420475] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.410247] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.411892] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.411552] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.411185] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.412573] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.422145] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.413182] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.412005] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.423109] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.412963] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.413948] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.413462] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.415817] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.424642] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.414438] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.416672] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.415491] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.427149] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.417540] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.416490] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.427965] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.416993] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.418571] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.428797] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.417946] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.418244] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.420076] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.419234] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.429674] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.419540] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.420774] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.421826] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.431144] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.422800] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.421942] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.422430] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.422920] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.431984] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.424336] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.423439] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.432834] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.424302] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.425454] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.433685] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.426518] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.425954] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.426828] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.434813] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.427468] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.426909] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.428326] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.435345] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.428358] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.429151] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.428352] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.436764] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.429791] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.429954] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.437330] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.430779] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.429954] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.439416] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.431737] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.432337] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.431424] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.432451] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.433308] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.433438] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.434456] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.434801] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.435002] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.435766] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.436563] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.435937] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.436414] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.436963] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.436610] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.438565] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.437951] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.438517] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.439438] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.438603] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.439801] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.440566] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.439983] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.440322] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.440950] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.441339] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.442708] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.441942] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.443406] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.443436] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.443499] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.443786] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.444392] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.444815] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.444744] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.445359] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.446201] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.445769] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.447091] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.447557] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.447804] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.447796] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.448781] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.448448] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.448000] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.440651] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.450683] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.449798] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.449578] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.442960] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.450594] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.443699] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.452470] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.444704] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.453138] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.454210] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.445656] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.455204] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.456204] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.447439] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.457224] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.448356] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.458199] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.449488] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.459210] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.460209] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.451012] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.451231] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.461143] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.462119] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.453746] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.463118] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.453000] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.464120] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.454983] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.454512] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.465116] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.455527] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.455549] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.456226] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.466116] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.456514] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.467097] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.456764] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.457242] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.457521] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.468041] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.458524] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.458066] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.458969] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.459516] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.469964] iommu: Default domain type: Translated lb # [ 0.459083] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.459861] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.460518] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.470710] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.471377] ACPI: bus type USB registered worker2 # [ 0.461513] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.460998] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.460809] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.472128] usbcore: registered new interface driver usbfs worker2 # [ 0.462454] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.461665] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.473066] usbcore: registered new interface driver hub worker2 # [ 0.463412] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.462679] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.473779] usbcore: registered new device driver usb worker2 # [ 0.464410] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.462829] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.474980] NetLabel: Initializing worker2 # [ 0.465145] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.475541] NetLabel: domain hash size = 128 worker2 # [ 0.465436] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.464469] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.476103] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.466391] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.466030] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.477075] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.467165] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.477813] PCI: Using ACPI for IRQ routing client # [ 0.467061] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.467432] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.468048] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.467895] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.469054] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.469400] iommu: Default domain type: Translated lb # [ 0.468881] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.470038] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.470087] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.469881] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.470713] ACPI: bus type USB registered client # [ 0.471037] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.470877] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.471446] usbcore: registered new interface driver usbfs client # [ 0.472042] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.471874] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.472391] usbcore: registered new interface driver hub lb # [ 0.472878] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.473047] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.473104] usbcore: registered new device driver usb client # [ 0.473982] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.473877] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.474208] NetLabel: Initializing client # [ 0.474956] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.474422] NetLabel: domain hash size = 128 lb # [ 0.474902] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.475954] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.475160] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.475816] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.476923] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.475476] NetLabel: unlabeled traffic allowed by default lb # [ 0.476791] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.476390] PCI: Using ACPI for IRQ routing client # [ 0.477699] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.477754] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.477954] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.478513] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.478953] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.478793] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.479954] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.479781] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.480759] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.482003] iommu: Default domain type: Translated lb # [ 0.481565] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.482850] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.484054] ACPI: bus type USB registered lb # [ 0.483645] iommu: Default domain type: Translated client # [ 0.484887] usbcore: registered new interface driver usbfs lb # [ 0.484384] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.485672] usbcore: registered new interface driver hub lb # [ 0.485064] ACPI: bus type USB registered client # [ 0.485950] usbcore: registered new device driver usb lb # [ 0.485821] usbcore: registered new interface driver usbfs lb # [ 0.486726] usbcore: registered new interface driver hub client # [ 0.487737] NetLabel: Initializing lb # [ 0.487467] usbcore: registered new device driver usb client # [ 0.487947] NetLabel: domain hash size = 128 client # [ 0.488694] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.488617] NetLabel: Initializing client # [ 0.488986] NetLabel: unlabeled traffic allowed by default lb # [ 0.489232] NetLabel: domain hash size = 128 client # [ 0.489890] PCI: Using ACPI for IRQ routing lb # [ 0.489778] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.490766] NetLabel: unlabeled traffic allowed by default lb # [ 0.491513] PCI: Using ACPI for IRQ routing worker1 # [ 0.521679] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.522099] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.522099] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.522108] vgaarb: loaded worker1 # [ 0.522846] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.523105] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.529186] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.520244] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.520413] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.532648] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.520413] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.520421] vgaarb: loaded worker1 # [ 0.533365] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.521175] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.534772] pnp: PnP ACPI init worker2 # [ 0.521417] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.535539] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.536508] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.538093] pnp: PnP ACPI: found 5 devices worker2 # [ 0.525503] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.529045] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.529776] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.533337] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.531180] pnp: PnP ACPI init worker1 # [ 0.545648] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.533938] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.547023] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.532222] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.547951] NET: Registered PF_INET protocol family lb # [ 0.535148] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.533938] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.533178] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.533946] vgaarb: loaded lb # [ 0.535775] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.549076] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.534693] pnp: PnP ACPI: found 5 devices client # [ 0.534661] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.535775] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.535784] vgaarb: loaded client # [ 0.534944] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.536528] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.536781] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.538037] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.542251] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.541589] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.543741] clocksource: Switched to clocksource acpi_pm lb # [ 0.541873] clocksource: Switched to clocksource kvm-clock client # [ 0.542331] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.544690] NET: Registered PF_INET protocol family client # [ 0.543880] pnp: PnP ACPI init worker2 # [ 0.545848] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.544736] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.545743] VFS: Disk quotas dquot_6.6.0 client # [ 0.545698] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.546458] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.547285] pnp: PnP ACPI: found 5 devices lb # [ 0.547895] pnp: PnP ACPI init lb # [ 0.548694] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.565564] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.549662] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.567154] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.551210] pnp: PnP ACPI: found 5 devices worker1 # [ 0.568502] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.569921] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.571238] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.554878] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.572366] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.556306] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.573618] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.557278] NET: Registered PF_INET protocol family worker1 # [ 0.574705] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.558485] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.575935] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.558855] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.576879] NET: Registered PF_XDP protocol family lb # [ 0.560348] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.562001] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.577687] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.561353] NET: Registered PF_INET protocol family worker1 # [ 0.578671] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.563711] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.562525] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.579666] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.565027] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.580738] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.566406] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.581856] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.567683] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.582978] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.568863] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.584683] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.570276] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.571517] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.586993] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.572810] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.573829] NET: Registered PF_XDP protocol family worker1 # [ 0.589464] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.574728] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.575737] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.591499] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.576777] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.575004] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.577846] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.593315] PCI: CLS 0 bytes, default 64 client # [ 0.576747] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.578973] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.577991] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.594287] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.580056] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.595969] Trying to unpack rootfs image as initramfs... client # [ 0.579302] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.581720] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.579404] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.580518] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.580971] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.581738] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.583936] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.582312] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.583060] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.583699] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.584247] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.586296] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.584971] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.585415] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.586383] NET: Registered PF_XDP protocol family worker2 # [ 0.588222] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.586137] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.587237] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.587415] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.589885] PCI: CLS 0 bytes, default 64 client # [ 0.588255] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.588482] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.589271] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.590767] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.589738] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.590339] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.592489] Trying to unpack rootfs image as initramfs... lb # [ 0.590697] NET: Registered PF_XDP protocol family client # [ 0.591413] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.591515] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.592506] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.592592] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.594248] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.593599] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.594737] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.595960] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.597251] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.597115] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.599205] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.598937] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.601133] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.601813] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.602874] PCI: CLS 0 bytes, default 64 lb # [ 0.603804] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.603778] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.605889] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.605504] Trying to unpack rootfs image as initramfs... lb # [ 0.607619] PCI: CLS 0 bytes, default 64 lb # [ 0.608659] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.610459] Trying to unpack rootfs image as initramfs... worker1 # [ 0.640158] Initialise system trusted keyrings worker1 # [ 0.643826] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.636149] Initialise system trusted keyrings worker2 # [ 0.639182] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.663057] Key type asymmetric registered worker1 # [ 0.665780] Asymmetric key parser 'x509' registered client # [ 0.649585] Initialise system trusted keyrings worker1 # [ 0.666615] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.669921] io scheduler mq-deadline registered client # [ 0.653213] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.670674] io scheduler kyber registered lb # [ 0.655307] Initialise system trusted keyrings worker1 # [ 0.674790] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.660521] Key type asymmetric registered lb # [ 0.658904] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.676055] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.663132] Asymmetric key parser 'x509' registered worker2 # [ 0.664030] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.681565] Linux agpgart interface v0.103 worker2 # [ 0.667224] io scheduler mq-deadline registered worker1 # [ 0.682386] ACPI: bus type drm_connector registered worker2 # [ 0.668012] io scheduler kyber registered worker1 # [ 0.685191] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.686359] usbserial: USB Serial support registered for generic worker2 # [ 0.672141] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.673483] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.674370] Key type asymmetric registered worker1 # [ 0.690782] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.675090] Asymmetric key parser 'x509' registered worker1 # [ 0.690782] Please enable it if your BIOS has the CPPC option. client # [ 0.675932] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.693044] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.678887] Linux agpgart interface v0.103 worker2 # [ 0.679655] ACPI: bus type drm_connector registered worker1 # [ 0.695914] drop_monitor: Initializing network drop monitor service lb # [ 0.680040] Key type asymmetric registered worker1 # [ 0.697137] NET: Registered PF_INET6 protocol family lb # [ 0.680785] Asymmetric key parser 'x509' registered worker2 # [ 0.682545] usbcore: registered new interface driver usbserial_generic client # [ 0.681268] io scheduler mq-deadline registered client # [ 0.682031] io scheduler kyber registered worker2 # [ 0.683646] usbserial: USB Serial support registered for generic lb # [ 0.681648] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.700213] Segment Routing with IPv6 client # [ 0.684709] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.686132] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.686132] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.702800] In-situ OAM (IOAM) with IPv6 client # [ 0.685955] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.703826] IPI shorthand broadcast: enabled worker2 # [ 0.688435] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.686963] io scheduler mq-deadline registered lb # [ 0.687759] io scheduler kyber registered client # [ 0.691452] Linux agpgart interface v0.103 worker2 # [ 0.693259] drop_monitor: Initializing network drop monitor service lb # [ 0.691471] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.692287] ACPI: bus type drm_connector registered worker2 # [ 0.694441] NET: Registered PF_INET6 protocol family lb # [ 0.692704] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.695531] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.697592] Segment Routing with IPv6 worker1 # [ 0.712022] sched_clock: Marking stable (579016882, 132746766)->(780029209, -68265561) client # [ 0.696604] usbserial: USB Serial support registered for generic lb # [ 0.696635] Linux agpgart interface v0.103 lb # [ 0.697393] ACPI: bus type drm_connector registered worker2 # [ 0.700173] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.716016] registered taskstats version 1 worker2 # [ 0.701262] IPI shorthand broadcast: enabled worker1 # [ 0.716966] Loading compiled-in X.509 certificates lb # [ 0.700281] usbcore: registered new interface driver usbserial_generic client # [ 0.700181] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.700181] Please enable it if your BIOS has the CPPC option. lb # [ 0.701365] usbserial: USB Serial support registered for generic client # [ 0.702436] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.703881] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.705322] drop_monitor: Initializing network drop monitor service lb # [ 0.703881] Please enable it if your BIOS has the CPPC option. client # [ 0.706580] NET: Registered PF_INET6 protocol family lb # [ 0.706184] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.709307] sched_clock: Marking stable (576014162, 133099365)->(783664561, -74551034) client # [ 0.709670] Segment Routing with IPv6 lb # [ 0.709995] drop_monitor: Initializing network drop monitor service lb # [ 0.711213] NET: Registered PF_INET6 protocol family client # [ 0.712191] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.714323] registered taskstats version 1 client # [ 0.713281] IPI shorthand broadcast: enabled worker2 # [ 0.715342] Loading compiled-in X.509 certificates lb # [ 0.716314] Segment Routing with IPv6 lb # [ 0.717061] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.734779] Demotion targets for Node 0: null lb # [ 0.720158] IPI shorthand broadcast: enabled worker1 # [ 0.737805] Key type .fscrypt registered worker1 # [ 0.738504] Key type fscrypt-provisioning registered client # [ 0.721664] sched_clock: Marking stable (589014399, 132138579)->(793076694, -71923716) worker1 # [ 0.739463] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.741778] ima: Allocated hash algorithm: sha1 worker1 # [ 0.742582] ima: No architecture policies found client # [ 0.728369] registered taskstats version 1 lb # [ 0.727608] sched_clock: Marking stable (593015261, 133833561)->(799847990, -72999168) client # [ 0.729350] Loading compiled-in X.509 certificates worker2 # [ 0.731654] Demotion targets for Node 0: null worker1 # [ 0.746775] PM: Magic number: 10:383:844 worker1 # [ 0.747490] PM: hash matches drivers/base/power/main.c:1117 lb # [ 0.731075] registered taskstats version 1 lb # [ 0.732106] Loading compiled-in X.509 certificates worker2 # [ 0.735168] Key type .fscrypt registered worker2 # [ 0.735871] Key type fscrypt-provisioning registered worker1 # [ 0.751419] RAS: Correctable Errors collector initialized. worker2 # [ 0.736828] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.739125] ima: Allocated hash algorithm: sha1 worker2 # [ 0.739954] ima: No architecture policies found worker2 # [ 0.742131] PM: Magic number: 10:383:844 worker2 # [ 0.742878] PM: hash matches drivers/base/power/main.c:1117 worker1 # [ 0.760173] clk: Disabling unused clocks worker2 # [ 0.746743] RAS: Correctable Errors collector initialized. client # [ 0.745761] Demotion targets for Node 0: null worker1 # [ 0.762775] PM: genpd: Disabling unused power domains client # [ 0.749200] Key type .fscrypt registered client # [ 0.749897] Key type fscrypt-provisioning registered client # [ 0.750873] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.750856] Demotion targets for Node 0: null client # [ 0.753166] ima: Allocated hash algorithm: sha1 worker2 # [ 0.755421] clk: Disabling unused clocks client # [ 0.753963] ima: No architecture policies found lb # [ 0.753900] Key type .fscrypt registered lb # [ 0.754614] Key type fscrypt-provisioning registered lb # [ 0.755584] ima: No TPM chip found, activating TPM-bypass! client # [ 0.758171] PM: Magic number: 10:383:844 lb # [ 0.757862] ima: Allocated hash algorithm: sha1 worker2 # [ 0.760139] PM: genpd: Disabling unused power domains lb # [ 0.758689] ima: No architecture policies found client # [ 0.758855] PM: hash matches drivers/base/power/main.c:1117 lb # [ 0.760865] PM: Magic number: 10:383:844 lb # [ 0.761631] PM: hash matches drivers/base/power/main.c:1117 client # [ 0.762751] RAS: Correctable Errors collector initialized. lb # [ 0.765632] RAS: Correctable Errors collector initialized. client # [ 0.769368] clk: Disabling unused clocks client # [ 0.770101] PM: genpd: Disabling unused power domains lb # [ 0.774332] clk: Disabling unused clocks lb # [ 0.778874] PM: genpd: Disabling unused power domains worker1 # [ 0.922213] Freeing initrd memory: 29056K worker1 # [ 0.925488] Freeing unused decrypted memory: 2028K worker1 # [ 0.928194] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.929343] Write protecting the kernel read-only data: 32768k worker1 # [ 0.931252] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.932816] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.918973] Freeing initrd memory: 29060K worker2 # [ 0.922133] Freeing unused decrypted memory: 2028K worker2 # [ 0.924802] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.925953] Write protecting the kernel read-only data: 32768k worker2 # [ 0.927883] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.929456] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.937691] Freeing initrd memory: 29056K client # [ 0.941007] Freeing unused decrypted memory: 2028K client # [ 0.943799] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.944933] Write protecting the kernel read-only data: 32768k client # [ 0.946844] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.948109] Freeing initrd memory: 29064K client # [ 0.948437] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.951345] Freeing unused decrypted memory: 2028K lb # [ 0.954073] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.955207] Write protecting the kernel read-only data: 32768k lb # [ 0.957126] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.958649] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.983886] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.984986] Run /init as init process worker2 # [ 0.980351] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.995629] systemd[1]: Inserted module 'autofs4' worker2 # [ 0.981441] Run /init as init process worker2 # [ 0.991975] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.015462] fuse: init (API version 7.45) client # [ 0.999447] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 1.000583] Run /init as init process worker1 # [ 1.022894] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.025207] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.011879] fuse: init (API version 7.45) lb # [ 1.009652] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.010749] Run /init as init process client # [ 1.011426] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.028304] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.030179] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.019285] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.035383] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.021631] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.037000] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.021692] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.024593] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.026598] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.044067] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.045740] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.031721] virtiofs virtio5: discovered new tag: nix-store client # [ 1.031325] fuse: init (API version 7.45) worker2 # [ 1.033387] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.048995] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.050442] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.038740] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.040322] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.041914] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.041523] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.041501] fuse: init (API version 7.45) worker2 # [ 1.045017] virtiofs virtio7: discovered new tag: xchg client # [ 1.044689] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.046527] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.046854] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.049024] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.051784] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.052702] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.070474] systemd[1]: Successfully made /usr/ read-only. client # [ 1.054305] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.055249] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.057509] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.062340] virtiofs virtio6: discovered new tag: shared lb # [ 1.063590] virtiofs virtio5: discovered new tag: nix-store client # [ 1.063832] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.066973] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.065146] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.067130] virtiofs virtio7: discovered new tag: xchg client # [ 1.068581] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.072970] virtiofs virtio6: discovered new tag: shared lb # [ 1.074551] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.077856] virtiofs virtio7: discovered new tag: xchg lb # [ 1.079406] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.089907] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.100661] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.406158] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.410965] systemd[1]: Detected virtualization kvm. worker1 # [ 1.411790] systemd[1]: Detected architecture x86-64. worker1 # [ 1.412601] systemd[1]: Running in initrd. worker1 # [ 1.413638] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.414816] systemd[1]: Hostname set to . worker2 # [ 1.402479] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.407576] systemd[1]: Detected virtualization kvm. worker2 # [ 1.408470] systemd[1]: Detected architecture x86-64. worker2 # [ 1.409386] systemd[1]: Running in initrd. worker2 # [ 1.410488] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.411727] systemd[1]: Hostname set to . client # [ 1.425384] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.430417] systemd[1]: Detected virtualization kvm. client # [ 1.431295] systemd[1]: Detected architecture x86-64. client # [ 1.432193] systemd[1]: Running in initrd. client # [ 1.433264] systemd[1]: Initializing machine ID from random generator. client # [ 1.434503] systemd[1]: Hostname set to . lb # [ 1.437233] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.449131] systemd[1]: Detected virtualization kvm. lb # [ 1.451193] systemd[1]: Detected architecture x86-64. lb # [ 1.453289] systemd[1]: Running in initrd. lb # [ 1.455645] systemd[1]: Initializing machine ID from random generator. lb # [ 1.458497] systemd[1]: Hostname set to . worker1 # [ 1.603146] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.621838] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.640295] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.644024] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.645196] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.628924] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.646562] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.647685] systemd[1]: Reached target Path Units. worker1 # [ 1.648524] systemd[1]: Reached target Slice Units. worker1 # [ 1.649395] systemd[1]: Reached target Swaps. worker1 # [ 1.650187] systemd[1]: Reached target Timer Units. worker1 # [ 1.651143] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.652326] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.653457] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.654441] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.655455] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.656397] systemd[1]: Reached target Socket Units. worker1 # [ 1.658149] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.661830] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.659572] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.663479] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.664701] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.682361] systemd[1]: Starting Journal Service... client # [ 1.666163] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.667275] systemd[1]: Reached target Path Units. client # [ 1.668163] systemd[1]: Reached target Slice Units. client # [ 1.669030] systemd[1]: Reached target Swaps. client # [ 1.669860] systemd[1]: Reached target Timer Units. client # [ 1.670850] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.672072] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.673310] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.690936] systemd[1]: Starting Load Kernel Modules... client # [ 1.674321] systemd[1]: Listening on udev Control Socket. client # [ 1.675357] systemd[1]: Listening on udev Kernel Socket. client # [ 1.676340] systemd[1]: Reached target Socket Units. worker1 # [ 1.693845] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.678125] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.677126] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.683299] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.701473] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.687502] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.688826] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.690427] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.691644] systemd[1]: Reached target Path Units. worker2 # [ 1.692614] systemd[1]: Reached target Slice Units. worker2 # [ 1.693582] systemd[1]: Reached target Swaps. worker2 # [ 1.694495] systemd[1]: Reached target Timer Units. client # [ 1.681984] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.695550] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.696850] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.698155] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.713830] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.699318] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.700421] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.701488] systemd[1]: Reached target Socket Units. worker2 # [ 1.703459] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.702762] systemd[1]: Starting Journal Service... worker1 # [ 1.719663] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.726116] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.713235] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.730170] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.732377] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.715915] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.708193] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.721352] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.743830] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.731388] systemd[1]: Starting Journal Service... lb # [ 1.729933] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.733151] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.734543] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.734352] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.750666] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.735714] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.736878] systemd[1]: Reached target Path Units. lb # [ 1.737746] systemd[1]: Reached target Slice Units. lb # [ 1.738666] systemd[1]: Reached target Swaps. client # [ 1.738747] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.739539] systemd[1]: Reached target Timer Units. worker2 # [ 1.742265] systemd[1]: Starting Load Kernel Modules... lb # [ 1.740500] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.741742] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.742956] systemd[1]: Listening on Journal Sockets. lb # [ 1.743980] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.745249] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.745001] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.745991] systemd[1]: Reached target Socket Units. worker1 # [ 1.763083] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.747779] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.747738] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.749846] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.752625] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.758865] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.763723] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.752927] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.766223] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.768779] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.784310] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.773960] systemd[1]: Starting Journal Service... client # [ 1.774951] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.792954] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.778136] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.783340] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.784683] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.783929] systemd[1]: Starting Load Kernel Modules... lb # [ 1.786571] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.804303] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.789426] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.792549] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.813360] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.799183] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.805910] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.807357] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.806741] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.812472] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.815177] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.831605] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.816347] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.819253] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.837966] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.843846] systemd[1]: Reached target Local File Systems. lb # [ 1.826303] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.827696] systemd[1]: Finished Load Kernel Modules. lb # [ 1.828258] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.850944] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.836672] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.715981] systemd-modules-load[67]: Inserted module 'dm_mod' client # [ 1.836349] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.720717] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.836916] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.721709] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.845319] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.860953] systemd[1]: Started Journal Service. lb # [ 1.849395] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.734890] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.857185] systemd[1]: Finished Load Kernel Modules. client # [ 1.857226] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.858027] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.862652] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.748089] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.865780] systemd[1]: Starting Apply Kernel Variables... client # [ 1.869236] systemd[1]: Reached target Local File Systems. client # [ 1.874340] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.744763] systemd-modules-load[67]: Inserted module 'dm_mod' client # [ 1.747867] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.879390] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.748920] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.884672] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.770051] systemd[1]: Finished Create System Files and Directories. client # [ 1.887329] systemd[1]: Started Journal Service. lb # [ 1.887036] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.890352] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.760315] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.896192] systemd[1]: Reached target Local File Systems. worker1 # [ 1.779381] systemd-udevd[74]: Using default interface naming scheme 'v261'. lb # [ 1.899377] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.903313] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.775088] systemd[1]: Starting Create System Files and Directories... lb # [ 1.907079] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.775682] systemd-modules-load[67]: Inserted module 'dm_mod' worker2 # [ 1.779270] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.780331] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.916084] systemd[1]: Started Journal Service. worker1 # [ 1.802560] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.788435] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.928940] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.799852] systemd[1]: Starting Create System Files and Directories... client # [ 1.801305] systemd[1]: Finished Create System Files and Directories. lb # [ 1.934055] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.805943] systemd-udevd[74]: Using default interface naming scheme 'v261'. lb # [ 1.938926] systemd[1]: Reached target Local File Systems. lb # [ 1.946051] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.814144] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.815481] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.817272] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.826302] systemd[1]: Finished Create System Files and Directories. lb # [ 1.958051] systemd[1]: Started Journal Service. lb # [ 1.828912] systemd[1]: Finished Apply Kernel Variables. client # [ 1.830321] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.834411] systemd-udevd[75]: Using default interface naming scheme 'v261'. worker1 # [ 1.856093] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.856985] systemd[1]: Reached target System Initialization. worker1 # [ 1.858441] systemd[1]: Reached target Basic System. lb # [ 1.841330] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.857452] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.869461] systemd[1]: Finished Create System Files and Directories. lb # [ 1.875237] systemd-udevd[75]: Using default interface naming scheme 'v261'. client # [ 1.883049] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.886071] systemd[1]: Reached target System Initialization. client # [ 1.886900] systemd[1]: Reached target Basic System. lb # [ 1.899162] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.914748] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.915651] systemd[1]: Reached target System Initialization. worker2 # [ 1.916547] systemd[1]: Reached target Basic System. lb # [ 1.954230] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.955745] systemd[1]: Reached target System Initialization. lb # [ 1.956662] systemd[1]: Reached target Basic System. worker1 # [ 2.175982] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.180525] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.186580] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.196348] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.197110] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.198816] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.201254] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.201948] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.204786] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.205616] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.207146] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.209407] usb usb1: Product: EHCI Host Controller worker1 # [ 2.211783] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.212495] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.215905] hub 1-0:1.0: USB hub found worker1 # [ 2.216449] hub 1-0:1.0: 6 ports detected worker1 # [ 2.220147] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.204444] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.226797] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.212957] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.216279] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.235463] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.241877] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.226859] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.227588] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.228831] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.232201] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.232866] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.234689] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.250253] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.251374] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.235239] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.236155] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.237379] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.240334] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.239396] usb usb1: Product: EHCI Host Controller client # [ 2.240718] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.242293] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.245235] hub 1-0:1.0: USB hub found worker2 # [ 2.247164] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.245804] hub 1-0:1.0: 6 ports detected worker2 # [ 2.247862] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.249180] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.251766] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.270793] usb usb2: Product: UHCI Host Controller worker1 # [ 2.271478] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.255588] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.261357] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.262244] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.264175] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.264410] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.148527] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.151057] systemd[1]: Starting Virtual Console Setup... lb # [ 2.268807] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.270998] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.272661] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.288500] SCSI subsystem initialized worker2 # [ 2.275131] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.275511] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.277157] usb usb1: Product: EHCI Host Controller worker2 # [ 2.277814] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.293828] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.280454] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.280511] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.282296] hub 1-0:1.0: USB hub found worker2 # [ 2.285122] hub 1-0:1.0: 6 ports detected lb # [ 2.282755] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.290497] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.289423] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.291272] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.308946] hub 2-0:1.0: USB hub found lb # [ 2.295815] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.296773] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.180393] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.182351] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.299503] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.302487] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.304789] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.186489] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.188262] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.321931] hub 2-0:1.0: 2 ports detected client # [ 2.305311] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.307977] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.309154] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.310288] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.313313] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.312349] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.329110] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.313170] usb usb2: Product: UHCI Host Controller client # [ 2.313892] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.313664] usb usb1: Product: EHCI Host Controller lb # [ 2.314783] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.315858] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.316334] SCSI subsystem initialized lb # [ 2.319041] hub 1-0:1.0: USB hub found lb # [ 2.319634] hub 1-0:1.0: 6 ports detected worker2 # [ 2.321613] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.190307] systemd[1]: Starting Virtual Console Setup... lb # [ 2.323397] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.325824] SCSI subsystem initialized worker1 # [ 2.341095] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.324122] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.341816] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.333038] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.199567] (udev-worker)[87]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.334539] usb usb2: Product: UHCI Host Controller worker1 # [ 2.217981] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.219486] systemd[1]: Reached target Initrd Root Device. client # [ 2.335756] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.205214] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.338306] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.355908] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.356666] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.208656] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.340464] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.224760] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.342349] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.213187] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.360965] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.349511] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.366792] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.350042] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.351207] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.220341] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.356305] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.371791] usb usb3: Product: UHCI Host Controller worker1 # [ 2.372477] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.375800] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.226651] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.360861] hub 2-0:1.0: USB hub found worker1 # [ 2.378227] hub 3-0:1.0: USB hub found client # [ 2.229663] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.230764] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.379805] hub 3-0:1.0: 2 ports detected client # [ 2.234423] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.368629] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.385103] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.369219] hub 2-0:1.0: 2 ports detected lb # [ 2.369553] usb usb2: Product: UHCI Host Controller worker1 # [ 2.386900] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.391370] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.375168] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.393984] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.262558] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.383476] hub 2-0:1.0: USB hub found worker1 # [ 2.397921] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.384189] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.384908] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.251647] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.270492] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.255731] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.404316] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.257254] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.391276] hub 2-0:1.0: 2 ports detected lb # [ 2.390012] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.407014] usb usb4: Product: UHCI Host Controller client # [ 2.391676] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.261302] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.410802] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.411590] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.263520] systemd[1]: Reached target Initrd Root Device. client # [ 2.397409] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.414247] hub 4-0:1.0: USB hub found lb # [ 2.262994] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.415892] hub 4-0:1.0: 2 ports detected client # [ 2.267310] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.404367] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.410194] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.273421] (udev-worker)[87]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.410952] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.275455] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.410187] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.412110] hub 2-0:1.0: USB hub found client # [ 2.412342] usb usb3: Product: UHCI Host Controller client # [ 2.413062] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.283051] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.284655] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.418714] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.419495] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.417914] hub 2-0:1.0: 2 ports detected client # [ 2.418743] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.288312] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.420361] hub 3-0:1.0: USB hub found lb # [ 2.287773] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.423237] hub 3-0:1.0: 2 ports detected worker2 # [ 2.426593] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.442811] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.293739] systemd[1]: Finished Virtual Console Setup. client # [ 2.430229] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.430540] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.430962] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.432939] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.448240] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.449128] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.435149] usb usb3: Product: UHCI Host Controller client # [ 2.434259] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.435848] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.435026] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.304212] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.455832] scsi host0: ahci worker2 # [ 2.440734] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.456776] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.442441] hub 3-0:1.0: USB hub found worker1 # [ 2.458621] scsi host1: ahci worker2 # [ 2.444063] hub 3-0:1.0: 2 ports detected client # [ 2.441908] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.460077] scsi host2: ahci client # [ 2.443241] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.444052] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.461835] scsi host3: ahci client # [ 2.313435] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.463523] scsi host4: ahci client # [ 2.447185] usb usb4: Product: UHCI Host Controller client # [ 2.447896] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.465287] scsi host5: ahci lb # [ 2.447883] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.449930] SCSI subsystem initialized worker1 # [ 2.466451] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.450539] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.452255] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.453027] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.468161] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.318456] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.469389] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.321810] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.319804] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.470582] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.471780] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.472920] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.322410] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.458455] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.458423] hub 4-0:1.0: USB hub found client # [ 2.459562] hub 4-0:1.0: 2 ports detected worker2 # [ 2.461974] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.463369] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.463357] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.332332] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.464499] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.467215] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.472274] usb usb4: Product: UHCI Host Controller worker2 # [ 2.473005] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.475175] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.475187] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.477813] hub 4-0:1.0: USB hub found lb # [ 2.479385] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.483459] hub 4-0:1.0: 2 ports detected client # [ 2.483175] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.482969] usb usb3: Product: UHCI Host Controller client # [ 2.486083] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.487002] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.491898] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.360198] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.494686] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.495398] hub 3-0:1.0: USB hub found client # [ 2.496022] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.499184] hub 3-0:1.0: 2 ports detected worker2 # [ 2.500609] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.500066] scsi host0: ahci worker2 # [ 2.501714] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.366796] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.501684] scsi host1: ahci client # [ 2.503042] scsi host2: ahci client # [ 2.504882] scsi host3: ahci client # [ 2.506373] scsi host4: ahci lb # [ 2.507175] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.508000] scsi host5: ahci client # [ 2.509088] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.508921] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.510871] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.512902] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.511976] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.512041] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.513263] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.514439] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.514887] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.515595] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.518181] scsi host0: ahci worker2 # [ 2.519444] scsi host1: ahci lb # [ 2.517079] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.521136] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.519932] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.522754] scsi host2: ahci lb # [ 2.521881] usb usb4: Product: UHCI Host Controller worker2 # [ 2.524063] scsi host3: ahci lb # [ 2.522611] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.525858] scsi host4: ahci lb # [ 2.525146] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.527354] scsi host5: ahci worker2 # [ 2.527952] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.527291] hub 4-0:1.0: USB hub found worker2 # [ 2.530149] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.528984] hub 4-0:1.0: 2 ports detected worker2 # [ 2.531399] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.532576] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.533682] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.534776] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.557874] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.569879] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.570984] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.586325] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.572366] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.589267] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.575923] scsi host0: ahci worker1 # [ 2.592351] usb 1-1: Product: QEMU USB Tablet lb # [ 2.577873] scsi host1: ahci worker1 # [ 2.594335] usb 1-1: Manufacturer: QEMU lb # [ 2.579516] scsi host2: ahci worker1 # [ 2.596045] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.581222] scsi host3: ahci lb # [ 2.582946] scsi host4: ahci lb # [ 2.584532] scsi host5: ahci lb # [ 2.585636] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.587386] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.588536] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.589725] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.590908] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.592131] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.629614] hid: raw HID events driver (C) Jiri Kosina client # [ 2.612340] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.615240] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.618441] usb 1-1: Product: QEMU USB Tablet client # [ 2.620255] usb 1-1: Manufacturer: QEMU client # [ 2.621873] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.651639] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.653451] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.656716] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.660350] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.662405] usb 1-1: Manufacturer: QEMU worker2 # [ 2.664598] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.687922] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.689102] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.690484] usb 1-1: Product: QEMU USB Tablet lb # [ 2.691185] usb 1-1: Manufacturer: QEMU lb # [ 2.691745] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.696747] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.579687] systemd[1]: Mounting /sysroot... lb # [ 2.706107] hid: raw HID events driver (C) Jiri Kosina client # [ 2.598035] systemd[1]: Mounting /sysroot... worker2 # [ 2.627386] systemd[1]: Mounting /sysroot... worker1 # [ 2.782329] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.784344] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.785280] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.786185] ata3.00: applying bridge limits worker1 # [ 2.786925] ata3.00: configured for UDMA/100 worker1 # [ 2.787690] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.788632] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.789512] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.790408] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.791452] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.669193] systemd[1]: Mounting /sysroot... client # [ 2.825903] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.826903] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.827975] ata3.00: applying bridge limits client # [ 2.828719] ata3.00: configured for UDMA/100 client # [ 2.829517] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.830420] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.831351] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.832204] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.833100] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.834245] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.854887] usbcore: registered new interface driver usbhid worker1 # [ 2.855630] usbhid: USB HID core driver worker2 # [ 2.846719] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.849592] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.852155] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.868971] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.870911] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.854765] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.857515] ata3.00: applying bridge limits worker1 # [ 2.873779] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.859666] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.862291] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.864860] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.867615] ata3.00: configured for UDMA/100 worker1 # [ 2.886871] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.870274] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.902816] EXT4-fs (vda): mounted filesystem 64106a2a-e6ea-4ade-9149-0aa75911ce23 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.774841] systemd[1]: Mounted /sysroot. client # [ 2.892386] usbcore: registered new interface driver usbhid worker1 # [ 2.777066] systemd[1]: Reached target Initrd Root File System. client # [ 2.896980] usbhid: USB HID core driver worker1 # [ 2.781884] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 2.901821] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.903301] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.787856] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 2.904208] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.905170] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.906111] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.791308] systemd[1]: Mounting /sysroot/run... lb # [ 2.907099] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.908134] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.908980] ata3.00: applying bridge limits worker1 # [ 2.794124] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 2.910637] ata3.00: configured for UDMA/100 lb # [ 2.913239] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.805151] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 2.808460] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.924356] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.926484] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.932553] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.943360] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.945680] EXT4-fs (vda): mounted filesystem 9015bf7c-119a-4136-b544-1ca8f2659424 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.951232] usbcore: registered new interface driver usbhid client # [ 2.819240] systemd[1]: Mounted /sysroot. worker2 # [ 2.954306] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.820834] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.957116] usbhid: USB HID core driver client # [ 2.824243] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.847073] systemd-sysroot-fstab-check[145]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.966336] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.970300] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.855175] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 2.838855] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.972290] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.856582] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 2.858804] systemd[1]: Mounted /sysroot/run. worker1 # [ 2.859520] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 2.844064] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.845584] systemd[1]: Reloading... worker1 # [ 2.864567] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 2.869224] systemd[1]: Reload requested from client PID 145 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.870706] systemd[1]: Reloading... lb # [ 2.990063] usbcore: registered new interface driver usbhid lb # [ 2.990886] usbhid: USB HID core driver worker2 # [ 3.002680] EXT4-fs (vda): mounted filesystem f16a84ab-7980-4d0e-a794-679d69a5229f r/w with ordered data mode. Quota mode: none. lb # [ 3.003060] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.875460] systemd[1]: Mounted /sysroot. worker2 # [ 2.877321] systemd[1]: Reached target Initrd Root File System. lb # [ 3.010090] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.880176] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.013981] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 3.022936] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.894467] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.898073] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.899726] systemd[1]: Reloading... lb # [ 3.041866] EXT4-fs (vda): mounted filesystem 07335991-04c2-49b5-b1b4-54c37da3080a r/w with ordered data mode. Quota mode: none. lb # [ 2.912910] systemd[1]: Mounted /sysroot. worker1 # [ 2.933977] systemd[1]: Reloading finished in 62 ms. lb # [ 2.916079] systemd[1]: Reached target Initrd Root File System. lb # [ 2.918818] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.942649] systemd-sysroot-fstab-check[145]: Requesting initrd-fs.target/start/replace... client # [ 2.928186] systemd[1]: Reloading finished in 84 ms. worker1 # [ 2.945893] systemd-sysroot-fstab-check[145]: Requesting swap.target/start/replace... worker1 # [ 2.948195] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 2.950577] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 2.936258] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.953117] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 2.934767] systemd-sysroot-fstab-check[141]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.955150] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 2.940222] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... lb # [ 2.940071] systemd[1]: Reload requested from client PID 141 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.941528] systemd[1]: Reloading... client # [ 2.943251] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 2.944623] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 2.946177] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 2.964694] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 2.966320] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 2.975973] systemd[1]: Reloading finished in 78 ms. worker2 # [ 2.984360] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker2 # [ 2.989206] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker2 # [ 2.992331] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 2.993856] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 2.995128] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.022414] systemd[1]: Reloading finished in 82 ms. lb # [ 3.030448] systemd-sysroot-fstab-check[141]: Requesting initrd-fs.target/start/replace... lb # [ 3.035165] systemd-sysroot-fstab-check[141]: Requesting swap.target/start/replace... lb # [ 3.038767] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.040168] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.041204] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.578927] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.599716] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.602747] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.607127] systemd[1]: Mounting /sysroot/run... client # [ 3.609126] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.627081] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.629350] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.631127] systemd[1]: Starting Find NixOS closure... client # [ 3.617149] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.634334] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.627905] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.636180] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.652736] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.638923] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.656071] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 3.641674] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.644733] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.645187] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.661590] systemd[1]: Finished Find NixOS closure. client # [ 3.646610] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.662761] systemd[1]: Reached target Initrd Default Target. worker1 # [ 3.664867] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.651889] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.654128] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.654304] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.678333] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.679633] systemd[1]: Stopped target Basic System. client # [ 3.664080] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.681208] systemd[1]: Stopped target Initrd Root Device. client # [ 3.665689] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.681959] systemd[1]: Stopped target Path Units. worker1 # [ 3.682661] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.683682] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.684674] systemd[1]: Stopped target Slice Units. worker1 # [ 3.685759] systemd[1]: Stopped target Socket Units. worker2 # [ 3.670337] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.686788] systemd[1]: Stopped target System Initialization. worker1 # [ 3.687860] systemd[1]: Stopped target Swaps. worker1 # [ 3.688728] systemd[1]: Stopped target Timer Units. worker1 # [ 3.690133] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.671197] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.690897] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.691787] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.692824] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.694180] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.696131] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.678173] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.697218] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.698144] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.700049] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.700798] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.701818] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.702849] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.703828] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.704657] systemd[1]: Stopped target Local File Systems. lb # [ 3.687182] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.707150] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.708082] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.709067] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.711122] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.712138] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.714094] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.697167] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.700871] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.719939] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.706163] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.708876] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.724200] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.710380] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.708322] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.728445] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.714510] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.730112] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.732943] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.717630] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.733932] systemd[1]: Closed udev Control Socket. worker1 # [ 3.736087] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.736834] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.737860] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.738721] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.739815] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.741110] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.742030] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.728094] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.744104] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.729700] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.745382] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.759338] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.760772] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.762137] systemd[1]: Reached target Switch Root. worker1 # [ 3.763885] systemd[1]: Starting NixOS Activation... lb # [ 3.749767] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.752885] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.753825] systemd[1]: Mounted /sysroot/run. lb # [ 3.754683] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.755592] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.759731] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.770405] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.771860] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.774176] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.796050] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.797152] systemd[1]: Reached target Initrd File Systems. lb # [ 3.798836] systemd[1]: Starting Find NixOS closure... lb # [ 3.801543] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.831848] initrd-nixos-activation-start[190]: booting system configuration /nix/store/xi6vvckx9rwwnrsyw13p0hn9l4ymyaqm-nixos-system-worker1-test lb # [ 3.820074] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.827550] systemd[1]: Finished Find NixOS closure. lb # [ 3.829182] systemd[1]: Reached target Initrd Default Target. lb # [ 3.830479] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.859207] initrd-nixos-activation-start[190]: running activation script... lb # [ 3.843879] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.846227] systemd[1]: Stopped target Basic System. lb # [ 3.847021] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.847743] systemd[1]: Stopped target Path Units. lb # [ 3.848415] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.849408] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.850412] systemd[1]: Stopped target Slice Units. lb # [ 3.851151] systemd[1]: Stopped target Socket Units. lb # [ 3.851837] systemd[1]: Stopped target System Initialization. lb # [ 3.852621] systemd[1]: Stopped target Swaps. lb # [ 3.853446] systemd[1]: Stopped target Timer Units. lb # [ 3.855181] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.855988] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.856794] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.857841] systemd[1]: Stopped Find NixOS closure. lb # [ 3.859062] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.860089] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.862174] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.863132] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.865064] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.865752] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.866949] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.868641] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.869643] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.872482] systemd[1]: Stopped target Local File Systems. lb # [ 3.873269] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.874169] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.876149] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.878085] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.879181] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.880221] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.886646] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.891251] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.894119] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.897058] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.900078] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.901098] systemd[1]: Closed udev Control Socket. lb # [ 3.903669] systemd[1]: Starting Cleanup udev Database... lb # [ 3.904490] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.905637] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.907234] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.908411] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.909491] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.910493] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.912132] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.914323] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.930429] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.931907] systemd[1]: Finished Cleanup udev Database. lb # [ 3.933520] systemd[1]: Reached target Switch Root. lb # [ 3.935493] systemd[1]: Starting NixOS Activation... lb # [ 4.003524] initrd-nixos-activation-start[192]: booting system configuration /nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test lb # [ 4.029729] initrd-nixos-activation-start[192]: running activation script... worker1 # [ 4.052526] initrd-nixos-activation-start[213]: setting up /etc... worker1 # [ 4.153126] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.154208] systemd[1]: Finished NixOS Activation. worker1 # [ 4.155484] systemd[1]: Starting Switch Root... worker1 # [ 4.167709] systemd[1]: Switching root. lb # [ 4.229268] initrd-nixos-activation-start[215]: setting up /etc... worker1 # [ 4.430693] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.333459] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.335105] systemd[1]: Finished NixOS Activation. lb # [ 4.336989] systemd[1]: Starting Switch Root... lb # [ 4.349793] systemd[1]: Switching root. worker1 # [ 4.526477] NET: Registered PF_VSOCK protocol family lb # [ 4.611809] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.701421] NET: Registered PF_VSOCK protocol family client # [ 4.598757] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.620070] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.621374] systemd[1]: Reached target Initrd File Systems. client # [ 4.623067] systemd[1]: Starting Find NixOS closure... client # [ 4.625477] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.628404] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.643205] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.645351] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.653154] systemd[1]: Finished Find NixOS closure. client # [ 4.654253] systemd[1]: Reached target Initrd Default Target. client # [ 4.655895] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.669444] systemd[1]: Stopped target Initrd Default Target. client # [ 4.670682] systemd[1]: Stopped target Basic System. client # [ 4.671641] systemd[1]: Stopped target Initrd Root Device. client # [ 4.673106] systemd[1]: Stopped target Path Units. client # [ 4.673787] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.674890] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.675874] systemd[1]: Stopped target Slice Units. worker2 # [ 4.675869] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.676724] systemd[1]: Stopped target Socket Units. worker2 # [ 4.677964] systemd[1]: Reached target Initrd File Systems. client # [ 4.677712] systemd[1]: Stopped target System Initialization. worker2 # [ 4.679789] systemd[1]: Starting Find NixOS closure... client # [ 4.679401] systemd[1]: Stopped target Swaps. client # [ 4.680395] systemd[1]: Stopped target Timer Units. client # [ 4.681286] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.683153] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.683057] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.683834] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.684891] systemd[1]: Stopped Find NixOS closure. client # [ 4.685894] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.686762] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.688307] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.689282] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.690419] systemd[1]: Stopped Load Kernel Modules. client # [ 4.692225] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.693459] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.694779] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.695897] systemd[1]: Stopped Create System Files and Directories. client # [ 4.697148] systemd[1]: Stopped target Local File Systems. client # [ 4.698111] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.700118] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.701164] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.704280] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.704969] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.705337] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.706090] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.706291] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.710769] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.712163] systemd[1]: Reached target Initrd Default Target. client # [ 4.712314] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.713587] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.716481] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.721805] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.725099] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.725984] systemd[1]: Stopped target Initrd Default Target. client # [ 4.726055] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.727379] systemd[1]: Stopped target Basic System. client # [ 4.726946] systemd[1]: Closed udev Control Socket. worker2 # [ 4.728352] systemd[1]: Stopped target Initrd Root Device. client # [ 4.728192] systemd[1]: Starting Cleanup udev Database... client # [ 4.728962] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.730182] systemd[1]: Stopped target Path Units. client # [ 4.730116] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.730893] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.731209] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.731897] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.732910] systemd[1]: Stopped target Slice Units. worker2 # [ 4.733628] systemd[1]: Stopped target Socket Units. client # [ 4.733086] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.734358] systemd[1]: Stopped target System Initialization. client # [ 4.734046] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.735346] systemd[1]: Stopped target Swaps. client # [ 4.734914] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.735760] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.737145] systemd[1]: Stopped target Timer Units. worker2 # [ 4.737870] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.738660] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.738508] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.739563] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.740568] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.741768] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.743185] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.744293] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.745282] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.885103] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 4.746466] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.747457] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.894838] systemd[1]: Detected virtualization kvm. worker2 # [ 4.749227] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.896625] systemd[1]: Detected architecture x86-64. worker2 # [ 4.750570] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.898685] systemd[1]: Detected first boot. worker2 # [ 4.751708] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.752956] systemd[1]: Stopped target Local File Systems. client # [ 4.752484] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.754163] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.754138] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.755234] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.902221] systemd[1]: Initializing machine ID from random generator. client # [ 4.755431] systemd[1]: Reached target Switch Root. worker2 # [ 4.756985] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.757429] systemd[1]: Starting NixOS Activation... worker2 # [ 4.759745] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.760725] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.761662] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.770410] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.774434] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.777077] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.779271] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.782192] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.783345] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.784637] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.786126] systemd[1]: Closed udev Control Socket. worker2 # [ 4.787292] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.789180] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.790337] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.791332] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.792710] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.793681] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.795122] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.807944] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.809328] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.810498] systemd[1]: Reached target Switch Root. worker2 # [ 4.812061] systemd[1]: Starting NixOS Activation... client # [ 4.828703] initrd-nixos-activation-start[190]: booting system configuration /nix/store/w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test client # [ 4.852936] initrd-nixos-activation-start[190]: running activation script... worker2 # [ 4.884815] initrd-nixos-activation-start[191]: booting system configuration /nix/store/i0c2a3l8xkam6y95ah3pciy5d6i6rs74-nixos-system-worker2-test worker2 # [ 4.911061] initrd-nixos-activation-start[191]: running activation script... lb # [ 5.060983] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.070753] systemd[1]: Detected virtualization kvm. lb # [ 5.072681] systemd[1]: Detected architecture x86-64. lb # [ 5.074647] systemd[1]: Detected first boot. lb # [ 5.078759] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.137434] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.040325] initrd-nixos-activation-start[213]: setting up /etc... lb # [ 5.199908] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.093281] initrd-nixos-activation-start[214]: setting up /etc... worker1 # [ 5.248808] systemd[1]: Applying preset policy. client # [ 5.134601] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.136177] systemd[1]: Finished NixOS Activation. client # [ 5.137992] systemd[1]: Starting Switch Root... client # [ 5.149720] systemd[1]: Switching root. lb # [ 5.291641] systemd[1]: Applying preset policy. worker2 # [ 5.194865] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.197094] systemd[1]: Finished NixOS Activation. worker2 # [ 5.198585] systemd[1]: Starting Switch Root... worker2 # [ 5.211537] systemd[1]: Switching root. worker1 # [ 5.380445] systemd[1]: Populated /etc with preset unit settings. client # [ 5.407238] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.470870] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 5.475286] systemd[1]: Populated /etc with preset unit settings. client # [ 5.500660] NET: Registered PF_VSOCK protocol family worker1 # [ 5.563116] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.564626] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.567138] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.569223] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.570615] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.571555] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.557940] NET: Registered PF_VSOCK protocol family worker1 # [ 5.573318] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.574477] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.575246] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.576034] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.576900] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.577629] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.578439] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.579316] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.580247] systemd[1]: Reached target Path Units. worker1 # [ 5.580968] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.581716] systemd[1]: Reached target Slice Units. worker1 # [ 5.594013] systemd[1]: Reached target Swaps. worker1 # [ 5.596208] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.598779] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.600551] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.602526] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.603466] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.606493] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.607885] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.610269] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.611650] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.612802] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.614118] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.618284] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.619359] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.620269] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.622447] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.627096] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.632232] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.638250] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.647969] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.657345] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.664003] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.670361] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.681404] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.691010] systemd[1]: Mounting FUSE Control File System... lb # [ 5.678510] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.695217] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 5.679895] systemd[1]: Stopped initrd-switch-root.service. lb # [ 5.682195] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 5.684182] systemd[1]: Created slice Slice /system/getty. lb # [ 5.685538] systemd[1]: Created slice User and Session Slice. lb # [ 5.686435] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 5.687612] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.688716] systemd[1]: Expecting device /dev/hvc0... lb # [ 5.689418] systemd[1]: Expecting device /dev/ttyS0... lb # [ 5.690154] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.690999] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.708413] systemd[1]: Starting Journal Service... lb # [ 5.691745] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.692523] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.693447] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.694329] systemd[1]: Reached target Path Units. lb # [ 5.695056] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.716844] systemd[1]: Starting Load Kernel Modules... lb # [ 5.695867] systemd[1]: Reached target Slice Units. worker1 # [ 5.724561] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.708198] systemd[1]: Reached target Swaps. lb # [ 5.710111] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.712490] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.730016] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.714220] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.732026] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.716076] systemd[1]: Listening on Factory Reset Management. lb # [ 5.717044] systemd[1]: Listening on Hostname Service Socket. lb # [ 5.719692] systemd[1]: Starting Journal Log Access Socket... lb # [ 5.721020] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.738750] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.723742] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 5.724913] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.743344] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.726037] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.727364] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.745125] systemd[1]: Mounted Huge Pages File System. worker1 # [ 5.746924] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 5.731198] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.748876] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.732243] systemd[1]: Listening on udev Control Socket. lb # [ 5.733159] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.750818] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.735261] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.754421] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.737589] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.756005] systemd[1]: Mounted FUSE Control File System. lb # [ 5.744905] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.763310] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 5.768042] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.751926] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.771166] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 5.775587] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.760991] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.774007] systemd[1]: Starting Load Kernel Module configfs... lb # [ 5.781060] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.804024] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.788738] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 5.800702] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 5.813947] systemd[1]: Mounting FUSE Control File System... worker1 # [ 5.830770] EXT4-fs (vda): re-mounted 64106a2a-e6ea-4ade-9149-0aa75911ce23. lb # [ 5.819115] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.838456] systemd-journald[283]: Collecting audit messages is enabled. worker1 # [ 5.840647] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 5.842071] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 5.844540] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.830803] systemd[1]: Starting Journal Service... lb # [ 5.837505] systemd[1]: Starting Load Kernel Modules... worker1 # [ 5.854448] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 5.856115] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.857562] loop: module loaded worker1 # [ 5.863140] systemd[1]: Finished Load Kernel Modules. lb # [ 5.850728] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.870279] systemd[1]: Starting Firewall... worker1 # [ 5.876204] systemd[1]: Starting Apply Kernel Variables... client # [ 5.859263] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.863111] systemd[1]: Detected virtualization kvm. client # [ 5.863800] systemd[1]: Detected architecture x86-64. client # [ 5.864577] systemd[1]: Detected first boot. lb # [ 5.865115] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 5.867003] systemd[1]: Initializing machine ID from random generator. lb # [ 5.867754] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.893683] systemd[1]: Started Journal Service. lb # [ 5.879038] systemd-journald[285]: Collecting audit messages is enabled. lb # [ 5.880045] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.770634] systemd[1]: Queued start job for default target Multi-User System. lb # [ 5.887448] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 5.771839] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.890095] systemd[1]: Mounted Huge Pages File System. lb # [ 5.893696] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 5.779360] systemd-modules-load[284]: Inserted module 'loop' lb # [ 5.762606] systemd[1]: Queued start job for default target Multi-User System. lb # [ 5.898487] systemd[1]: Started Journal Service. lb # [ 5.765645] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 5.785153] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 5.787251] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 5.792904] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.776306] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.777173] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.784111] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.784986] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.786161] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.916551] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.927640] systemd[1]: Detected virtualization kvm. worker2 # [ 5.929778] systemd[1]: Detected architecture x86-64. lb # [ 5.795882] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.932046] systemd[1]: Detected first boot. lb # [ 5.931498] loop: module loaded lb # [ 5.800294] systemd-modules-load[286]: Inserted module 'loop' worker2 # [ 5.935934] systemd[1]: Initializing machine ID from random generator. lb # [ 5.813104] systemd[1]: Finished Load Kernel Modules. lb # [ 5.818031] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 5.837208] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 5.839165] systemd[1]: Reached target First Boot Complete. lb # [ 5.959199] EXT4-fs (vda): re-mounted 07335991-04c2-49b5-b1b4-54c37da3080a. lb # [ 5.826610] systemd[1]: Starting Firewall... lb # [ 5.832100] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 5.991354] systemd-journald[283]: Received client request to flush runtime journal. lb # [ 5.843309] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.848650] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 5.985325] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.854105] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.865758] systemd-oomd[288]: No swap; memory pressure usage will be degraded lb # [ 5.874502] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.875560] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.887064] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.887895] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.893916] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.073989] systemd[1]: Applying preset policy. lb # [ 6.079309] systemd-journald[285]: Received client request to flush runtime journal. worker1 # [ 5.974818] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 5.977810] systemd-oomd[285]: No swap; memory pressure usage will be degraded worker1 # [ 5.980256] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 5.982168] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 5.982981] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 5.985283] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 5.986305] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.037489] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.038417] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.058399] systemd-udevd[316]: Using default interface naming scheme 'v261'. lb # [ 6.040752] systemd[1]: Reached target First Boot Complete. lb # [ 6.042716] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.177650] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.046568] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.063167] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.066515] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.135160] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 6.253550] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.277302] systemd[1]: Applying preset policy. lb # [ 6.160717] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.174034] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 6.177076] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.179100] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.203349] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.223537] systemd-udevd[325]: Using default interface naming scheme 'v261'. worker1 # [ 6.290720] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.274091] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.451940] systemd[1]: Populated /etc with preset unit settings. client # [ 6.458834] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.460185] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.462491] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.464489] systemd[1]: Created slice Slice /system/getty. client # [ 6.465834] systemd[1]: Created slice User and Session Slice. client # [ 6.466752] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.467972] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.469028] systemd[1]: Expecting device /dev/hvc0... client # [ 6.469732] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.470520] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.471380] systemd[1]: Stopped target initrd-fs.target. client # [ 6.472155] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.472908] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.473739] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.474643] systemd[1]: Reached target Path Units. client # [ 6.475440] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.367565] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.476217] systemd[1]: Reached target Slice Units. client # [ 6.488217] systemd[1]: Reached target Swaps. client # [ 6.490178] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.492655] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.494476] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.496446] systemd[1]: Listening on Factory Reset Management. client # [ 6.497357] systemd[1]: Listening on Hostname Service Socket. client # [ 6.500070] systemd[1]: Starting Journal Log Access Socket... client # [ 6.501397] systemd[1]: Listening on Journal Audit Socket. client # [ 6.504194] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.505308] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.506406] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.507699] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.511988] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.513012] systemd[1]: Listening on udev Control Socket. client # [ 6.513861] systemd[1]: Listening on udev Varlink Socket. client # [ 6.515977] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.398941] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.518436] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 6.389348] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.524371] systemd[1]: Mounting Kernel Debug File System... client # [ 6.531636] systemd[1]: Mounting Kernel Trace File System... client # [ 6.540896] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.430203] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.548666] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.435065] systemd[1]: Mounting /run/wrappers... client # [ 6.554374] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.447215] (udev-worker)[354]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.564792] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.450106] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.576228] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.591469] systemd[1]: Mounting FUSE Control File System... client # [ 6.595831] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.470675] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.492413] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.494572] systemd[1]: Reached target Local File Systems. client # [ 6.611518] systemd[1]: Starting Journal Service... worker1 # [ 6.498581] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 6.501197] systemd[1]: Starting register-nix-paths.service... client # [ 6.618275] systemd[1]: Starting Load Kernel Modules... worker1 # [ 6.504306] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.505236] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.507990] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.511136] systemd[1]: Starting Create System Files and Directories... client # [ 6.628293] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.498316] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.635548] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 6.636900] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 6.639473] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.641548] systemd[1]: Created slice Slice /system/getty. client # [ 6.641301] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.642984] systemd[1]: Created slice User and Session Slice. worker2 # [ 6.643887] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.645148] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.646247] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 6.646954] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.645290] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.647706] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 6.648510] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 6.649290] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 6.650095] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.650928] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 6.651835] systemd[1]: Reached target Path Units. worker2 # [ 6.652531] systemd[1]: Reached target Remote File Systems. client # [ 6.656233] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.653353] systemd[1]: Reached target Slice Units. client # [ 6.663524] systemd-journald[283]: Collecting audit messages is enabled. worker2 # [ 6.665550] systemd[1]: Reached target Swaps. worker2 # [ 6.667534] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.669919] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.533161] (udev-worker)[349]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.671691] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.670473] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.536330] (udev-worker)[347]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.673544] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.674477] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.541344] (udev-worker)[349]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.677351] systemd[1]: Starting Journal Log Access Socket... client # [ 6.676176] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.678481] systemd[1]: Listening on Journal Audit Socket. client # [ 6.677026] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.681221] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.682325] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 6.683464] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.682444] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.548819] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.684753] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.686477] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 6.688613] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.555724] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.689632] systemd[1]: Listening on udev Control Socket. worker2 # [ 6.690530] systemd[1]: Listening on udev Varlink Socket. client # [ 6.690826] systemd[1]: Started Journal Service. worker2 # [ 6.692631] systemd[1]: Mounting Huge Pages File System... client # [ 6.560281] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.696265] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.702515] systemd[1]: Mounting Kernel Debug File System... client # [ 6.571745] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.572810] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.575393] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 6.710497] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.594931] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.580070] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.599117] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 6.719389] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.718409] loop: module loaded client # [ 6.588234] systemd-modules-load[284]: Inserted module 'loop' lb # [ 6.590849] systemd[1]: Mounted /run/wrappers. lb # [ 6.592238] systemd[1]: Reached target Local File Systems. worker2 # [ 6.730141] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.730990] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.596474] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.599173] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.601090] systemd[1]: Starting register-nix-paths.service... client # [ 6.603260] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 6.739198] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.606770] systemd[1]: Finished Load Kernel Modules. lb # [ 6.608314] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.609241] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.616081] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.751372] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.617358] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.752167] EXT4-fs (vda): re-mounted 9015bf7c-119a-4136-b544-1ca8f2659424. worker2 # [ 6.756599] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.761975] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.646881] systemd[1]: Finished Create System Files and Directories. lb # [ 6.633425] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.651833] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.653517] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.638508] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.773417] systemd[1]: Starting Journal Service... client # [ 6.639924] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.778270] systemd[1]: Starting Load Kernel Modules... client # [ 6.647280] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.648292] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.783654] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.654324] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.790541] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.659211] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.793177] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.661063] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.798956] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.668547] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.804746] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.807277] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.809206] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.810736] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 6.814304] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 6.816234] systemd[1]: Mounted FUSE Control File System. worker2 # [ 6.820412] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 6.824576] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 6.733407] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 6.851964] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.719154] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.854354] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.852975] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.859034] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.725363] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.730912] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 6.879384] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.783079] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.902282] systemd-journald[284]: Collecting audit messages is enabled. worker1 # [ 6.786114] systemd[1]: Starting Update is Completed... worker2 # [ 6.907548] EXT4-fs (vda): re-mounted f16a84ab-7980-4d0e-a794-679d69a5229f. worker2 # [ 6.916159] loop: module loaded lb # [ 6.781497] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.917840] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.920239] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.921471] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.790303] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.927937] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.930148] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.797711] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 6.934166] systemd[1]: Finished Load Kernel Modules. client # [ 6.800430] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.801326] systemd[1]: Reached target First Boot Complete. client # [ 6.802622] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.939607] systemd[1]: Starting Firewall... client # [ 6.807349] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 6.945330] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 6.831347] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.833743] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.836764] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.821188] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.821119] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.839152] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.825619] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.823181] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.841979] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.961595] systemd[1]: Started Journal Service. worker2 # [ 6.829355] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.844558] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.827219] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.830649] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.846899] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.829130] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.831955] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.834590] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.836786] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.855388] systemd[1]: Finished Update is Completed. worker2 # [ 6.840163] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 6.848209] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 6.849374] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.866113] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.888190] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.897611] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.898743] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.901293] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 6.899490] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 6.906524] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 6.907415] systemd[1]: Reached target First Boot Complete. worker2 # [ 7.052039] systemd-journald[284]: Received client request to flush runtime journal. client # [ 6.934225] systemd-udevd[314]: Using default interface naming scheme 'v261'. lb # [ 6.938112] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.945325] systemd[1]: Starting Update is Completed... worker1 # [ 6.983344] systemd[1]: Finished Firewall. client # [ 6.969124] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.164904] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.016087] systemd[1]: Finished Update is Completed. lb # [ 7.154145] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.040744] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 7.046058] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 7.046888] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.048810] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.047962] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.050523] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 7.053089] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.054092] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.211779] ACPI: button: Power Button [PWRF] lb # [ 7.226577] ACPI: button: Power Button [PWRF] worker1 # [ 7.111874] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.096317] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 7.113743] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.112602] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.264309] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.115967] systemd-udevd[317]: Using default interface naming scheme 'v261'. worker1 # [ 7.282354] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.137528] (udev-worker)[320]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.139239] (udev-worker)[319]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.141448] (udev-worker)[319]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.302875] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 7.314214] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.189524] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.342147] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.344410] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.218715] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.219897] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.221730] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.223885] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.356928] mousedev: PS/2 mouse device common for all mice client # [ 7.225762] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.226967] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.364449] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:49:46 UTC (1790354986) lb # [ 7.366144] systemd-journald[285]: Time jumped backwards, rotating. lb # [ 7.391159] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.269367] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.420384] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.426970] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.309964] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 7.310032] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:49:46 UTC (1790354986) client # [ 7.329768] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.310112] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.317533] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.346830] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 7.348867] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 7.356936] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.322566] systemd-journald[283]: Time jumped backwards, rotating. worker1 # [ 7.323051] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.369532] systemd[1]: Mounted /run/wrappers. client # [ 7.370743] systemd[1]: Reached target Local File Systems. client # [ 7.374279] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 7.377114] systemd[1]: Starting register-nix-paths.service... client # [ 7.379202] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.380226] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.323128] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.395499] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 7.389070] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.424698] Console: switching to colour dummy device 80x25 client # [ 7.400878] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.496243] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.496357] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.420937] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 7.440911] ACPI: button: Power Button [PWRF] client # [ 7.441942] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.548205] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.548442] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.439327] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 7.460326] systemd[1]: Finished register-nix-paths.service. lb # [ 7.444603] systemd[1]: Finished register-nix-paths.service. lb # [ 7.446037] systemd[1]: Reached target System Initialization. worker1 # [ 7.464291] systemd[1]: Reached target System Initialization. lb # [ 7.448993] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 7.467170] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.450074] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.450973] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.453159] systemd[1]: Reached target Timer Units. lb # [ 7.453875] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.471837] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 7.474491] systemd[1]: Reached target Timer Units. worker2 # [ 7.460320] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.477559] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 7.459912] systemd[1]: Listening on niks3 server socket. lb # [ 7.460724] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.461471] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.463887] systemd[1]: Reached target Socket Units. lb # [ 7.464605] systemd[1]: Reached target Basic System. lb # [ 7.466941] systemd[1]: Started backdoor.service. worker1 # [ 7.486179] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.469071] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 7.494106] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 7.495295] systemd[1]: Reached target Socket Units. lb # [ 7.480113] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.484747] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.485959] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 7.504244] systemd[1]: Reached target Basic System. worker1 # [ 7.505095] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 7.507603] systemd[1]: Started backdoor.service. worker2 # [ 7.493552] (udev-worker)[352]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.492452] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.497775] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.500238] (udev-worker)[352]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.516149] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.499070] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.517417] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.519456] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.506346] systemd[1]: Mounting /run/wrappers... client # [ 7.449303] mousedev: PS/2 mouse device common for all mice lb # [ 7.507145] systemd[1]: Starting resolvconf update... client # [ 7.519568] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.537522] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 7.529348] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.530700] systemd[1]: Starting resolvconf update... client # [ 7.520688] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.541287] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 7.542330] systemd[1]: Starting Virtual Console Setup... client # [ 7.528368] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.426949] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 7.427047] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.445453] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.563446] Console: switching to colour dummy device 80x25 client # [ 7.533993] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 7.533893] systemd[1]: Started rustfs.service. lb # [ 7.549352] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 7.554441] systemd[1]: Mounted /run/wrappers. worker2 # [ 7.556784] systemd[1]: Reached target Local File Systems. worker2 # [ 7.558264] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.560722] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.563392] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.564864] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.568126] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.570478] systemd[1]: Starting Create System Files and Directories... client # [ 7.537591] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:49:47 UTC (1790354987) client # [ 7.537672] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.571381] nsncd[520]: Sep 25 16:49:46.840 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.575967] systemd[1]: Finished Firewall. lb # [ 7.577129] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # connecting to host... lb # [ 7.597560] systemd[1]: Finished Post-Boot Actions. client # [ 7.601612] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.564589] Console: switching to colour dummy device 80x25 client # [ 7.572180] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.624374] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.626571] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.631464] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 7.610599] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.610719] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.766480] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.766482] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.636179] systemd[1]: Starting Update is Completed... worker2 # [ 7.647068] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.586543] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.586727] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.650504] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 7.804176] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.804179] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.788128] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.675562] systemd[1]: Finished Post-Boot Actions. lb # [ 7.792758] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.665680] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.805032] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.805744] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.689592] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 7.828439] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.829139] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.681071] systemd[1]: Finished Update is Completed. lb # [ 7.813733] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.815402] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.681085] systemd[1]: Starting User Login Management... client # [ 7.815820] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.714530] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 7.708132] systemd[1]: Finished Create System Files and Directories. client # [ 7.841272] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.841929] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.712365] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.728361] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 7.730509] nix-grpc-daemon[511]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 7.717404] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 7.849855] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.734732] nix-grpc-daemon[511]: E0000 00:00:1790354987.035765 511 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 7.739962] nix-grpc-daemon[511]: E0000 00:00:1790354987.046879 511 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 7.727634] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 7.748376] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 7.752623] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" worker1 # [ 7.759616] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 7.764167] nix-grpc-daemon[511]: E0000 00:00:1790354987.078370 571 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # connecting to host... client # [ 7.889529] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.893475] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 7.779672] nsncd[514]: Sep 25 16:49:47.092 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 7.784157] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.784985] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.793179] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.793978] nix-grpc-daemon[511]: E0000 00:00:1790354987.114579 571 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 7.796076] nix-grpc-daemon[511]: E0000 00:00:1790354987.114873 571 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 7.798214] systemd[1]: Starting User Login Management... worker2 # [ 7.793826] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.822488] nix-grpc-daemon[511]: E0000 00:00:1790354987.142258 571 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 7.810372] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.828645] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 7.847918] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.840185] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.841365] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.843401] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.845610] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.849769] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.852280] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.855717] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.856502] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.858361] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.874389] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.860246] systemd[1]: Starting Update is Completed... lb # [ 7.866199] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 7.867221] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 7.868336] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.888236] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' lb # [ 7.870761] systemd[1]: Stopping User and Group Name Lookups... lb # [ 7.872241] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 7.892745] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.882075] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 7.903509] systemd[1]: Started D-Bus System Message Bus. lb # [ 7.886090] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.033831] Console: switching to colour frame buffer device 160x50 client # [ 8.045054] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.920530] systemd[1]: Finished Update is Completed. lb # [ 7.919833] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.930888] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.947213] dbus-broker-launch[518]: Ready client # [ 7.932794] systemd[1]: Stopped Virtual Console Setup. client # [ 7.940779] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.000678] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 8.001827] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.002678] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 8.003552] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 8.004374] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.011569] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.013165] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.021087] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.144161] ppdev: user-space parallel port driver worker1 # [ 8.032119] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 8.043725] systemd-logind[590]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 8.052587] systemd[1]: Finished Firewall. client # [ 8.184545] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.057495] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.060672] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.074908] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.076687] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.210647] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 8.213243] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.083855] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.240888] ACPI: button: Power Button [PWRF] lb # [ 8.220660] ppdev: user-space parallel port driver lb # [ 8.225605] Console: switching to colour frame buffer device 160x50 lb # [ 8.246232] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 7.941840] dbus-broker-launch[553]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.116444] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.120816] dbus-broker-launch[553]: NSS returned no entry for 'systemd-timesync' lb # [ 8.122750] dbus-broker-launch[553]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.126106] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.129975] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.135679] nsncd[611]: Sep 25 16:49:47.270 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.140489] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.141466] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.142547] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.143892] dbus-broker-launch[553]: Ready lb # [ 8.146754] systemd[1]: Finished resolvconf update. lb # [ 8.147458] systemd[1]: Reached target Preparation for Network. lb # [ 8.149283] systemd[1]: Starting DHCP Client... lb # [ 8.149962] systemd[1]: Starting Address configuration of eth1... lb # [ 8.152129] systemd[1]: Starting Extra networking commands.... lb # [ 8.152925] systemd-logind[555]: New seat seat0. lb # [ 8.155772] systemd[1]: Started User Login Management. lb # [ 8.156503] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.292837] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 8.157480] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.158201] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.163253] systemd[1]: Starting linger-users.service... lb # [ 8.168680] systemd[1]: Starting Virtual Console Setup... client # [ 8.311646] kvm_amd: TSC scaling supported client # [ 8.312090] kvm_amd: Nested Virtualization enabled client # [ 8.312907] kvm_amd: Nested Paging enabled client # [ 8.313467] kvm_amd: LBR virtualization supported client # [ 8.313913] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.314616] kvm_amd: Virtual GIF supported client # [ 8.315001] kvm_amd: Virtual NMI enabled worker2 # [ 8.190086] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.193038] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 8.343664] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.353260] EDAC MC: Ver: 3.0.0 worker1 # [ 8.251462] ppdev: user-space parallel port driver lb # [ 8.271081] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.280444] systemd[1]: Finished linger-users.service. worker1 # [ 8.380441] Console: switching to colour frame buffer device 160x50 worker1 # [ 8.408318] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.314505] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.335469] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 8.292564] network-addresses-eth1-start[637]: adding address 192.168.1.2/24... done worker1 # [ 8.425839] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.456235] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.045583] systemd-logind[590]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.328209] dhcpcd[673]: dhcpcd-10.3.2 starting lb # [ 8.447180] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.333516] nsncd[637]: Sep 25 16:49:47.401 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.320146] network-addresses-eth1-start[637]: adding address 2001:db8:1::2/64... done worker1 # [ 8.341732] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.342867] dhcpcd[729]: dev: loaded udev worker1 # [ 8.346377] network-addresses-eth1-start[664]: adding address 192.168.1.3/24... done worker1 # [ 8.351491] network-addresses-eth1-start[664]: adding address 2001:db8:1::3/64... done worker1 # [ 8.352771] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.358352] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.497143] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 8.497611] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.365641] systemd[1]: Finished resolvconf update. worker1 # [ 8.368663] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.372245] systemd[1]: Starting DHCP Client... worker2 # [ 8.341472] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.373261] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.341535] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:49:47 UTC (1790354987) worker1 # [ 8.376408] systemd[1]: Starting Extra networking commands.... lb # [ 8.358618] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.381332] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.382236] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.383122] systemd[1]: Reached target Network. worker1 # [ 8.383771] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.384822] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.389178] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.389857] systemd-logind[590]: New seat seat0. worker1 # [ 8.390609] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.392507] systemd-logind[590]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.395104] systemd[1]: Started User Login Management. worker2 # [ 8.341608] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.395857] systemd[1]: Starting linger-users.service... worker2 # [ 8.342320] systemd-journald[284]: Time jumped backwards, rotating. worker2 # [ 8.348713] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.384200] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.388252] systemd[1]: Finished register-nix-paths.service. lb # [ 8.388494] systemd[1]: Stopped Virtual Console Setup. client # [ 8.398771] systemd-vconsole-setup[417]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.402095] systemd[1]: Finished Virtual Console Setup. client # [ 8.403454] systemd[1]: Reached target System Initialization. worker2 # [ 8.348793] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 8.404830] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 8.424302] Console: switching to colour dummy device 80x25 client # [ 8.406200] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 8.434863] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 8.408206] systemd[1]: Reached target Timer Units. client # [ 8.408907] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.409768] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.408963] systemd[1]: Starting Virtual Console Setup... client # [ 8.410625] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.411784] systemd[1]: Reached target Socket Units. client # [ 8.412561] systemd[1]: Reached target Basic System. client # [ 8.414168] systemd[1]: Started backdoor.service. worker1 # [ 8.430526] nix-grpc-daemon[511]: ts=2026-09-25T16:49:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" client # [ 8.417087] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.421510] systemd[1]: Starting nftables firewall... client # [ 8.427447] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.446252] systemd[1]: Finished Permit User Sessions. client # [ 8.435069] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.454650] systemd[1]: Started Getty on tty1. worker2 # [ 8.447163] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 8.552052] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.457118] systemd[1]: Reached target Login Prompts. worker2 # [ 8.552193] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.444622] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.478291] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.463787] systemd[1]: Starting resolvconf update... worker1 # [ 8.482301] systemd[1]: Finished linger-users.service. worker2 # [ 8.607335] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 8.607337] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 8.612224] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 8.612898] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.486356] dhcpcd[659]: dhcpcd-10.3.2 starting client # connecting to host... worker2 # [ 8.622450] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.623665] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 8.497316] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.518810] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.504475] dhcpcd[715]: dev: loaded udev worker1 # [ 8.656997] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 8.511881] systemd[1]: Finished register-nix-paths.service. worker2 # [ 8.515250] systemd[1]: Reached target System Initialization. worker2 # [ 8.517938] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 8.520964] systemd[1]: Started Daily Cleanup of Temporary Directories. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 8.523057] systemd[1]: Reached target Timer Units. lb # [ 8.519501] systemd[1]: Finished Extra networking commands.. lb # [ 8.522446] systemd[1]: Reached target Network. client # [ 8.532941] nsncd[425]: Sep 25 16:49:48.626 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.523740] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.538240] systemd[1]: Starting PostgreSQL Server... worker2 # [ 8.527164] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.540646] systemd[1]: Starting Permit User Sessions... client # [ 8.539279] systemd[1]: Finished Post-Boot Actions. client: connected to guest root shell lb # [ 8.700247] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.700679] 8021q: adding VLAN 0 to HW filter on device eth1 client: (connecting took 9.27 seconds) client # [ 8.539934] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.530916] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.718935] kvm_amd: TSC scaling supported client: (finished: waiting for the VM to finish booting, in 9.27 seconds) client # [ 8.543100] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.532042] systemd[1]: Reached target Socket Units. client # [ 8.543900] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.533123] systemd[1]: Reached target Basic System. client # [ 8.556913] systemd[1]: Starting User Login Management... worker2 # [ 8.537304] systemd[1]: Started backdoor.service. worker1 # [ 8.719336] kvm_amd: Nested Virtualization enabled worker2 # [ 8.542189] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.720148] kvm_amd: Nested Paging enabled worker2 # [ 8.543159] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.720530] kvm_amd: LBR virtualization supported worker2 # [ 8.544021] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.721244] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.560316] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.721687] kvm_amd: Virtual GIF supported worker2 # [ 8.544739] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.722354] kvm_amd: Virtual NMI enabled worker2 # [ 8.551214] systemd[1]: Starting resolvconf update... worker1 # [ 8.734535] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.554664] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.735241] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.596294] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.737549] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 8.738415] cfg80211: failed to load regulatory.db worker1 # [ 8.765076] EDAC MC: Ver: 3.0.0 lb # [ 8.759256] kvm_amd: TSC scaling supported lb # [ 8.759699] kvm_amd: Nested Virtualization enabled worker1 # [ 8.781370] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.649848] dhcpcd[729]: eth0: waiting for carrier worker1 # [ 8.651040] dhcpcd[729]: eth0: carrier acquired worker2 # [ 8.636928] systemd[1]: Finished Post-Boot Actions. worker1 # [ 8.656734] dhcpcd[729]: DUID 00:01:00:01:32:49:62:ab:52:54:00:12:34:56 lb # [ 8.639350] systemd[1]: Finished Permit User Sessions. lb # [ 8.774084] kvm_amd: Nested Paging enabled worker1 # [ 8.658221] dhcpcd[729]: eth0: IAID 00:12:34:56 lb # [ 8.774479] kvm_amd: LBR virtualization supported worker1 # [ 8.658888] dhcpcd[729]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.776769] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 8.778836] kvm_amd: Virtual GIF supported lb # [ 8.779224] kvm_amd: Virtual NMI enabled client # [ 8.649683] dbus-broker-launch[436]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.654230] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 8.659849] dbus-broker-launch[436]: NSS returned no entry for 'systemd-timesync' client # [ 8.660860] dbus-broker-launch[436]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.664709] systemd[1]: Started Getty on tty1. lb # [ 8.666939] systemd[1]: Reached target Login Prompts. worker2 # connecting to host... client # [ 8.672192] systemd-logind[455]: New seat seat0. client # [ 8.680272] systemd-logind[455]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.681450] systemd-logind[455]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 8.682870] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.682703] systemd-logind[455]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.698496] systemd-vconsole-setup[731]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.683915] nsncd[514]: Sep 25 16:49:47.972 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.702234] systemd[1]: Finished Virtual Console Setup. worker2 # [ 8.688192] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.688791] systemd[1]: Started User Login Management. worker2 # [ 8.691727] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.693289] systemd[1]: Starting User Login Management... worker2 # [ 8.713803] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 8.722110] systemd[1]: Started D-Bus System Message Bus. client # [ 8.731167] systemd[1]: Starting linger-users.service... client # [ 8.733378] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.734286] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.735687] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.870728] EDAC MC: Ver: 3.0.0 client # [ 8.738613] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.740609] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.745244] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 8.747859] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.751174] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.762347] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' worker2 # [ 8.763712] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 8.764465] dbus-broker-launch[436]: Ready worker2 # [ 8.779376] systemd[1]: Started D-Bus System Message Bus. client # [ 8.788516] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.929199] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.951180] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.819570] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.953075] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 8.822620] systemd[1]: Finished linger-users.service. lb # [ 8.955218] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 8.956071] cfg80211: failed to load regulatory.db client # [ 8.840185] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.841871] nsncd[521]: Sep 25 16:49:48.933 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.844914] systemd[1]: Finished resolvconf update. client # [ 8.846959] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.848158] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.851757] systemd[1]: Starting DHCP Client... lb # [ 8.869197] postgresql-pre-start[732]: The files belonging to this database system will be owned by user "postgres". lb # [ 8.870577] postgresql-pre-start[732]: This user must also own the server process. lb # [ 8.878486] postgresql-pre-start[732]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 8.879687] postgresql-pre-start[732]: The default database encoding has accordingly been set to "UTF8". lb # [ 8.880867] postgresql-pre-start[732]: The default text search configuration will be set to "english". lb # [ 8.881976] postgresql-pre-start[732]: Data page checksums are enabled. lb # [ 8.882849] postgresql-pre-start[732]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 8.885834] postgresql-pre-start[732]: creating subdirectories ... ok lb # [ 8.886671] postgresql-pre-start[732]: selecting dynamic shared memory implementation ... posix lb # [ 9.035633] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.903802] dhcpcd[715]: eth0: waiting for carrier lb # [ 8.904959] dhcpcd[715]: eth0: carrier acquired worker2 # [ 9.042355] Console: switching to colour frame buffer device 160x50 lb # [ 8.918463] dhcpcd[715]: DUID 00:01:00:01:32:49:62:ac:52:54:00:12:34:56 lb # [ 8.919376] dhcpcd[715]: eth0: IAID 00:12:34:56 lb # [ 8.920085] dhcpcd[715]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 9.051596] ppdev: user-space parallel port driver client # [ 8.948038] dhcpcd[551]: dhcpcd-10.3.2 starting client # [ 8.953647] dhcpcd[559]: dev: loaded udev worker2 # [ 9.092186] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 8.816291] dbus-broker-launch[518]: Ready client # [ 9.095387] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.968191] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.969796] postgresql-pre-start[732]: selecting default "max_connections" ... 100 worker2 # [ 8.974661] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 8.977706] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 8.983460] nsncd[587]: Sep 25 16:49:48.194 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.991742] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 8.992726] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.994780] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.996081] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 8.996962] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.999963] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.001296] systemd-logind[541]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 9.004554] systemd-logind[541]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 9.007145] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 9.007966] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 9.011170] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.013901] systemd[1]: Finished resolvconf update. worker2 # [ 9.016414] systemd[1]: Reached target Preparation for Network. worker2 # [ 9.019506] systemd[1]: Starting DHCP Client... worker2 # [ 9.022474] systemd[1]: Starting Address configuration of eth1... worker2 # [ 9.023420] systemd[1]: Starting Extra networking commands.... worker2 # [ 9.025446] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.027847] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.029101] systemd-logind[541]: New seat seat0. worker2 # [ 9.029781] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.032589] systemd[1]: Started User Login Management. worker2 # [ 9.034909] systemd[1]: Starting linger-users.service... client # [ 9.170861] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 9.043919] systemd-logind[541]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 9.050569] postgresql-pre-start[732]: selecting default "shared_buffers" ... 128MB client # [ 9.192892] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.193590] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.059769] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 9.195675] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.196557] cfg80211: failed to load regulatory.db worker2 # [ 9.198360] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 9.063944] systemd[1]: Finished Virtual Console Setup. worker2 # [ 9.075731] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 9.079294] systemd[1]: Finished linger-users.service. client # [ 9.087788] systemd[1]: Finished nftables firewall. client # [ 9.089883] systemd[1]: Reached target Preparation for Network. client # [ 9.094494] systemd[1]: Starting Address configuration of eth1... worker2 # [ 9.098716] network-addresses-eth1-start[615]: adding address 192.168.1.4/24... done client # [ 9.102248] systemd[1]: Starting Extra networking commands.... client # [ 9.244738] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 9.113587] network-addresses-eth1-start[615]: adding address 2001:db8:1::4/64... done client # [ 9.114138] dhcpcd[559]: eth0: waiting for carrier client # [ 9.114895] dhcpcd[559]: eth0: carrier acquired client # [ 9.126463] dhcpcd[559]: DUID 00:01:00:01:32:49:62:ad:52:54:00:12:34:56 client # [ 9.127536] dhcpcd[559]: eth0: IAID 00:12:34:56 client # [ 9.128538] dhcpcd[559]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 9.133534] systemd[1]: Finished Address configuration of eth1. client # [ 9.284239] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.291361] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 9.162474] network-addresses-eth1-start[579]: adding address 192.168.1.1/24... done client # [ 9.173439] network-addresses-eth1-start[579]: adding address 2001:db8:1::1/64... done client # [ 9.185836] systemd[1]: Finished Address configuration of eth1. client # [ 9.208249] systemd[1]: Finished Extra networking commands.. client # [ 9.210158] systemd[1]: Reached target Network. client # [ 9.212238] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.231767] nix-grpc-daemon[511]: ts=2026-09-25T16:49:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" client # [ 9.227576] systemd[1]: Finished Permit User Sessions. client # [ 9.230787] systemd[1]: Started Getty on tty1. client # [ 9.232101] systemd[1]: Reached target Login Prompts. worker2 # [ 9.233329] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.234416] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.236205] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.264766] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.265667] systemd[1]: Reached target Network. worker2 # [ 9.268224] systemd[1]: Starting Permit User Sessions... worker2 # [ 9.269969] dhcpcd[628]: dhcpcd-10.3.2 starting worker2 # [ 9.280153] dhcpcd[690]: dev: loaded udev worker2 # [ 9.428184] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 9.428611] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.358075] systemd[1]: Finished Permit User Sessions. worker2 # [ 9.358820] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 9.374400] systemd[1]: Started Getty on tty1. worker2 # [ 9.375144] systemd[1]: Reached target Login Prompts. worker2 # [ 9.568639] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 9.591488] kvm_amd: TSC scaling supported worker2 # [ 9.591929] kvm_amd: Nested Virtualization enabled worker2 # [ 9.592637] kvm_amd: Nested Paging enabled worker2 # [ 9.593383] kvm_amd: LBR virtualization supported worker2 # [ 9.593825] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 9.594559] kvm_amd: Virtual GIF supported worker2 # [ 9.594988] kvm_amd: Virtual NMI enabled worker2 # [ 9.611688] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 9.612420] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 9.614238] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 9.615056] cfg80211: failed to load regulatory.db worker2 # [ 9.638706] EDAC MC: Ver: 3.0.0 worker2 # [ 9.653862] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 9.521820] dhcpcd[690]: eth0: waiting for carrier worker2 # [ 9.522931] dhcpcd[690]: eth0: carrier acquired worker2 # [ 9.528879] dhcpcd[690]: DUID 00:01:00:01:32:49:62:ac:52:54:00:12:34:56 worker2 # [ 9.530074] dhcpcd[690]: eth0: IAID 00:12:34:56 worker2 # [ 9.530720] dhcpcd[690]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 9.579701] systemd-vconsole-setup[684]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 9.582261] systemd[1]: Finished Virtual Console Setup. lb # [ 9.636634] postgresql-pre-start[732]: selecting default time zone ... UTC lb # [ 9.639430] postgresql-pre-start[732]: creating configuration files ... ok lb # [ 9.806620] postgresql-pre-start[732]: running bootstrap script ... ok client: (finished: waiting for unit network-addresses-eth1.service, in 10.52 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service lb # [ 10.235979] postgresql-pre-start[732]: performing post-bootstrap initialization ... ok worker1 # [ 10.267069] dhcpcd[729]: eth0: soliciting a DHCP lease worker1 # [ 10.417321] NET: Registered PF_PACKET protocol family worker1 # [ 10.291699] dhcpcd[729]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.296363] dhcpcd[729]: eth0: probing address 10.0.2.15/24 lb # [ 10.382045] postgresql-pre-start[732]: syncing data to disk ... ok lb # [ 10.382985] postgresql-pre-start[732]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.384161] postgresql-pre-start[732]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.386028] postgresql-pre-start[732]: Success. You can now start the database server using: lb # [ 10.387040] postgresql-pre-start[732]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 10.458288] postgres[779]: [779] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.461104] postgres[779]: [779] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.462274] postgres[779]: [779] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.465148] postgres[779]: [779] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 10.477175] postgres[788]: [788] LOG: database system was shut down at 2026-09-25 16:49:49 GMT lb # [ 10.482617] postgres[779]: [779] LOG: database system is ready to accept connections lb # [ 10.488431] systemd[1]: Started PostgreSQL Server. lb # [ 10.494430] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 10.616771] postgresql-setup-start[799]: CREATE DATABASE worker1 # [ 10.645112] dhcpcd[729]: eth0: soliciting an IPv6 router worker1 # [ 10.648838] dhcpcd[729]: eth0: Router Advertisement from fe80::2 lb # [ 10.634957] dhcpcd[715]: eth0: soliciting an IPv6 router worker1 # [ 10.651339] dhcpcd[729]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 10.635824] dhcpcd[715]: eth0: Router Advertisement from fe80::2 lb # [ 10.636591] dhcpcd[715]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.653900] dhcpcd[729]: eth0: adding route to fec0::/64 lb # [ 10.637456] dhcpcd[715]: eth0: adding route to fec0::/64 lb # [ 10.638650] dhcpcd[715]: eth0: adding default route via fe80::2 worker1 # [ 10.656302] dhcpcd[729]: eth0: adding default route via fe80::2 lb # [ 10.650204] postgresql-setup-start[804]: CREATE ROLE lb # [ 10.660276] postgresql-setup-start[806]: ALTER DATABASE lb # [ 10.665059] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.666790] systemd[1]: Reached target PostgreSQL. worker1 # [ 10.832691] nix-grpc-daemon[511]: ts=2026-09-25T16:49:50Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 10.884805] dhcpcd[715]: eth0: soliciting a DHCP lease lb # [ 11.036634] NET: Registered PF_PACKET protocol family lb # [ 10.908705] dhcpcd[715]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 10.912142] dhcpcd[715]: eth0: probing address 10.0.2.15/24 worker2 # [ 11.045616] dhcpcd[690]: eth0: soliciting an IPv6 router worker2 # [ 11.048504] dhcpcd[690]: eth0: Router Advertisement from fe80::2 worker2 # [ 11.050596] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 11.052993] dhcpcd[690]: eth0: adding route to fec0::/64 worker2 # [ 11.054790] dhcpcd[690]: eth0: adding default route via fe80::2 worker2 # [ 11.062478] dhcpcd[690]: eth0: soliciting a DHCP lease worker2 # [ 11.212801] NET: Registered PF_PACKET protocol family worker2 # [ 11.086217] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 11.089377] dhcpcd[690]: eth0: probing address 10.0.2.15/24 client # [ 11.112199] dhcpcd[559]: eth0: soliciting a DHCP lease client # [ 11.262345] NET: Registered PF_PACKET protocol family client # [ 11.138137] dhcpcd[559]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 11.141369] dhcpcd[559]: eth0: probing address 10.0.2.15/24 client # [ 11.847859] dhcpcd[559]: eth0: soliciting an IPv6 router client # [ 11.850382] dhcpcd[559]: eth0: Router Advertisement from fe80::2 client # [ 11.852984] dhcpcd[559]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 11.855351] dhcpcd[559]: eth0: adding route to fec0::/64 client # [ 11.857304] dhcpcd[559]: eth0: adding default route via fe80::2 worker1 # [ 14.033211] nix-grpc-daemon[511]: ts=2026-09-25T16:49:53Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 14.808674] dhcpcd[729]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 14.811688] dhcpcd[729]: eth0: adding route to 10.0.2.0/24 worker1 # [ 14.814499] dhcpcd[729]: eth0: adding default route via 10.0.2.2 worker1 # [ 14.896418] systemd[1]: Started DHCP Client. worker1 # [ 14.898168] systemd[1]: Reached target Multi-User System. worker1 # [ 14.898887] systemd[1]: Startup finished in 855ms (kernel) + 3.517s (initrd) + 10.525s (userspace) = 14.897s. client # [ 15.624157] dhcpcd[559]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 15.627529] dhcpcd[559]: eth0: adding route to 10.0.2.0/24 client # [ 15.629829] dhcpcd[559]: eth0: adding default route via 10.0.2.2 client # [ 15.710646] systemd[1]: Started DHCP Client. client # [ 15.712406] systemd[1]: Reached target Multi-User System. client # [ 15.713448] systemd[1]: Startup finished in 871ms (kernel) + 4.473s (initrd) + 10.367s (userspace) = 15.713s. worker2 # [ 16.154595] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 16.157465] dhcpcd[690]: eth0: adding route to 10.0.2.0/24 worker2 # [ 16.160202] dhcpcd[690]: eth0: adding default route via 10.0.2.2 worker2 # [ 16.247773] systemd[1]: Started DHCP Client. worker2 # [ 16.250209] systemd[1]: Reached target Network is Online. worker2 # [ 16.252156] systemd[1]: Starting scheduler-token.service... worker2 # [ 16.284277] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 16.285774] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 16.287739] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 16.289264] systemd[1]: Dependency failed for Nix worker-protocol over gRPC. worker2 # [ 16.291169] systemd[1]: nix-grpc-daemon.service: Job nix-grpc-daemon.service/start failed with result 'dependency'. worker2 # [ 16.292908] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 35ms wall clock time, 3.1M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. worker2 # [ 16.294776] systemd[1]: Reached target Multi-User System. worker2 # [ 16.295539] systemd[1]: Startup finished in 851ms (kernel) + 4.550s (initrd) + 10.890s (userspace) = 16.292s. lb # [ 16.530570] dhcpcd[715]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.533520] dhcpcd[715]: eth0: adding route to 10.0.2.0/24 lb # [ 16.535917] dhcpcd[715]: eth0: adding default route via 10.0.2.2 lb # [ 16.619571] systemd[1]: Started DHCP Client. lb # [ 16.622410] systemd[1]: Reached target Network is Online. lb # [ 16.626381] systemd[1]: Started Envoy reverse proxy. lb # [ 16.634148] systemd[1]: Started mock-oidc.service. lb # [ 16.727159] mock-oidc-server[921]: Mock OIDC Server running lb # [ 16.728150] mock-oidc-server[921]: OIDC Address: 192.168.1.2:8080 lb # [ 16.729256] mock-oidc-server[921]: Issue Address: 0.0.0.0:8081 lb # [ 16.730231] mock-oidc-server[921]: Issuer: http://192.168.1.2:8080/oidc lb # [ 16.731423] mock-oidc-server[921]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 16.732685] mock-oidc-server[921]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 16.734250] mock-oidc-server[921]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 16.946412] envoy[919]: [2026-09-25 16:49:56.215][919][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 16.949102] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 16.950540] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 16.952227] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 16.954986] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 16.967879] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 16.974187] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 16.976616] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 16.978828] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 16.980876] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 16.982943] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 16.986273] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 16.992281] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 16.993988] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 16.996638] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 16.998284] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 17.001079] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.003693] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 17.006339] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 17.008604] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 17.010151] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 17.017110] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 17.019118] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 17.023124] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 17.025112] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 17.028225] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 17.030491] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 17.032194] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 17.034440] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 17.037040] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 17.040577] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 17.042526] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 17.044090] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 17.046321] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 17.048655] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 17.050238] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 17.055026] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 17.056950] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 17.058620] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 17.060346] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 17.062448] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 17.064379] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 17.066903] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 17.071088] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 17.072733] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 17.074176] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 17.075748] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 17.078714] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 17.080362] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 17.082157] envoy[919]: [2026-09-25 16:49:56.217][919][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 17.086258] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 17.089453] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 17.091309] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 17.095198] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 17.096968] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 17.099148] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.101651] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 17.103856] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 17.106241] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 17.107906] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 17.109470] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 17.110970] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 17.115555] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 17.117594] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 17.126793] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 17.133082] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 17.135668] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 17.137397] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 17.142088] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 17.144441] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 17.146475] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 17.148281] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 17.150087] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 17.152320] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 17.155195] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 17.159388] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 17.163086] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 17.164740] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 17.166628] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 17.168217] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 17.171068] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.173043] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 17.175274] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 17.176950] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 17.178553] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 17.180283] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 17.182245] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 17.184641] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.186435] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 17.189343] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 17.192046] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 17.196442] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 17.207619] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 17.209305] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 17.211170] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 17.212941] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 17.216085] envoy[919]: [2026-09-25 16:49:56.218][919][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 17.217698] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 17.219968] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 17.225104] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 17.227134] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 17.229561] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 17.231199] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 17.235196] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 17.241143] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 17.242746] envoy[919]: [2026-09-25 16:49:56.224][919][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 17.267602] envoy[919]: [2026-09-25 16:49:56.235][919][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 17.270091] envoy[919]: [2026-09-25 16:49:56.243][919][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 17.282750] envoy[919]: [2026-09-25 16:49:56.243][919][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 17.284110] envoy[919]: [2026-09-25 16:49:56.243][919][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 17.291417] envoy[919]: [2026-09-25 16:49:56.243][919][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 17.295926] envoy[919]: [2026-09-25 16:49:56.565][919][info][main] [source/server/server.cc:968] runtime: {} lb # [ 17.298965] envoy[919]: [2026-09-25 16:49:56.568][919][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 17.300726] envoy[919]: [2026-09-25 16:49:56.569][919][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 17.302440] envoy[919]: [2026-09-25 16:49:56.571][919][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 17.304361] envoy[919]: [2026-09-25 16:49:56.573][919][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 17.306115] envoy[919]: [2026-09-25 16:49:56.575][919][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 17.307514] envoy[919]: [2026-09-25 16:49:56.575][919][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 17.324447] envoy[919]: [2026-09-25 16:49:56.593][919][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 17.329246] envoy[919]: [2026-09-25 16:49:56.598][919][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 17.331119] envoy[919]: [2026-09-25 16:49:56.600][919][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 17.334149] envoy[919]: [2026-09-25 16:49:56.603][919][info][main] [source/server/server.cc:1077] starting main dispatch loop lb # [ 17.335702] envoy[919]: [2026-09-25 16:49:56.605][919][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 17.337783] envoy[919]: [2026-09-25 16:49:56.606][919][info][upstream] [source/common/upstream/cluster_manager_impl.cc:227] cm init: initializing secondary clusters worker2 # [ 17.536899] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 1. worker2 # [ 17.543909] systemd[1]: Starting scheduler-token.service... worker2 # [ 17.603600] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.606630] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.609566] systemd[1]: scheduler-token.service: Consumed 33ms CPU time over 1.316s wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb # [ 17.844324] rustfs-bucket-start[945]: mb s3://farm lb # [ 17.853501] systemd[1]: Finished rustfs-bucket.service. lb # [ 17.859340] systemd[1]: Starting niks3 server... lb # [ 17.977218] postgres[962]: [962] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 17.978503] postgres[962]: [962] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 18.000358] niks3-server[957]: 2026/09/25 16:49:57 OK 20241026095416_initial_model.sql (12.94ms) lb # [ 18.003885] niks3-server[957]: 2026/09/25 16:49:57 OK 20251210153512_drop_unused_gin_index.sql (3.67ms) lb # [ 18.009334] niks3-server[957]: 2026/09/25 16:49:57 OK 20251218171726_add_pins.sql (3.95ms) lb # [ 18.013451] niks3-server[957]: 2026/09/25 16:49:57 OK 20260628120000_add_object_size_and_stats.sql (4.1ms) lb # [ 18.017709] niks3-server[957]: 2026/09/25 16:49:57 OK 20260905000000_add_claims.sql (4.21ms) lb # [ 18.021523] niks3-server[957]: 2026/09/25 16:49:57 OK 20260920000000_drop_claims.sql (3.78ms) lb # [ 18.024430] niks3-server[957]: 2026/09/25 16:49:57 OK 20260923120000_add_pushes.sql (2.82ms) lb # [ 18.025485] niks3-server[957]: 2026/09/25 16:49:57 goose: successfully migrated database to version: 20260923120000 lb # [ 18.029381] niks3-server[957]: 2026/09/25 16:49:57 OK 1_commit_pending_closure.sql (4.91ms) lb # [ 18.032095] niks3-server[957]: 2026/09/25 16:49:57 OK 2_object_stats_trigger.sql (2.69ms) lb # [ 18.034682] niks3-server[957]: 2026/09/25 16:49:57 OK 3_commit_push.sql (2.5ms) lb # [ 18.035605] niks3-server[957]: 2026/09/25 16:49:57 goose: up to current file version: 3 lb # [ 18.038814] niks3-server[957]: 2026/09/25 16:49:57 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 18.067586] niks3-server[957]: 2026/09/25 16:49:57 INFO Read proxy enabled — serving cache objects from S3 lb # [ 18.069609] niks3-server[957]: 2026/09/25 16:49:57 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 18.071498] niks3-server[957]: 2026/09/25 16:49:57 INFO systemd watchdog enabled interval=15s lb # [ 18.074151] systemd[1]: Started niks3 server. lb # [ 18.074761] systemd[1]: Reached target Multi-User System. lb # [ 18.075803] niks3-server[957]: 2026/09/25 16:49:57 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 18.078073] systemd[1]: Startup finished in 880ms (kernel) + 3.663s (initrd) + 13.533s (userspace) = 18.077s. lb: (finished: waiting for unit niks3.service, in 8.72 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.04 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost worker1 # [ 19.033816] nix-grpc-daemon[511]: ts=2026-09-25T16:49:58Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" worker1 # [ 24.034562] nix-grpc-daemon[511]: ts=2026-09-25T16:50:03Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 28.083754] niks3-server[957]: 2026/09/25 16:50:07 INFO lead: acquired remote=192.168.1.3:40638 worker1 # [ 28.102456] nix-grpc-daemon[511]: ts=2026-09-25T16:50:07Z level=info event=scheduler_take_over worker1 # [ 29.034607] nix-grpc-daemon[511]: ts=2026-09-25T16:50:08Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 32.336866] envoy[919]: [2026-09-25 16:50:11.605][919][warning][config] [source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:130] gRPC config: initial fetch timed out for type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment lb # [ 32.343685] envoy[919]: [2026-09-25 16:50:11.605][919][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 32.347816] envoy[919]: [2026-09-25 16:50:11.605][919][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 32.353467] envoy[919]: [2026-09-25 16:50:11.622][919][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 32.420651] envoy[919]: conn peer=[::1]:37730 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=4 lb: (finished: waiting for TCP port 50051 on localhost, in 13.48 seconds) worker2 # [ 32.523056] systemd[1]: Starting scheduler-token.service... worker2 # [ 32.567206] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 32.568707] systemd[1]: Finished scheduler-token.service. worker2 # [ 32.569986] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 47ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 32.574513] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 32.667468] nix-grpc-daemon[800]: ts=2026-09-25T16:50:11Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 32.677539] nix-grpc-daemon[800]: ts=2026-09-25T16:50:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 32.679762] nix-grpc-daemon[800]: ts=2026-09-25T16:50:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 32.692718] nix-grpc-daemon[800]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 32.694280] nix-grpc-daemon[800]: E0000 00:00:1790355011.983880 800 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 32.699872] nix-grpc-daemon[800]: E0000 00:00:1790355011.991360 800 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 32.703615] nix-grpc-daemon[800]: ts=2026-09-25T16:50:11Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 32.707516] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 32.716078] nix-grpc-daemon[800]: E0000 00:00:1790355012.007463 842 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 32.728893] nix-grpc-daemon[800]: E0000 00:00:1790355012.020329 842 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 32.733052] nix-grpc-daemon[800]: E0000 00:00:1790355012.022529 842 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 32.743044] nix-grpc-daemon[800]: E0000 00:00:1790355012.034459 842 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 32.760347] nix-grpc-daemon[800]: ts=2026-09-25T16:50:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.792797] nix-grpc-daemon[511]: ts=2026-09-25T16:50:12Z level=info event=oidc_jwks provider=mock keys=1 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 32.796533] nix-grpc-daemon[511]: ts=2026-09-25T16:50:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:35488 worker1 # [ 32.800383] nix-grpc-daemon[511]: ts=2026-09-25T16:50:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 34.036723] nix-grpc-daemon[511]: ts=2026-09-25T16:50:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.041654] nix-grpc-daemon[511]: ts=2026-09-25T16:50:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:35488 worker1 # [ 34.045209] nix-grpc-daemon[511]: ts=2026-09-25T16:50:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 37.759787] nix-grpc-daemon[511]: E0000 00:00:1790355017.081042 569 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 37.789147] nix-grpc-daemon[511]: E0000 00:00:1790355017.111497 569 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 37.799128] nix-grpc-daemon[511]: E0000 00:00:1790355017.117975 569 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 37.819760] nix-grpc-daemon[511]: E0000 00:00:1790355017.142317 569 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 48.660913] nix-grpc-daemon[511]: ts=2026-09-25T16:50:27Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:46602 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 16.80 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.45 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 50.164199] nix-grpc-daemon[800]: ts=2026-09-25T16:50:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 50.175462] systemd[1]: Started Nix Daemon. worker2 # [ 50.291743] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 50.306830] nix-grpc-daemon[800]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 1/5) worker2 # [ 50.326461] nix-grpc-daemon[800]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 2/5) worker2 # [ 50.410652] nix-grpc-daemon[800]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 318 ms (attempt 3/5) worker2 # [ 50.730938] nix-grpc-daemon[800]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 4/5) worker2 # [ 50.820290] nix-grpc-daemon[800]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 50.823717] nix-grpc-daemon[800]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 50.844150] nix-grpc-daemon[800]: ts=2026-09-25T16:50:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 50.855662] nix-grpc-daemon[800]: ts=2026-09-25T16:50:30Z level=debug event=path_info_miss path=w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test error="error: path '/nix/store/w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 50.885193] nix-grpc-daemon[511]: ts=2026-09-25T16:50:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 50.896488] systemd[1]: Started Nix Daemon. worker1 # [ 51.003583] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 51.022897] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) worker1 # [ 51.078295] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 2/5) worker1 # [ 51.117290] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 3/5) worker1 # [ 51.245211] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 287 ms (attempt 4/5) worker1 # [ 51.535686] nix-grpc-daemon[511]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 51.539648] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 51.552086] nix-grpc-daemon[511]: ts=2026-09-25T16:50:30Z level=debug event=path_info_miss path=w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test error="error: path '/nix/store/w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 51.773708] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46616 worker1 # [ 51.788358] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46616 worker1 # [ 51.797503] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=debug event=path_info_miss path=w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test error="error: path '/nix/store/w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 51.796816] nix-grpc-daemon[800]: ts=2026-09-25T16:50:31Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 51.801392] nix-grpc-daemon[800]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53724 worker2 # [ 51.809813] nix-grpc-daemon[800]: ts=2026-09-25T16:50:31Z level=debug event=path_info_miss path=w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test error="error: path '/nix/store/w787jbyr7zgkhjvgnixpm9jzpqdir8w7-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker1 # [ 51.971560] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 52.104269] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.14 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 52.242886] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 52.252289] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 52.282163] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker1 # [ 52.286139] nix-grpc-daemon[511]: ts=2026-09-25T16:50:31Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 52.281075] nix-grpc-daemon[800]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 52.294159] nix-grpc-daemon[800]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying 1 paths to 'lb:50051'... worker2 # [ 52.306162] nix-grpc-daemon[800]: ts=2026-09-25T16:50:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker2 # [ 52.327279] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 52.356830] nix-grpc-daemon[800]: ts=2026-09-25T16:50:31Z level=info event=niks3_push_started pid=871 worker2 # [ 52.505639] nix-grpc-daemon[871]: time=2026-09-25T16:50:31.796Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 52.595687] nix-daemon[858]: accepted connection from pid 884, user nix-grpc-daemon (trusted) worker2 # [ 52.608319] nix-daemon[858]: reaped child process 887, status = succeeded lb # [ 52.614805] niks3-server[957]: 2026/09/25 16:50:31 INFO Received push request method=POST path=/api/pushes worker2 # [ 52.631351] nix-grpc-daemon[871]: time=2026-09-25T16:50:31.922Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 52.632861] nix-grpc-daemon[871]: time=2026-09-25T16:50:31.924Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 52.660575] niks3-server[957]: 2026/09/25 16:50:31 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign lb # [ 52.676731] niks3-server[957]: 2026/09/25 16:50:31 INFO Signed narinfos id=1 count=1 worker2 # [ 52.686199] nix-grpc-daemon[871]: time=2026-09-25T16:50:31.977Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.693444] niks3-server[957]: 2026/09/25 16:50:31 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 52.701170] niks3-server[957]: 2026/09/25 16:50:31 INFO Received complete push request method=POST path=/api/pushes/1/complete lb # [ 52.714123] niks3-server[957]: 2026/09/25 16:50:31 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst worker2 # [ 52.723795] nix-grpc-daemon[871]: time=2026-09-25T16:50:32.015Z level=INFO msg="Upload complete. (213ms)" worker2 # [ 52.728636] nix-grpc-daemon[800]: ts=2026-09-25T16:50:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 52.734942] nix-grpc-daemon[800]: ts=2026-09-25T16:50:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 52.746700] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 52.755667] nix-daemon[858]: reaped child process 869, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker2 # [ 52.763860] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 54.189922] nix-daemon[858]: reaped child process 891, status = succeeded worker2 # [ 54.262088] nix-daemon[858]: accepted connection from pid 907, user nix-grpc-daemon (trusted) worker2 # [ 54.273389] nix-daemon[858]: reaped child process 910, status = succeeded lb # [ 54.278920] niks3-server[957]: 2026/09/25 16:50:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 54.294891] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.586Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 54.298060] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.587Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 54.324138] niks3-server[957]: 2026/09/25 16:50:33 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign worker2 # [ 54.331820] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.623Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.329301] niks3-server[957]: 2026/09/25 16:50:33 INFO Signed narinfos id=2 count=1 lb # [ 54.346421] niks3-server[957]: 2026/09/25 16:50:33 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 54.350497] niks3-server[957]: 2026/09/25 16:50:33 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 54.353027] niks3-server[957]: 2026/09/25 16:50:33 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 54.355918] niks3-server[957]: 2026/09/25 16:50:33 INFO Received complete push request method=POST path=/api/pushes/2/complete lb # [ 54.364578] niks3-server[957]: 2026/09/25 16:50:33 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker2 # [ 54.402283] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.693Z level=INFO msg="Upload complete. (231ms)" worker2 # [ 54.408716] nix-grpc-daemon[800]: ts=2026-09-25T16:50:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 54.435874] nix-grpc-daemon[511]: ts=2026-09-25T16:50:33Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 54.423187] nix-grpc-daemon[800]: ts=2026-09-25T16:50:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 54.441183] nix-grpc-daemon[511]: ts=2026-09-25T16:50:33Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 54.436426] nix-daemon[858]: reaped child process 889, status = succeeded worker2 # [ 54.439345] nix-grpc-daemon[800]: ts=2026-09-25T16:50:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 54.450051] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.741Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 54.458047] nix-grpc-daemon[800]: ts=2026-09-25T16:50:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker2 # [ 54.477192] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 54.571425] nix-daemon[858]: accepted connection from pid 914, user nix-grpc-daemon (trusted) worker2 # [ 54.585934] nix-daemon[858]: reaped child process 917, status = succeeded lb # [ 54.589087] niks3-server[957]: 2026/09/25 16:50:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 54.599645] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.891Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 54.601259] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.892Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 54.622074] niks3-server[957]: 2026/09/25 16:50:33 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 54.629370] niks3-server[957]: 2026/09/25 16:50:33 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign worker2 # [ 54.640197] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.931Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.637057] niks3-server[957]: 2026/09/25 16:50:33 INFO Signed narinfos id=3 count=1 lb # [ 54.645318] niks3-server[957]: 2026/09/25 16:50:33 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 54.655343] niks3-server[957]: 2026/09/25 16:50:33 INFO Received complete push request method=POST path=/api/pushes/3/complete lb # [ 54.666651] niks3-server[957]: 2026/09/25 16:50:33 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker2 # [ 54.674204] nix-grpc-daemon[871]: time=2026-09-25T16:50:33.965Z level=INFO msg="Upload complete. (185ms)" worker2 # [ 54.679269] nix-grpc-daemon[800]: ts=2026-09-25T16:50:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 54.684853] nix-grpc-daemon[800]: ts=2026-09-25T16:50:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 54.697220] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 54.707135] nix-daemon[858]: reaped child process 912, status = succeeded worker2 # [ 54.710515] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 55.725112] nix-daemon[858]: reaped child process 921, status = succeeded worker2 # [ 55.802626] nix-daemon[858]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker2 # [ 55.814977] nix-daemon[858]: reaped child process 940, status = succeeded lb # [ 55.818422] niks3-server[957]: 2026/09/25 16:50:35 INFO Received push request method=POST path=/api/pushes worker2 # [ 55.832364] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.123Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 55.834353] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.125Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 55.863709] niks3-server[957]: 2026/09/25 16:50:35 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 55.868618] niks3-server[957]: 2026/09/25 16:50:35 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 55.872815] niks3-server[957]: 2026/09/25 16:50:35 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign lb # [ 55.878109] niks3-server[957]: 2026/09/25 16:50:35 INFO Signed narinfos id=4 count=1 worker2 # [ 55.881245] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.172Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.888104] niks3-server[957]: 2026/09/25 16:50:35 INFO Received complete push request method=POST path=/api/pushes/4/complete lb # [ 55.892062] niks3-server[957]: 2026/09/25 16:50:35 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker2 # [ 55.898539] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.189Z level=INFO msg="Upload complete. (180ms)" lb # [ 55.898418] niks3-server[957]: 2026/09/25 16:50:35 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker2 # [ 55.904795] nix-grpc-daemon[800]: ts=2026-09-25T16:50:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 55.927527] nix-grpc-daemon[511]: ts=2026-09-25T16:50:35Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 55.915248] nix-grpc-daemon[800]: ts=2026-09-25T16:50:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 55.932202] nix-grpc-daemon[511]: ts=2026-09-25T16:50:35Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 55.925075] nix-grpc-daemon[800]: ts=2026-09-25T16:50:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 55.929646] nix-daemon[858]: reaped child process 919, status = succeeded worker2 # [ 55.933464] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.224Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 55.938797] nix-grpc-daemon[800]: ts=2026-09-25T16:50:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker2 # [ 55.949212] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 56.034882] nix-daemon[858]: accepted connection from pid 944, user nix-grpc-daemon (trusted) worker2 # [ 56.048572] nix-daemon[858]: reaped child process 947, status = succeeded lb # [ 56.050832] niks3-server[957]: 2026/09/25 16:50:35 INFO Received push request method=POST path=/api/pushes worker2 # [ 56.061714] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.353Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 56.063430] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.354Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 56.081228] niks3-server[957]: 2026/09/25 16:50:35 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign lb # [ 56.091501] niks3-server[957]: 2026/09/25 16:50:35 INFO Signed narinfos id=5 count=1 worker2 # [ 56.098227] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.389Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.095377] niks3-server[957]: 2026/09/25 16:50:35 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 56.104181] niks3-server[957]: 2026/09/25 16:50:35 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 56.113537] niks3-server[957]: 2026/09/25 16:50:35 INFO Received complete push request method=POST path=/api/pushes/5/complete worker2 # [ 56.126156] nix-grpc-daemon[871]: time=2026-09-25T16:50:35.417Z level=INFO msg="Upload complete. (170ms)" lb # [ 56.125892] niks3-server[957]: 2026/09/25 16:50:35 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker2 # [ 56.130964] nix-grpc-daemon[800]: ts=2026-09-25T16:50:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 56.137228] nix-grpc-daemon[800]: ts=2026-09-25T16:50:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 56.149640] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 56.154406] nix-daemon[858]: reaped child process 942, status = succeeded worker2 # [ 56.158290] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 56.973300] nix-daemon[858]: reaped child process 951, status = succeeded worker2 # [ 57.046840] nix-daemon[858]: accepted connection from pid 967, user nix-grpc-daemon (trusted) worker2 # [ 57.059404] nix-daemon[858]: reaped child process 970, status = succeeded lb # [ 57.065231] niks3-server[957]: 2026/09/25 16:50:36 INFO Received push request method=POST path=/api/pushes worker2 # [ 57.117870] nix-grpc-daemon[871]: time=2026-09-25T16:50:36.409Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 57.120842] nix-grpc-daemon[871]: time=2026-09-25T16:50:36.410Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 57.150375] niks3-server[957]: 2026/09/25 16:50:36 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign lb # [ 57.154233] niks3-server[957]: 2026/09/25 16:50:36 INFO Signed narinfos id=6 count=1 worker2 # [ 57.160533] nix-grpc-daemon[871]: time=2026-09-25T16:50:36.451Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.157753] niks3-server[957]: 2026/09/25 16:50:36 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 57.169496] niks3-server[957]: 2026/09/25 16:50:36 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 57.175162] niks3-server[957]: 2026/09/25 16:50:36 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 57.182201] niks3-server[957]: 2026/09/25 16:50:36 INFO Received complete push request method=POST path=/api/pushes/6/complete lb # [ 57.187827] niks3-server[957]: 2026/09/25 16:50:36 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker2 # [ 57.196769] nix-grpc-daemon[871]: time=2026-09-25T16:50:36.488Z level=INFO msg="Upload complete. (232ms)" worker2 # [ 57.202915] nix-grpc-daemon[800]: ts=2026-09-25T16:50:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 57.219510] nix-daemon[858]: reaped child process 949, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.13 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath lb # [ 57.328743] envoy[919]: conn peer=[2001:db8:1::1]:56134 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=1411 lb # [ 57.332486] envoy[919]: conn peer=[2001:db8:1::1]:56146 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=61 lb # [ 57.336115] envoy[919]: conn peer=[2001:db8:1::1]:56154 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=11 lb # [ 57.340062] envoy[919]: conn peer=[2001:db8:1::1]:56158 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 lb # [ 57.343577] envoy[919]: conn peer=[2001:db8:1::1]:56172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9490 tx=4336 ms=4996 client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.12 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 5.67 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 58.246243] nix-grpc-daemon[800]: ts=2026-09-25T16:50:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53724 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # [ 58.262453] nix-grpc-daemon[800]: ts=2026-09-25T16:50:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 58.272461] nix-grpc-daemon[871]: time=2026-09-25T16:50:37.563Z level=INFO msg="All 2 paths already cached" worker1 # [ 58.303539] nix-grpc-daemon[511]: ts=2026-09-25T16:50:37Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.20 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.80 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 58.817168] nix-grpc-daemon[511]: ts=2026-09-25T16:50:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 58.810962] nix-grpc-daemon[800]: ts=2026-09-25T16:50:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 58.820510] nix-grpc-daemon[871]: time=2026-09-25T16:50:38.111Z level=INFO msg="All 2 paths already cached" worker1 # [ 58.848819] nix-grpc-daemon[511]: ts=2026-09-25T16:50:38Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 58.836532] nix-grpc-daemon[800]: ts=2026-09-25T16:50:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 58.853323] nix-grpc-daemon[511]: ts=2026-09-25T16:50:38Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 58.847564] nix-grpc-daemon[800]: ts=2026-09-25T16:50:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 58.863206] nix-grpc-daemon[871]: time=2026-09-25T16:50:38.154Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker2 # [ 58.871993] nix-grpc-daemon[800]: ts=2026-09-25T16:50:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 58.885392] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 58.986427] nix-daemon[858]: accepted connection from pid 996, user nix-grpc-daemon (trusted) worker2 # [ 58.999529] nix-daemon[858]: reaped child process 999, status = succeeded lb # [ 59.006303] niks3-server[957]: 2026/09/25 16:50:38 INFO Received push request method=POST path=/api/pushes worker2 # [ 59.100221] nix-grpc-daemon[871]: time=2026-09-25T16:50:38.391Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 59.104834] nix-grpc-daemon[871]: time=2026-09-25T16:50:38.395Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 59.113084] niks3-server[957]: 2026/09/25 16:50:38 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign lb # [ 59.116618] niks3-server[957]: 2026/09/25 16:50:38 INFO Signed narinfos id=7 count=1 worker2 # [ 59.119839] nix-grpc-daemon[871]: time=2026-09-25T16:50:38.410Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.122137] niks3-server[957]: 2026/09/25 16:50:38 INFO Received complete push request method=POST path=/api/pushes/7/complete lb # [ 59.125847] niks3-server[957]: 2026/09/25 16:50:38 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 59.131681] niks3-server[957]: 2026/09/25 16:50:38 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst worker2 # [ 59.144299] nix-grpc-daemon[871]: time=2026-09-25T16:50:38.435Z level=INFO msg="Upload complete. (246ms)" lb # [ 59.145927] niks3-server[957]: 2026/09/25 16:50:38 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker2 # [ 59.149263] nix-grpc-daemon[800]: ts=2026-09-25T16:50:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 59.155224] nix-grpc-daemon[800]: ts=2026-09-25T16:50:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 59.168200] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 59.177242] nix-daemon[858]: reaped child process 994, status = succeeded client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... worker2 # [ 59.186487] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 60.428693] nix-daemon[858]: reaped child process 1003, status = succeeded worker2 # [ 60.514277] nix-daemon[858]: accepted connection from pid 1019, user nix-grpc-daemon (trusted) worker2 # [ 60.525585] nix-daemon[858]: reaped child process 1022, status = succeeded lb # [ 60.531941] niks3-server[957]: 2026/09/25 16:50:39 INFO Received push request method=POST path=/api/pushes worker2 # [ 60.543123] nix-grpc-daemon[871]: time=2026-09-25T16:50:39.834Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 60.544878] nix-grpc-daemon[871]: time=2026-09-25T16:50:39.836Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 60.573865] niks3-server[957]: 2026/09/25 16:50:39 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign worker2 # [ 60.585386] nix-grpc-daemon[871]: time=2026-09-25T16:50:39.876Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.583195] niks3-server[957]: 2026/09/25 16:50:39 INFO Signed narinfos id=8 count=1 lb # [ 60.588286] niks3-server[957]: 2026/09/25 16:50:39 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 60.596333] niks3-server[957]: 2026/09/25 16:50:39 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 60.601317] niks3-server[957]: 2026/09/25 16:50:39 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 60.612127] niks3-server[957]: 2026/09/25 16:50:39 INFO Received complete push request method=POST path=/api/pushes/8/complete lb # [ 60.620229] niks3-server[957]: 2026/09/25 16:50:39 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker2 # [ 60.809637] nix-grpc-daemon[871]: time=2026-09-25T16:50:40.100Z level=INFO msg="Upload complete. (411ms)" worker2 # [ 60.815714] nix-grpc-daemon[800]: ts=2026-09-25T16:50:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 60.831835] nix-daemon[858]: reaped child process 1001, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.19 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.50 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 61.226408] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 61.214938] nix-grpc-daemon[800]: ts=2026-09-25T16:50:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 61.251671] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker1 # [ 61.258281] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 61.262949] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 61.272861] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker1 # [ 61.284593] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 61.295675] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 61.314685] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=info event=niks3_push_started pid=923 worker1 # [ 61.440284] nix-grpc-daemon[923]: time=2026-09-25T16:50:40.761Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 61.531504] nix-daemon[864]: accepted connection from pid 936, user nix-grpc-daemon (trusted) worker1 # [ 61.543860] nix-daemon[864]: reaped child process 939, status = succeeded lb # [ 61.535769] niks3-server[957]: 2026/09/25 16:50:40 INFO Received push request method=POST path=/api/pushes worker1 # [ 61.559672] nix-grpc-daemon[923]: time=2026-09-25T16:50:40.882Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 61.561183] nix-grpc-daemon[923]: time=2026-09-25T16:50:40.883Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 61.569758] niks3-server[957]: 2026/09/25 16:50:40 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 61.576220] niks3-server[957]: 2026/09/25 16:50:40 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign lb # [ 61.581101] niks3-server[957]: 2026/09/25 16:50:40 INFO Signed narinfos id=9 count=1 worker1 # [ 61.602040] nix-grpc-daemon[923]: time=2026-09-25T16:50:40.924Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.598351] niks3-server[957]: 2026/09/25 16:50:40 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 61.602498] niks3-server[957]: 2026/09/25 16:50:40 INFO Received complete push request method=POST path=/api/pushes/9/complete worker1 # [ 61.630571] nix-grpc-daemon[923]: time=2026-09-25T16:50:40.953Z level=INFO msg="Upload complete. (187ms)" lb # [ 61.613520] niks3-server[957]: 2026/09/25 16:50:40 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 61.634244] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 61.639166] nix-grpc-daemon[511]: ts=2026-09-25T16:50:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 61.648596] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 61.653177] nix-daemon[864]: reaped child process 921, status = succeeded worker1 # [ 61.658044] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 62.901777] nix-daemon[864]: reaped child process 943, status = succeeded worker1 # [ 62.979261] nix-daemon[864]: accepted connection from pid 959, user nix-grpc-daemon (trusted) worker1 # [ 62.991903] nix-daemon[864]: reaped child process 962, status = succeeded lb # [ 62.981347] niks3-server[957]: 2026/09/25 16:50:42 INFO Received push request method=POST path=/api/pushes worker1 # [ 63.007509] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.329Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 63.008949] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.331Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 63.016992] niks3-server[957]: 2026/09/25 16:50:42 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 63.031360] niks3-server[957]: 2026/09/25 16:50:42 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign lb # [ 63.037568] niks3-server[957]: 2026/09/25 16:50:42 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 63.043320] niks3-server[957]: 2026/09/25 16:50:42 INFO Signed narinfos id=10 count=1 worker1 # [ 63.064876] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.387Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.054401] niks3-server[957]: 2026/09/25 16:50:42 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 63.062340] niks3-server[957]: 2026/09/25 16:50:42 INFO Received complete push request method=POST path=/api/pushes/10/complete worker1 # [ 63.085562] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.408Z level=INFO msg="Upload complete. (219ms)" lb # [ 63.070740] niks3-server[957]: 2026/09/25 16:50:42 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker1 # [ 63.094415] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 63.105580] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker1 # [ 63.110212] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 63.116184] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 63.126845] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 63.129119] nix-daemon[864]: reaped child process 941, status = succeeded worker1 # [ 63.163151] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.485Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker1 # [ 63.171986] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 63.180965] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 63.276080] nix-daemon[864]: accepted connection from pid 968, user nix-grpc-daemon (trusted) worker1 # [ 63.289893] nix-daemon[864]: reaped child process 971, status = succeeded lb # [ 63.278355] niks3-server[957]: 2026/09/25 16:50:42 INFO Received push request method=POST path=/api/pushes worker1 # [ 63.304914] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.627Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 63.306412] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.629Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 63.307366] niks3-server[957]: 2026/09/25 16:50:42 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 63.319347] niks3-server[957]: 2026/09/25 16:50:42 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign worker1 # [ 63.341851] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.664Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.323938] niks3-server[957]: 2026/09/25 16:50:42 INFO Signed narinfos id=11 count=1 lb # [ 63.333206] niks3-server[957]: 2026/09/25 16:50:42 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 63.344740] niks3-server[957]: 2026/09/25 16:50:42 INFO Received complete push request method=POST path=/api/pushes/11/complete worker1 # [ 63.371569] nix-grpc-daemon[923]: time=2026-09-25T16:50:42.694Z level=INFO msg="Upload complete. (178ms)" lb # [ 63.354724] niks3-server[957]: 2026/09/25 16:50:42 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker1 # [ 63.375296] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 63.380481] nix-grpc-daemon[511]: ts=2026-09-25T16:50:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 63.391932] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 63.398640] nix-daemon[864]: reaped child process 966, status = succeeded worker1 # [ 63.403645] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 64.018545] nix-daemon[864]: reaped child process 975, status = succeeded worker1 # [ 64.092525] nix-daemon[864]: accepted connection from pid 991, user nix-grpc-daemon (trusted) worker1 # [ 64.106285] nix-daemon[864]: reaped child process 994, status = succeeded lb # [ 64.094780] niks3-server[957]: 2026/09/25 16:50:43 INFO Received push request method=POST path=/api/pushes worker1 # [ 64.121894] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.444Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 64.123378] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.446Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 64.133373] niks3-server[957]: 2026/09/25 16:50:43 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 64.137650] niks3-server[957]: 2026/09/25 16:50:43 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 64.145915] niks3-server[957]: 2026/09/25 16:50:43 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign worker1 # [ 64.169362] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.491Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.150980] niks3-server[957]: 2026/09/25 16:50:43 INFO Signed narinfos id=12 count=1 lb # [ 64.156797] niks3-server[957]: 2026/09/25 16:50:43 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 64.163055] niks3-server[957]: 2026/09/25 16:50:43 INFO Received complete push request method=POST path=/api/pushes/12/complete worker1 # [ 64.187574] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.510Z level=INFO msg="Upload complete. (178ms)" lb # [ 64.172681] niks3-server[957]: 2026/09/25 16:50:43 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker1 # [ 64.192439] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 64.203631] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 64.208439] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 64.212037] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 64.217137] nix-daemon[864]: reaped child process 973, status = succeeded worker1 # [ 64.218515] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 64.224613] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.547Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 64.230952] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker1 # [ 64.242773] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 64.327117] nix-daemon[864]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker1 # [ 64.342722] nix-daemon[864]: reaped child process 1003, status = succeeded lb # [ 64.328874] niks3-server[957]: 2026/09/25 16:50:43 INFO Received push request method=POST path=/api/pushes worker1 # [ 64.357608] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.680Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 64.359195] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.681Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 64.364428] niks3-server[957]: 2026/09/25 16:50:43 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign worker1 # [ 64.387125] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.709Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.369090] niks3-server[957]: 2026/09/25 16:50:43 INFO Signed narinfos id=13 count=1 lb # [ 64.371447] niks3-server[957]: 2026/09/25 16:50:43 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 64.383098] niks3-server[957]: 2026/09/25 16:50:43 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 64.386562] niks3-server[957]: 2026/09/25 16:50:43 INFO Received complete push request method=POST path=/api/pushes/13/complete worker1 # [ 64.409141] nix-grpc-daemon[923]: time=2026-09-25T16:50:43.731Z level=INFO msg="Upload complete. (161ms)" lb # [ 64.392466] niks3-server[957]: 2026/09/25 16:50:43 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker1 # [ 64.412725] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 64.417439] nix-grpc-daemon[511]: ts=2026-09-25T16:50:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 64.425277] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 64.430868] nix-daemon[864]: reaped child process 998, status = succeeded worker1 # [ 64.435215] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 65.478527] nix-daemon[864]: reaped child process 1007, status = succeeded worker1 # [ 65.560988] nix-daemon[864]: accepted connection from pid 1023, user nix-grpc-daemon (trusted) worker1 # [ 65.573045] nix-daemon[864]: reaped child process 1026, status = succeeded lb # [ 65.562351] niks3-server[957]: 2026/09/25 16:50:44 INFO Received push request method=POST path=/api/pushes worker1 # [ 65.588550] nix-grpc-daemon[923]: time=2026-09-25T16:50:44.910Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 65.590173] nix-grpc-daemon[923]: time=2026-09-25T16:50:44.912Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 65.594330] niks3-server[957]: 2026/09/25 16:50:44 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 65.609989] niks3-server[957]: 2026/09/25 16:50:44 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 65.615784] niks3-server[957]: 2026/09/25 16:50:44 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign lb # [ 65.623371] niks3-server[957]: 2026/09/25 16:50:44 INFO Signed narinfos id=14 count=1 worker1 # [ 65.643890] nix-grpc-daemon[923]: time=2026-09-25T16:50:44.966Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.631925] niks3-server[957]: 2026/09/25 16:50:44 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 65.641359] niks3-server[957]: 2026/09/25 16:50:44 INFO Received complete push request method=POST path=/api/pushes/14/complete lb # [ 65.650327] niks3-server[957]: 2026/09/25 16:50:44 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker1 # [ 65.672439] nix-grpc-daemon[923]: time=2026-09-25T16:50:44.994Z level=INFO msg="Upload complete. (229ms)" worker1 # [ 65.678930] nix-grpc-daemon[511]: ts=2026-09-25T16:50:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 65.695375] nix-daemon[864]: reaped child process 1005, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 4.62 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.12 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 65.938701] nix-grpc-daemon[511]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47838 worker1 # [ 65.944338] nix-grpc-daemon[511]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47838 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.14 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 66.066442] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:40908 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 66.092723] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:40908 worker2 # [ 66.099413] nix-grpc-daemon[800]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker2 # [ 66.113842] nix-grpc-daemon[800]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker2 # [ 66.126274] nix-grpc-daemon[800]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.20 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/823" client # removing stale temporary roots file "/nix/var/nix/temproots/856" client # removing stale temporary roots file "/nix/var/nix/temproots/808" client # removing stale temporary roots file "/nix/var/nix/temproots/900" client # removing stale temporary roots file "/nix/var/nix/temproots/844" client # removing stale temporary roots file "/nix/var/nix/temproots/877" client # removing stale temporary roots file "/nix/var/nix/temproots/885" client # removing stale temporary roots file "/nix/var/nix/temproots/864" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 66.409215] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 66.428242] nix-grpc-daemon[511]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 66.437060] nix-grpc-daemon[923]: time=2026-09-25T16:50:45.759Z level=INFO msg="All 1 paths already cached" worker2 # [ 66.428394] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 66.435691] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying 3 paths... worker2 # [ 66.445517] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker2 # [ 66.462471] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 66.468056] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_out=232 worker1 # [ 66.485138] nix-grpc-daemon[511]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 66.490682] nix-grpc-daemon[511]: ts=2026-09-25T16:50:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 66.476825] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 66.481767] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.35 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 5.43 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 66.536274] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 55478239acdf4afc900cb99e6bb1da80 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup worker2 # [ 66.666273] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53724 client # [ 66.671770] nix[952]: don't know how to build these paths: client # [ 66.672790] nix[952]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 66.695985] nix-grpc-daemon[511]: ts=2026-09-25T16:50:46Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 66.682342] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 66.700285] nix-grpc-daemon[511]: ts=2026-09-25T16:50:46Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 66.694723] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 client # [ 66.703963] nix[952]: copying 1 paths to 'lb:50051'... client # [ 66.704798] nix[952]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 66.705230] nix-grpc-daemon[800]: ts=2026-09-25T16:50:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 66.716513] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 66.823295] nix-daemon[858]: accepted connection from pid 1029, user nix-grpc-daemon (trusted) worker2 # [ 66.838155] nix-daemon[858]: reaped child process 1032, status = succeeded lb # [ 66.841776] niks3-server[957]: 2026/09/25 16:50:46 INFO Received push request method=POST path=/api/pushes worker2 # [ 66.852594] nix-grpc-daemon[871]: time=2026-09-25T16:50:46.143Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 66.854054] nix-grpc-daemon[871]: time=2026-09-25T16:50:46.143Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 66.870732] niks3-server[957]: 2026/09/25 16:50:46 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign lb # [ 66.877671] niks3-server[957]: 2026/09/25 16:50:46 INFO Signed narinfos id=15 count=1 worker2 # [ 66.883846] nix-grpc-daemon[871]: time=2026-09-25T16:50:46.175Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.886498] niks3-server[957]: 2026/09/25 16:50:46 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 66.892215] niks3-server[957]: 2026/09/25 16:50:46 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 66.903632] niks3-server[957]: 2026/09/25 16:50:46 INFO Received complete push request method=POST path=/api/pushes/15/complete worker2 # [ 66.916802] nix-grpc-daemon[871]: time=2026-09-25T16:50:46.208Z level=INFO msg="Upload complete. (188ms)" lb # [ 66.915258] niks3-server[957]: 2026/09/25 16:50:46 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 66.920944] nix-grpc-daemon[800]: ts=2026-09-25T16:50:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 66.926288] nix-grpc-daemon[800]: ts=2026-09-25T16:50:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 66.935494] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 66.944066] nix-daemon[858]: reaped child process 1027, status = succeeded worker2 # [ 66.947794] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # [ 66.947234] nix[952]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... lb # [ 67.329337] envoy[919]: conn peer=[2001:db8:1::1]:45318 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=58 lb # [ 67.332983] envoy[919]: conn peer=[2001:db8:1::1]:45332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4208 tx=1920 ms=2025 lb # [ 67.336545] envoy[919]: conn peer=[2001:db8:1::1]:45340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9438 tx=4315 ms=4471 lb # [ 67.340128] envoy[919]: conn peer=[2001:db8:1::1]:44344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=410 ms=40 lb # [ 67.344281] envoy[919]: conn peer=[2001:db8:1::1]:44328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1034 tx=2872 ms=96 lb # [ 67.348230] envoy[919]: conn peer=[2001:db8:1::1]:44372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=329 ms=27 lb # [ 67.351673] envoy[919]: conn peer=[2001:db8:1::1]:44360 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=34 client # [ 67.590685] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 5a4be7a2b7ef48d6874d9f965bd6ade5 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds) client: must succeed: sleep 2 worker2 # [ 67.770843] nix-grpc-daemon[800]: ts=2026-09-25T16:50:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53724 client # [ 67.780343] nix[968]: this derivation will be built: worker2 # [ 67.786259] nix-grpc-daemon[800]: ts=2026-09-25T16:50:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 client # [ 67.788481] nix[968]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 67.799927] nix-grpc-daemon[800]: ts=2026-09-25T16:50:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 client # [ 67.801832] nix[968]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker1 # [ 67.814927] nix-grpc-daemon[511]: ts=2026-09-25T16:50:47Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 client: (finished: must succeed: sleep 2, in 2.05 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 69.982449] nix-daemon[858]: reaped child process 1036, status = succeeded worker2 # [ 70.062667] nix-daemon[858]: accepted connection from pid 1062, user nix-grpc-daemon (trusted) worker2 # [ 70.075203] nix-daemon[858]: reaped child process 1065, status = succeeded lb # [ 70.081306] niks3-server[957]: 2026/09/25 16:50:49 INFO Received push request method=POST path=/api/pushes worker2 # [ 70.166593] nix-grpc-daemon[871]: time=2026-09-25T16:50:49.457Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 70.171836] nix-grpc-daemon[871]: time=2026-09-25T16:50:49.460Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 70.211181] niks3-server[957]: 2026/09/25 16:50:49 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign lb # [ 70.221138] niks3-server[957]: 2026/09/25 16:50:49 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 70.228075] niks3-server[957]: 2026/09/25 16:50:49 INFO Signed narinfos id=16 count=1 worker2 # [ 70.234694] nix-grpc-daemon[871]: time=2026-09-25T16:50:49.525Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.233417] niks3-server[957]: 2026/09/25 16:50:49 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 70.238321] niks3-server[957]: 2026/09/25 16:50:49 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 70.251232] niks3-server[957]: 2026/09/25 16:50:49 INFO Received complete push request method=POST path=/api/pushes/16/complete worker2 # [ 70.260950] nix-grpc-daemon[871]: time=2026-09-25T16:50:49.552Z level=INFO msg="Upload complete. (305ms)" lb # [ 70.262150] niks3-server[957]: 2026/09/25 16:50:49 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 70.268702] nix-grpc-daemon[800]: ts=2026-09-25T16:50:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=2 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 70.277285] nix-grpc-daemon[800]: ts=2026-09-25T16:50:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 70.291303] nix-daemon[858]: reaped child process 1034, status = succeeded client # [ 70.312752] systemd[1]: dedup1.service: Deactivated successfully. client # [ 70.316115] systemd[1]: dedup1.service: Consumed 116ms CPU time over 3.778s wall clock time, 43.5M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 70.321391] systemd[1]: dedup2.service: Deactivated successfully. client # [ 70.324397] systemd[1]: dedup2.service: Consumed 146ms CPU time over 2.733s wall clock time, 35.4M memory peak, 6.8K incoming IP traffic, 6.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 4.65 seconds) subtest: --timeout and --max-silent-time reach the builder worker1 # [ 71.323615] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 71.335963] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker1 # [ 71.342687] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 71.347427] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 71.355185] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 71.365826] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 71.376586] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 71.472523] nix-daemon[864]: accepted connection from pid 1053, user nix-grpc-daemon (trusted) worker1 # [ 71.487369] nix-daemon[864]: reaped child process 1056, status = succeeded lb # [ 71.475333] niks3-server[957]: 2026/09/25 16:50:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 71.501701] nix-grpc-daemon[923]: time=2026-09-25T16:50:50.823Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 71.503196] nix-grpc-daemon[923]: time=2026-09-25T16:50:50.823Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 71.509261] niks3-server[957]: 2026/09/25 16:50:50 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign lb # [ 71.514146] niks3-server[957]: 2026/09/25 16:50:50 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 71.521311] niks3-server[957]: 2026/09/25 16:50:50 INFO Signed narinfos id=17 count=1 worker1 # [ 71.543629] nix-grpc-daemon[923]: time=2026-09-25T16:50:50.866Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.529689] niks3-server[957]: 2026/09/25 16:50:50 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 71.538711] niks3-server[957]: 2026/09/25 16:50:50 INFO Received complete push request method=POST path=/api/pushes/17/complete lb # [ 71.547715] niks3-server[957]: 2026/09/25 16:50:50 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker1 # [ 71.564755] nix-grpc-daemon[923]: time=2026-09-25T16:50:50.887Z level=INFO msg="Upload complete. (177ms)" worker1 # [ 71.569381] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 71.575437] nix-grpc-daemon[511]: ts=2026-09-25T16:50:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 71.587103] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 71.593767] nix-daemon[864]: reaped child process 1051, status = succeeded worker1 # [ 71.598559] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) lb # [ 77.330326] envoy[919]: conn peer=[2001:db8:1::1]:44384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2998 tx=1562 ms=3615 lb # [ 77.334106] envoy[919]: conn peer=[2001:db8:1::1]:44388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1619 tx=1798 ms=2520 worker1 # [ 77.610605] nix-grpc-daemon[511]: ts=2026-09-25T16:50:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 77.622975] nix-daemon[864]: reaped child process 1058, status = succeeded worker1 # [ 77.624148] nix-daemon[864]: reaped child process 1060, status = succeeded worker2 # [ 77.758475] nix-grpc-daemon[800]: ts=2026-09-25T16:50:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 77.779174] nix-grpc-daemon[511]: ts=2026-09-25T16:50:57Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker1 # [ 77.781411] nix-grpc-daemon[511]: ts=2026-09-25T16:50:57Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 77.766773] nix-grpc-daemon[800]: ts=2026-09-25T16:50:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 77.778648] nix-grpc-daemon[800]: ts=2026-09-25T16:50:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 77.789205] nix-grpc-daemon[800]: ts=2026-09-25T16:50:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 77.800197] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 77.904800] nix-daemon[858]: accepted connection from pid 1078, user nix-grpc-daemon (trusted) worker2 # [ 77.917974] nix-daemon[858]: reaped child process 1081, status = succeeded lb # [ 77.924419] niks3-server[957]: 2026/09/25 16:50:57 INFO Received push request method=POST path=/api/pushes worker2 # [ 77.935434] nix-grpc-daemon[871]: time=2026-09-25T16:50:57.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 77.937335] nix-grpc-daemon[871]: time=2026-09-25T16:50:57.228Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 77.955455] niks3-server[957]: 2026/09/25 16:50:57 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 77.962868] niks3-server[957]: 2026/09/25 16:50:57 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign worker2 # [ 77.970984] nix-grpc-daemon[871]: time=2026-09-25T16:50:57.262Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.968775] niks3-server[957]: 2026/09/25 16:50:57 INFO Signed narinfos id=18 count=1 lb # [ 77.982553] niks3-server[957]: 2026/09/25 16:50:57 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 77.988069] niks3-server[957]: 2026/09/25 16:50:57 INFO Received complete push request method=POST path=/api/pushes/18/complete lb # [ 77.998044] niks3-server[957]: 2026/09/25 16:50:57 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker2 # [ 77.999878] nix-grpc-daemon[871]: time=2026-09-25T16:50:57.291Z level=INFO msg="Upload complete. (188ms)" worker2 # [ 78.004711] nix-grpc-daemon[800]: ts=2026-09-25T16:50:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 78.010709] nix-grpc-daemon[800]: ts=2026-09-25T16:50:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 78.023193] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 78.032228] nix-daemon[858]: reaped child process 1076, status = succeeded worker2 # [ 78.036395] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 84.249629] nix-grpc-daemon[800]: ts=2026-09-25T16:51:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 84.274668] nix-daemon[858]: reaped child process 1083, status = succeeded worker2 # [ 84.276668] nix-daemon[858]: reaped child process 1085, status = succeeded worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.30 seconds) subtest: a failing build is counted with its own reason worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 84.705631] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 84.719297] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=debug event=want client=9 drv=j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv cached=0 worker1 # [ 84.725323] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=debug event=assigned drv=j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 84.730123] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 84.742435] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 84.753080] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 84.763960] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 84.859268] nix-daemon[864]: accepted connection from pid 1093, user nix-grpc-daemon (trusted) worker1 # [ 84.872076] nix-daemon[864]: reaped child process 1096, status = succeeded lb # [ 84.860813] niks3-server[957]: 2026/09/25 16:51:04 INFO Received push request method=POST path=/api/pushes worker1 # [ 84.886987] nix-grpc-daemon[923]: time=2026-09-25T16:51:04.209Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 84.888986] nix-grpc-daemon[923]: time=2026-09-25T16:51:04.211Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" lb # [ 84.893910] niks3-server[957]: 2026/09/25 16:51:04 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign lb # [ 84.901515] niks3-server[957]: 2026/09/25 16:51:04 INFO Signed narinfos id=19 count=1 worker1 # [ 84.923440] nix-grpc-daemon[923]: time=2026-09-25T16:51:04.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.912296] niks3-server[957]: 2026/09/25 16:51:04 INFO Registered completed upload object_key=j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls lb # [ 84.916848] niks3-server[957]: 2026/09/25 16:51:04 INFO Registered completed upload object_key=nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst lb # [ 84.933447] niks3-server[957]: 2026/09/25 16:51:04 INFO Received complete push request method=POST path=/api/pushes/19/complete lb # [ 84.941541] niks3-server[957]: 2026/09/25 16:51:04 INFO Registered completed upload object_key=j5sh943zaa0qjagii0xkivjfb4c2c5p0.narinfo worker1 # [ 84.959192] nix-grpc-daemon[923]: time=2026-09-25T16:51:04.281Z level=INFO msg="Upload complete. (184ms)" worker1 # [ 84.963950] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=400 worker1 # [ 84.970335] nix-grpc-daemon[511]: ts=2026-09-25T16:51:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 84.979992] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 84.993277] nix-daemon[864]: reaped child process 1091, status = succeeded worker1 # [ 84.996840] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 86.006525] nix-grpc-daemon[511]: ts=2026-09-25T16:51:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv assign_id=11 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 86.031894] nix-daemon[864]: reaped child process 1098, status = succeeded worker1 # [ 86.034468] nix-daemon[864]: reaped child process 1100, status = succeeded worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: a failing build is counted with its own reason, in 1.90 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 86.408896] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 07c74080baff42778a2bd3331816ff1c client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 86.555076] nix[1059]: don't know how to build these paths: client # [ 86.556472] nix[1059]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 86.569438] nix-grpc-daemon[511]: ts=2026-09-25T16:51:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 86.580548] nix-grpc-daemon[511]: ts=2026-09-25T16:51:05Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 86.585776] nix-grpc-daemon[511]: ts=2026-09-25T16:51:05Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 86.573844] nix-grpc-daemon[800]: ts=2026-09-25T16:51:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 86.586881] nix-grpc-daemon[800]: ts=2026-09-25T16:51:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 client # [ 86.595985] nix[1059]: copying 1 paths to 'lb:50051'... client # [ 86.596867] nix[1059]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 86.597522] nix-grpc-daemon[800]: ts=2026-09-25T16:51:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 86.608121] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 86.712423] nix-daemon[858]: accepted connection from pid 1126, user nix-grpc-daemon (trusted) worker2 # [ 86.724962] nix-daemon[858]: reaped child process 1129, status = succeeded lb # [ 86.731960] niks3-server[957]: 2026/09/25 16:51:06 INFO Received push request method=POST path=/api/pushes worker2 # [ 86.742594] nix-grpc-daemon[871]: time=2026-09-25T16:51:06.033Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 86.744553] nix-grpc-daemon[871]: time=2026-09-25T16:51:06.035Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 86.763626] niks3-server[957]: 2026/09/25 16:51:06 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign worker2 # [ 86.772659] nix-grpc-daemon[871]: time=2026-09-25T16:51:06.064Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.770358] niks3-server[957]: 2026/09/25 16:51:06 INFO Signed narinfos id=20 count=1 lb # [ 86.775756] niks3-server[957]: 2026/09/25 16:51:06 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 86.781657] niks3-server[957]: 2026/09/25 16:51:06 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 86.795134] niks3-server[957]: 2026/09/25 16:51:06 INFO Received complete push request method=POST path=/api/pushes/20/complete lb # [ 86.802879] niks3-server[957]: 2026/09/25 16:51:06 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 86.810999] nix-grpc-daemon[871]: time=2026-09-25T16:51:06.102Z level=INFO msg="Upload complete. (191ms)" worker2 # [ 86.814966] nix-grpc-daemon[800]: ts=2026-09-25T16:51:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 86.819484] nix-grpc-daemon[800]: ts=2026-09-25T16:51:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 86.828176] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 86.838098] nix-daemon[858]: reaped child process 1124, status = succeeded worker2 # [ 86.842996] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # [ 86.841569] nix[1059]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... lb # [ 87.330469] envoy[919]: conn peer=[2001:db8:1::1]:44402 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=933 ms=6304 lb # [ 87.334205] envoy[919]: conn peer=[2001:db8:1::1]:46064 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=959 ms=6505 lb # [ 87.337654] envoy[919]: conn peer=[2001:db8:1::1]:43696 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2866 tx=1270 ms=1319 client # [ 87.481665] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 82b70dcf91b04f8f9d84c3def747acca client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.08 seconds) client: must succeed: sleep 2; systemctl kill -s INT share1 worker1 # [ 87.652781] nix-grpc-daemon[511]: ts=2026-09-25T16:51:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 client # [ 87.643203] nix[1075]: don't know how to build these paths: client # [ 87.644214] nix[1075]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 87.665735] nix-grpc-daemon[511]: ts=2026-09-25T16:51:06Z level=debug event=want client=11 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 87.653511] nix-grpc-daemon[800]: ts=2026-09-25T16:51:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 client # [ 87.655793] nix[1075]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 89.642132] systemd[1]: share1.service: Sent signal SIGINT to main process 1059 (nix) on client request. client # [ 89.648822] nix[1059]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 89.658532] nix[1059]: error: interrupted by the user client # [ 89.697808] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 89.699322] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 89.701262] systemd[1]: share1.service: Consumed 117ms CPU time over 3.292s wall clock time, 41.5M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 91.072315] nix-daemon[858]: reaped child process 1133, status = succeeded worker2 # [ 91.153974] nix-daemon[858]: accepted connection from pid 1163, user nix-grpc-daemon (trusted) worker2 # [ 91.164818] nix-daemon[858]: reaped child process 1166, status = succeeded lb # [ 91.171884] niks3-server[957]: 2026/09/25 16:51:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 91.183586] nix-grpc-daemon[871]: time=2026-09-25T16:51:10.474Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 91.185303] nix-grpc-daemon[871]: time=2026-09-25T16:51:10.476Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 91.217308] niks3-server[957]: 2026/09/25 16:51:10 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign worker2 # [ 91.228856] nix-grpc-daemon[871]: time=2026-09-25T16:51:10.520Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.226191] niks3-server[957]: 2026/09/25 16:51:10 INFO Signed narinfos id=21 count=1 lb # [ 91.234078] niks3-server[957]: 2026/09/25 16:51:10 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 91.239264] niks3-server[957]: 2026/09/25 16:51:10 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 91.250157] niks3-server[957]: 2026/09/25 16:51:10 INFO Received complete push request method=POST path=/api/pushes/21/complete lb # [ 91.252583] niks3-server[957]: 2026/09/25 16:51:10 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 91.256543] niks3-server[957]: 2026/09/25 16:51:10 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 91.262762] nix-grpc-daemon[871]: time=2026-09-25T16:51:10.554Z level=INFO msg="Upload complete. (211ms)" worker2 # [ 91.268847] nix-grpc-daemon[800]: ts=2026-09-25T16:51:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 91.277299] nix-grpc-daemon[800]: ts=2026-09-25T16:51:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 91.290909] nix-daemon[858]: reaped child process 1131, status = succeeded client # [ 91.299427] systemd[1]: share2.service: Deactivated successfully. client # [ 91.303139] systemd[1]: share2.service: Consumed 120ms CPU time over 3.821s wall clock time, 35.4M memory peak, 6.4K incoming IP traffic, 5.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 5.65 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 92.105462] systemd[1]: Started Nix Daemon. client # [ 92.193264] nix-daemon[1126]: accepted connection from pid 1123, user root (trusted) worker1 # [ 92.323820] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 92.329189] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 92.339731] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=want client=12 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 92.346396] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 92.351240] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 92.358534] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 92.369606] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 92.377984] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 92.473947] nix-daemon[864]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker1 # [ 92.486496] nix-daemon[864]: reaped child process 1151, status = succeeded lb # [ 92.475760] niks3-server[957]: 2026/09/25 16:51:11 INFO Received push request method=POST path=/api/pushes worker1 # [ 92.502298] nix-grpc-daemon[923]: time=2026-09-25T16:51:11.824Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 92.504455] nix-grpc-daemon[923]: time=2026-09-25T16:51:11.826Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 92.506667] niks3-server[957]: 2026/09/25 16:51:11 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 92.517234] niks3-server[957]: 2026/09/25 16:51:11 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign worker1 # [ 92.541077] nix-grpc-daemon[923]: time=2026-09-25T16:51:11.863Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.522937] niks3-server[957]: 2026/09/25 16:51:11 INFO Signed narinfos id=22 count=1 lb # [ 92.529297] niks3-server[957]: 2026/09/25 16:51:11 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 92.537908] niks3-server[957]: 2026/09/25 16:51:11 INFO Received complete push request method=POST path=/api/pushes/22/complete worker1 # [ 92.566873] nix-grpc-daemon[923]: time=2026-09-25T16:51:11.889Z level=INFO msg="Upload complete. (176ms)" lb # [ 92.549935] niks3-server[957]: 2026/09/25 16:51:11 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 92.570314] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 92.577233] nix-grpc-daemon[511]: ts=2026-09-25T16:51:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 92.585847] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 92.594461] nix-daemon[864]: reaped child process 1146, status = succeeded worker1 # [ 92.599147] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 93.634509] nix-daemon[864]: reaped child process 1155, status = succeeded worker1 # [ 93.719086] nix-daemon[864]: accepted connection from pid 1171, user nix-grpc-daemon (trusted) worker1 # [ 93.731151] nix-daemon[864]: reaped child process 1174, status = succeeded lb # [ 93.719482] niks3-server[957]: 2026/09/25 16:51:12 INFO Received push request method=POST path=/api/pushes worker1 # [ 93.745286] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.067Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 93.747144] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.069Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 93.763220] niks3-server[957]: 2026/09/25 16:51:13 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 93.770826] niks3-server[957]: 2026/09/25 16:51:13 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign lb # [ 93.776752] niks3-server[957]: 2026/09/25 16:51:13 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 93.782099] niks3-server[957]: 2026/09/25 16:51:13 INFO Signed narinfos id=23 count=1 worker1 # [ 93.803709] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.126Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.793719] niks3-server[957]: 2026/09/25 16:51:13 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 93.798398] niks3-server[957]: 2026/09/25 16:51:13 INFO Received complete push request method=POST path=/api/pushes/23/complete worker1 # [ 93.820420] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.142Z level=INFO msg="Upload complete. (213ms)" lb # [ 93.804037] niks3-server[957]: 2026/09/25 16:51:13 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 93.827604] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=13 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 93.824259] nix-grpc-daemon[800]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 worker1 # [ 93.843189] nix-daemon[864]: reaped child process 1153, status = succeeded worker2 # [ 93.833385] nix-grpc-daemon[800]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 93.856929] nix-grpc-daemon[800]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 93.862269] nix-grpc-daemon[800]: ts=2026-09-25T16:51:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 94.039980] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 94.045558] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 94.050532] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.373Z level=INFO msg="All 1 paths already cached" worker1 # [ 94.064145] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=want client=13 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 94.068870] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 94.075311] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 94.086693] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 94.099624] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.422Z level=INFO msg="All 1 paths already cached" worker1 # [ 94.107420] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 94.115550] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 94.214328] nix-daemon[864]: accepted connection from pid 1180, user nix-grpc-daemon (trusted) worker1 # [ 94.228170] nix-daemon[864]: reaped child process 1183, status = succeeded lb # [ 94.216570] niks3-server[957]: 2026/09/25 16:51:13 INFO Received push request method=POST path=/api/pushes worker1 # [ 94.242666] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.565Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 94.244192] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.566Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 94.248718] niks3-server[957]: 2026/09/25 16:51:13 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 94.255137] niks3-server[957]: 2026/09/25 16:51:13 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign lb # [ 94.261649] niks3-server[957]: 2026/09/25 16:51:13 INFO Signed narinfos id=24 count=1 worker1 # [ 94.283441] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.606Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.269286] niks3-server[957]: 2026/09/25 16:51:13 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 94.279400] niks3-server[957]: 2026/09/25 16:51:13 INFO Received complete push request method=POST path=/api/pushes/24/complete lb # [ 94.291079] niks3-server[957]: 2026/09/25 16:51:13 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 94.314192] nix-grpc-daemon[923]: time=2026-09-25T16:51:13.636Z level=INFO msg="Upload complete. (185ms)" worker1 # [ 94.318811] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 94.324402] nix-grpc-daemon[511]: ts=2026-09-25T16:51:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 94.334855] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 94.345383] nix-daemon[864]: reaped child process 1178, status = succeeded worker1 # [ 94.350281] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 95.565588] nix-daemon[864]: reaped child process 1187, status = succeeded worker1 # [ 95.640100] nix-daemon[864]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker1 # [ 95.651980] nix-daemon[864]: reaped child process 1206, status = succeeded lb # [ 95.642347] niks3-server[957]: 2026/09/25 16:51:14 INFO Received push request method=POST path=/api/pushes worker1 # [ 95.668167] nix-grpc-daemon[923]: time=2026-09-25T16:51:14.990Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 95.670991] nix-grpc-daemon[923]: time=2026-09-25T16:51:14.992Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 95.683201] niks3-server[957]: 2026/09/25 16:51:14 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign lb # [ 95.686872] niks3-server[957]: 2026/09/25 16:51:14 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 95.692848] niks3-server[957]: 2026/09/25 16:51:14 INFO Signed narinfos id=25 count=1 worker1 # [ 95.713442] nix-grpc-daemon[923]: time=2026-09-25T16:51:15.035Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.699112] niks3-server[957]: 2026/09/25 16:51:14 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 95.710268] niks3-server[957]: 2026/09/25 16:51:14 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 95.713150] niks3-server[957]: 2026/09/25 16:51:14 INFO Received complete push request method=POST path=/api/pushes/25/complete lb # [ 95.720148] niks3-server[957]: 2026/09/25 16:51:14 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 95.737214] nix-grpc-daemon[923]: time=2026-09-25T16:51:15.059Z level=INFO msg="Upload complete. (179ms)" worker1 # [ 95.744699] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=14 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 95.750790] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 95.761336] nix-daemon[864]: reaped child process 1185, status = succeeded worker2 # [ 95.753269] nix-grpc-daemon[800]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 95.764102] nix-grpc-daemon[800]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 95.775397] nix-grpc-daemon[800]: ts=2026-09-25T16:51:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 95.956637] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 95.949416] nix-grpc-daemon[800]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 95.959491] nix-grpc-daemon[871]: time=2026-09-25T16:51:15.250Z level=INFO msg="All 2 paths already cached" worker1 # [ 95.989217] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=want client=14 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 95.994596] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 95.999877] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 96.012133] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 96.025486] nix-grpc-daemon[923]: time=2026-09-25T16:51:15.347Z level=INFO msg="All 2 paths already cached" worker1 # [ 96.033379] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 96.041356] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 96.140333] nix-daemon[864]: accepted connection from pid 1212, user nix-grpc-daemon (trusted) worker1 # [ 96.153047] nix-daemon[864]: reaped child process 1215, status = succeeded lb # [ 96.142337] niks3-server[957]: 2026/09/25 16:51:15 INFO Received push request method=POST path=/api/pushes worker1 # [ 96.168287] nix-grpc-daemon[923]: time=2026-09-25T16:51:15.490Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 96.170400] nix-grpc-daemon[923]: time=2026-09-25T16:51:15.492Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 96.170517] niks3-server[957]: 2026/09/25 16:51:15 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign lb # [ 96.177913] niks3-server[957]: 2026/09/25 16:51:15 INFO Signed narinfos id=26 count=1 worker1 # [ 96.199580] nix-grpc-daemon[923]: time=2026-09-25T16:51:15.522Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.186701] niks3-server[957]: 2026/09/25 16:51:15 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 96.195204] niks3-server[957]: 2026/09/25 16:51:15 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 96.205124] niks3-server[957]: 2026/09/25 16:51:15 INFO Received complete push request method=POST path=/api/pushes/26/complete worker1 # [ 96.230931] nix-grpc-daemon[923]: time=2026-09-25T16:51:15.553Z level=INFO msg="Upload complete. (176ms)" lb # [ 96.214566] niks3-server[957]: 2026/09/25 16:51:15 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 96.235424] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 96.240694] nix-grpc-daemon[511]: ts=2026-09-25T16:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 96.251972] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 96.256565] nix-daemon[864]: reaped child process 1210, status = succeeded worker1 # [ 96.261166] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 97.276233] nix-daemon[864]: reaped child process 1219, status = succeeded worker1 # [ 97.350162] nix-daemon[864]: accepted connection from pid 1235, user nix-grpc-daemon (trusted) lb # [ 97.331482] envoy[919]: conn peer=[2001:db8:1::1]:43712 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=772 ms=3110 lb # [ 97.336062] envoy[919]: conn peer=[2001:db8:1::1]:43716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1470 tx=1400 ms=3646 lb # [ 97.339621] envoy[919]: conn peer=[2001:db8:1::1]:43720 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3406 tx=1922 ms=1566 worker1 # [ 97.363340] nix-daemon[864]: reaped child process 1238, status = succeeded lb # [ 97.343565] envoy[919]: conn peer=[2001:db8:1::1]:34696 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=16 lb # [ 97.347134] envoy[919]: conn peer=[2001:db8:1::1]:34706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=2139 ms=1762 lb # [ 97.351637] envoy[919]: conn peer=[2001:db8:1::1]:34710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=358 ms=35 lb # [ 97.358950] niks3-server[957]: 2026/09/25 16:51:16 INFO Received push request method=POST path=/api/pushes worker1 # [ 97.384800] nix-grpc-daemon[923]: time=2026-09-25T16:51:16.707Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 97.386612] nix-grpc-daemon[923]: time=2026-09-25T16:51:16.709Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 97.391085] niks3-server[957]: 2026/09/25 16:51:16 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 97.392789] niks3-server[957]: 2026/09/25 16:51:16 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign lb # [ 97.394836] niks3-server[957]: 2026/09/25 16:51:16 INFO Signed narinfos id=27 count=1 worker1 # [ 97.413217] nix-grpc-daemon[923]: time=2026-09-25T16:51:16.735Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.400836] niks3-server[957]: 2026/09/25 16:51:16 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 97.403734] niks3-server[957]: 2026/09/25 16:51:16 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 97.410684] niks3-server[957]: 2026/09/25 16:51:16 INFO Received complete push request method=POST path=/api/pushes/27/complete worker1 # [ 97.434611] nix-grpc-daemon[923]: time=2026-09-25T16:51:16.757Z level=INFO msg="Upload complete. (166ms)" lb # [ 97.417534] niks3-server[957]: 2026/09/25 16:51:16 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 97.439576] nix-grpc-daemon[511]: ts=2026-09-25T16:51:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=15 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 97.451236] nix-daemon[864]: reaped child process 1217, status = succeeded worker2 # [ 97.435913] nix-grpc-daemon[800]: ts=2026-09-25T16:51:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 97.444860] nix-grpc-daemon[800]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 97.468333] nix-grpc-daemon[800]: ts=2026-09-25T16:51:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 97.473415] nix-grpc-daemon[800]: ts=2026-09-25T16:51:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_out=232 client # [ 97.542982] nix-daemon[1126]: reaped child process 1128, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.53 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.59 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 98.201362] nix-daemon[1126]: accepted connection from pid 1209, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 98.319688] nix-grpc-daemon[800]: ts=2026-09-25T16:51:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53724 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 98.337990] nix-grpc-daemon[511]: ts=2026-09-25T16:51:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 98.444418] nix-daemon[864]: accepted connection from pid 1245, user nix-grpc-daemon (trusted) worker1 # [ 98.457297] nix-daemon[864]: reaped child process 1248, status = succeeded lb # [ 98.446825] niks3-server[957]: 2026/09/25 16:51:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 98.472775] nix-grpc-daemon[923]: time=2026-09-25T16:51:17.795Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 98.474903] nix-grpc-daemon[923]: time=2026-09-25T16:51:17.797Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 98.479606] niks3-server[957]: 2026/09/25 16:51:17 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign lb # [ 98.484757] niks3-server[957]: 2026/09/25 16:51:17 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 98.490741] niks3-server[957]: 2026/09/25 16:51:17 INFO Signed narinfos id=28 count=1 worker1 # [ 98.512639] nix-grpc-daemon[923]: time=2026-09-25T16:51:17.835Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.498702] niks3-server[957]: 2026/09/25 16:51:17 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 98.511731] niks3-server[957]: 2026/09/25 16:51:17 INFO Received complete push request method=POST path=/api/pushes/28/complete worker1 # [ 98.535551] nix-grpc-daemon[923]: time=2026-09-25T16:51:17.858Z level=INFO msg="Upload complete. (192ms)" lb # [ 98.520918] niks3-server[957]: 2026/09/25 16:51:17 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker1 # [ 98.554664] nix-grpc-daemon[511]: ts=2026-09-25T16:51:17Z level=debug event=want client=15 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker1 # [ 98.559842] nix-grpc-daemon[511]: ts=2026-09-25T16:51:17Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 98.547662] nix-grpc-daemon[800]: ts=2026-09-25T16:51:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 98.557665] nix-grpc-daemon[800]: ts=2026-09-25T16:51:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 98.572408] nix-grpc-daemon[800]: ts=2026-09-25T16:51:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 98.586259] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 98.692336] nix-daemon[858]: accepted connection from pid 1176, user nix-grpc-daemon (trusted) worker2 # [ 98.705042] nix-daemon[858]: reaped child process 1179, status = succeeded lb # [ 98.710151] niks3-server[957]: 2026/09/25 16:51:17 INFO Received push request method=POST path=/api/pushes worker2 # [ 98.721414] nix-grpc-daemon[871]: time=2026-09-25T16:51:18.012Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 98.723215] nix-grpc-daemon[871]: time=2026-09-25T16:51:18.014Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker2 # [ 98.724883] nix-grpc-daemon[871]: time=2026-09-25T16:51:18.014Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 98.755569] niks3-server[957]: 2026/09/25 16:51:18 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 98.770124] niks3-server[957]: 2026/09/25 16:51:18 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 98.775131] niks3-server[957]: 2026/09/25 16:51:18 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign lb # [ 98.777759] niks3-server[957]: 2026/09/25 16:51:18 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 98.784265] niks3-server[957]: 2026/09/25 16:51:18 INFO Signed narinfos id=29 count=2 worker2 # [ 98.787729] nix-grpc-daemon[871]: time=2026-09-25T16:51:18.078Z level=INFO msg="Uploading 2 narinfos" lb # [ 98.787570] niks3-server[957]: 2026/09/25 16:51:18 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 98.796483] niks3-server[957]: 2026/09/25 16:51:18 INFO Received complete push request method=POST path=/api/pushes/29/complete lb # [ 98.801204] niks3-server[957]: 2026/09/25 16:51:18 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo worker2 # [ 98.807271] nix-grpc-daemon[871]: time=2026-09-25T16:51:18.098Z level=INFO msg="Upload complete. (208ms)" lb # [ 98.807680] niks3-server[957]: 2026/09/25 16:51:18 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo worker2 # [ 98.812683] nix-grpc-daemon[800]: ts=2026-09-25T16:51:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 98.818677] nix-grpc-daemon[800]: ts=2026-09-25T16:51:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 98.828160] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 98.839637] nix-daemon[858]: reaped child process 1174, status = succeeded worker2 # [ 98.845474] nix-grpc-daemon[800]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 98.853222] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 99.868159] nix-daemon[858]: reaped child process 1184, status = succeeded worker2 # [ 99.945532] nix-daemon[858]: accepted connection from pid 1200, user nix-grpc-daemon (trusted) worker2 # [ 99.957166] nix-daemon[858]: reaped child process 1203, status = succeeded lb # [ 99.962718] niks3-server[957]: 2026/09/25 16:51:19 INFO Received push request method=POST path=/api/pushes worker2 # [ 99.975126] nix-grpc-daemon[871]: time=2026-09-25T16:51:19.266Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 99.996286] niks3-server[957]: 2026/09/25 16:51:19 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 100.002301] niks3-server[957]: 2026/09/25 16:51:19 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign lb # [ 100.009364] niks3-server[957]: 2026/09/25 16:51:19 INFO Signed narinfos id=30 count=1 worker2 # [ 100.015391] nix-grpc-daemon[871]: time=2026-09-25T16:51:19.306Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.017151] niks3-server[957]: 2026/09/25 16:51:19 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 100.029722] niks3-server[957]: 2026/09/25 16:51:19 INFO Received complete push request method=POST path=/api/pushes/30/complete lb # [ 100.037534] niks3-server[957]: 2026/09/25 16:51:19 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 100.043767] nix-grpc-daemon[871]: time=2026-09-25T16:51:19.335Z level=INFO msg="Upload complete. (183ms)" client # copying 1 paths... worker2 # [ 100.048367] nix-grpc-daemon[800]: ts=2026-09-25T16:51:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=1 input_bytes=120 input_s=0 worker2 # [ 100.055440] nix-grpc-daemon[800]: ts=2026-09-25T16:51:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 100.065613] nix-daemon[858]: reaped child process 1181, status = succeeded worker2 # [ 100.074569] nix-grpc-daemon[800]: ts=2026-09-25T16:51:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 100.076692] nix-grpc-daemon[800]: ts=2026-09-25T16:51:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_out=120 client # [ 100.147918] nix-daemon[1126]: reaped child process 1212, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.07 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 100.246097] nix-daemon[1126]: accepted connection from pid 1231, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 100.365590] nix-grpc-daemon[800]: ts=2026-09-25T16:51:19Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53724 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 100.385269] nix-grpc-daemon[511]: ts=2026-09-25T16:51:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 100.396316] nix-grpc-daemon[923]: time=2026-09-25T16:51:19.718Z level=INFO msg="All 1 paths already cached" worker1 # [ 100.412139] nix-grpc-daemon[511]: ts=2026-09-25T16:51:19Z level=debug event=want client=16 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 100.419393] nix-grpc-daemon[511]: ts=2026-09-25T16:51:19Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 100.425343] nix-grpc-daemon[511]: ts=2026-09-25T16:51:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 100.436928] nix-grpc-daemon[511]: ts=2026-09-25T16:51:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 100.455636] nix-grpc-daemon[511]: ts=2026-09-25T16:51:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 100.467082] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 100.481578] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 1/5) worker1 # [ 100.565727] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 188 ms (attempt 2/5) worker1 # [ 100.755867] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 3/5) worker1 # [ 100.830824] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 498 ms (attempt 4/5) worker1 # [ 101.331241] nix-grpc-daemon[511]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 101.334557] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 101.341290] nix-grpc-daemon[511]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 101.456802] nix-daemon[864]: accepted connection from pid 1261, user nix-grpc-daemon (trusted) worker1 # [ 101.471849] nix-daemon[864]: reaped child process 1264, status = succeeded lb # [ 101.463402] niks3-server[957]: 2026/09/25 16:51:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 101.488490] nix-grpc-daemon[923]: time=2026-09-25T16:51:20.810Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 101.490650] nix-grpc-daemon[923]: time=2026-09-25T16:51:20.812Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 101.495649] niks3-server[957]: 2026/09/25 16:51:20 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 101.499127] niks3-server[957]: 2026/09/25 16:51:20 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign lb # [ 101.507953] niks3-server[957]: 2026/09/25 16:51:20 INFO Signed narinfos id=31 count=1 worker1 # [ 101.529208] nix-grpc-daemon[923]: time=2026-09-25T16:51:20.851Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.515315] niks3-server[957]: 2026/09/25 16:51:20 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 101.527667] niks3-server[957]: 2026/09/25 16:51:20 INFO Received complete push request method=POST path=/api/pushes/31/complete lb # [ 101.533980] niks3-server[957]: 2026/09/25 16:51:20 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 101.555373] nix-grpc-daemon[923]: time=2026-09-25T16:51:20.877Z level=INFO msg="Upload complete. (193ms)" worker1 # [ 101.560742] nix-grpc-daemon[511]: ts=2026-09-25T16:51:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 paths=1 nar_bytes_in=560 worker1 # [ 101.567909] nix-grpc-daemon[511]: ts=2026-09-25T16:51:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 101.579133] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 101.589095] nix-daemon[864]: reaped child process 1254, status = succeeded worker1 # [ 101.592151] nix-daemon[864]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 102.420211] nix-daemon[864]: reaped child process 1268, status = succeeded worker1 # [ 102.492941] nix-daemon[864]: accepted connection from pid 1284, user nix-grpc-daemon (trusted) worker1 # [ 102.506400] nix-daemon[864]: reaped child process 1287, status = succeeded lb # [ 102.494836] niks3-server[957]: 2026/09/25 16:51:21 INFO Received push request method=POST path=/api/pushes worker1 # [ 102.521430] nix-grpc-daemon[923]: time=2026-09-25T16:51:21.843Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 102.532261] niks3-server[957]: 2026/09/25 16:51:21 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign lb # [ 102.537731] niks3-server[957]: 2026/09/25 16:51:21 INFO Signed narinfos id=32 count=1 worker1 # [ 102.558616] nix-grpc-daemon[923]: time=2026-09-25T16:51:21.881Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.542169] niks3-server[957]: 2026/09/25 16:51:21 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 102.551590] niks3-server[957]: 2026/09/25 16:51:21 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 102.559190] niks3-server[957]: 2026/09/25 16:51:21 INFO Received complete push request method=POST path=/api/pushes/32/complete worker1 # [ 102.589605] nix-grpc-daemon[923]: time=2026-09-25T16:51:21.912Z level=INFO msg="Upload complete. (190ms)" lb # [ 102.571968] niks3-server[957]: 2026/09/25 16:51:21 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker1 # [ 102.592161] nix-grpc-daemon[511]: ts=2026-09-25T16:51:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=17 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 client # copying 1 paths... worker1 # [ 102.598427] nix-grpc-daemon[511]: ts=2026-09-25T16:51:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 102.603154] nix-daemon[864]: reaped child process 1266, status = succeeded client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 102.600078] nix-grpc-daemon[800]: ts=2026-09-25T16:51:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 102.609954] nix-grpc-daemon[800]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 102.623874] nix-grpc-daemon[800]: ts=2026-09-25T16:51:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_out=120 client # [ 102.691872] nix-daemon[1126]: reaped child process 1234, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.54 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 102.791410] nix-daemon[1126]: accepted connection from pid 1253, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 102.922575] nix-grpc-daemon[511]: ts=2026-09-25T16:51:22Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 102.924985] nix-grpc-daemon[511]: ts=2026-09-25T16:51:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 102.932502] nix-grpc-daemon[923]: time=2026-09-25T16:51:22.255Z level=INFO msg="All 1 paths already cached" worker1 # [ 102.942201] nix-grpc-daemon[511]: ts=2026-09-25T16:51:22Z level=debug event=want client=17 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker1 # [ 102.944367] nix-grpc-daemon[511]: ts=2026-09-25T16:51:22Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 102.930509] nix-grpc-daemon[800]: ts=2026-09-25T16:51:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 102.942883] nix-grpc-daemon[800]: ts=2026-09-25T16:51:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 102.956703] nix-grpc-daemon[871]: time=2026-09-25T16:51:22.247Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 102.965154] nix-grpc-daemon[800]: ts=2026-09-25T16:51:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 102.976903] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 103.083165] nix-daemon[858]: accepted connection from pid 1208, user nix-grpc-daemon (trusted) worker2 # [ 103.097393] nix-daemon[858]: reaped child process 1211, status = succeeded lb # [ 103.101125] niks3-server[957]: 2026/09/25 16:51:22 INFO Received push request method=POST path=/api/pushes worker2 # [ 103.112198] nix-grpc-daemon[871]: time=2026-09-25T16:51:22.403Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 103.113542] nix-grpc-daemon[871]: time=2026-09-25T16:51:22.403Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 103.128891] niks3-server[957]: 2026/09/25 16:51:22 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign lb # [ 103.138245] niks3-server[957]: 2026/09/25 16:51:22 INFO Signed narinfos id=33 count=1 worker2 # [ 103.144066] nix-grpc-daemon[871]: time=2026-09-25T16:51:22.435Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.144620] niks3-server[957]: 2026/09/25 16:51:22 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 103.151373] niks3-server[957]: 2026/09/25 16:51:22 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 103.161617] niks3-server[957]: 2026/09/25 16:51:22 INFO Received complete push request method=POST path=/api/pushes/33/complete worker2 # [ 103.172835] nix-grpc-daemon[871]: time=2026-09-25T16:51:22.464Z level=INFO msg="Upload complete. (183ms)" lb # [ 103.171921] niks3-server[957]: 2026/09/25 16:51:22 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 103.176706] nix-grpc-daemon[800]: ts=2026-09-25T16:51:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=560 worker2 # [ 103.181589] nix-grpc-daemon[800]: ts=2026-09-25T16:51:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 worker2 # [ 103.191480] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) worker2 # [ 103.198301] nix-daemon[858]: reaped child process 1206, status = succeeded worker2 # [ 103.203264] nix-daemon[858]: accepted connection from pid 800, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 103.834566] nix-daemon[858]: reaped child process 1215, status = succeeded worker2 # [ 103.911888] nix-daemon[858]: accepted connection from pid 1231, user nix-grpc-daemon (trusted) worker2 # [ 103.923657] nix-daemon[858]: reaped child process 1234, status = succeeded lb # [ 103.930917] niks3-server[957]: 2026/09/25 16:51:23 INFO Received push request method=POST path=/api/pushes worker2 # [ 103.941971] nix-grpc-daemon[871]: time=2026-09-25T16:51:23.233Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 103.962929] niks3-server[957]: 2026/09/25 16:51:23 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 103.966484] niks3-server[957]: 2026/09/25 16:51:23 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign lb # [ 103.971641] niks3-server[957]: 2026/09/25 16:51:23 INFO Signed narinfos id=34 count=1 worker2 # [ 103.977725] nix-grpc-daemon[871]: time=2026-09-25T16:51:23.268Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.981151] niks3-server[957]: 2026/09/25 16:51:23 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 103.994354] niks3-server[957]: 2026/09/25 16:51:23 INFO Received complete push request method=POST path=/api/pushes/34/complete worker2 # [ 104.003976] nix-grpc-daemon[871]: time=2026-09-25T16:51:23.295Z level=INFO msg="Upload complete. (194ms)" lb # [ 104.007317] niks3-server[957]: 2026/09/25 16:51:23 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 104.008664] nix-grpc-daemon[800]: ts=2026-09-25T16:51:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=18 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 client # copying 1 paths... worker2 # [ 104.016936] nix-grpc-daemon[800]: ts=2026-09-25T16:51:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53724 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 104.026633] nix-daemon[858]: reaped child process 1213, status = succeeded worker1 # [ 104.051267] nix-grpc-daemon[511]: ts=2026-09-25T16:51:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 104.058439] nix-grpc-daemon[511]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... worker1 # [ 104.065301] nix-grpc-daemon[511]: ts=2026-09-25T16:51:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_out=120 client # [ 104.118344] nix-daemon[1126]: reaped child process 1256, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.43 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 6.51 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.10 seconds) worker2 # [ 104.834944] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 105.733822] nix-grpc-daemon[800]: ts=2026-09-25T16:51:25Z level=info event=signal_exit lb # [ 107.332601] envoy[919]: conn peer=[2001:db8:1::1]:34714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4281 tx=2354 ms=1542 lb # [ 107.336486] envoy[919]: conn peer=[2001:db8:1::1]:34730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=15 lb # [ 107.339991] envoy[919]: conn peer=[2001:db8:1::1]:34742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=16 lb # [ 107.343552] envoy[919]: conn peer=[2001:db8:1::1]:34734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=2043 ms=1774 lb # [ 107.347108] envoy[919]: conn peer=[2001:db8:1::1]:34754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3724 tx=2107 ms=2270 lb # [ 107.350611] envoy[919]: conn peer=[2001:db8:1::1]:34766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=329 ms=35 lb # [ 107.354935] envoy[919]: conn peer=[2001:db8:1::1]:53752 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3708 tx=2089 ms=1154 lb # [ 107.358460] envoy[919]: conn peer=[2001:db8:1::1]:53756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=329 ms=25 worker1 # [ 107.739424] nix-grpc-daemon[511]: ts=2026-09-25T16:51:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35488 worker1 # [ 107.741495] nix-grpc-daemon[511]: ts=2026-09-25T16:51:27Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 107.732210] nix-grpc-daemon[800]: ts=2026-09-25T16:51:27Z level=info event=scheduler_restarting worker2 # [ 107.742626] nix-grpc-daemon[800]: ts=2026-09-25T16:51:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 107.762802] nix-daemon[858]: reaped child process 860, status = succeeded worker2 # [ 108.412174] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 108.415927] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 108.420396] systemd[1]: nix-grpc-daemon.service: Consumed 2.082s CPU time over 1min 15.840s wall clock time, 69.3M memory peak, 174.7K incoming IP traffic, 344.2K outgoing IP traffic. lb: waiting until exactly ['worker1'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1'] are healthy members of x86_64-linux, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 108.639251] nix-grpc-daemon[511]: ts=2026-09-25T16:51:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 108.643553] nix-grpc-daemon[511]: ts=2026-09-25T16:51:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46616 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 108.709505] systemd[1]: Starting scheduler-token.service... worker2 # [ 108.745579] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 108.747082] systemd[1]: Finished scheduler-token.service. worker2 # [ 108.748529] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 37ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 108.752831] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 108.831345] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 108.833542] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 108.836791] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 108.841052] nix-grpc-daemon[1258]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 108.843222] nix-grpc-daemon[1258]: E0000 00:00:1790355088.132466 1258 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 108.846583] nix-grpc-daemon[1258]: E0000 00:00:1790355088.137902 1258 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 108.849518] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:28Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 108.854286] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 108.859106] nix-grpc-daemon[1258]: E0000 00:00:1790355088.150216 1301 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 108.871608] nix-grpc-daemon[1258]: E0000 00:00:1790355088.163089 1301 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 108.875123] nix-grpc-daemon[1258]: E0000 00:00:1790355088.165365 1301 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 108.898747] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 108.885672] nix-grpc-daemon[1258]: E0000 00:00:1790355088.177112 1301 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 108.894724] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.911798] nix-grpc-daemon[511]: ts=2026-09-25T16:51:28Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:35488 worker1 # [ 108.914102] nix-grpc-daemon[511]: ts=2026-09-25T16:51:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 109.766090] nix-grpc-daemon[511]: ts=2026-09-25T16:51:29Z level=info event=signal_exit lb # [ 110.087893] niks3-server[957]: 2026/09/25 16:51:29 INFO lead: released remote=192.168.1.3:40638 worker1 # [ 111.104140] nix-grpc-daemon[511]: ts=2026-09-25T16:51:30Z level=info event=scheduler_restarting lb # [ 111.087892] envoy[919]: [2026-09-25 16:51:30.355][919][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 111.112853] nix-grpc-daemon[511]: ts=2026-09-25T16:51:30Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 111.115573] nix-grpc-daemon[511]: ts=2026-09-25T16:51:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35488 worker2 # [ 111.099748] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:30Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 111.117101] nix-grpc-daemon[511]: ts=2026-09-25T16:51:30Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 111.118706] nix-grpc-daemon[511]: ts=2026-09-25T16:51:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35488 worker1 # [ 111.120237] nix-grpc-daemon[511]: ts=2026-09-25T16:51:30Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 111.133266] nix-daemon[864]: reaped child process 866, status = succeeded worker2 # [ 111.300304] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.319780] nix-grpc-daemon[511]: ts=2026-09-25T16:51:30Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 111.304163] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.505285] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.509190] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.710278] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.714131] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.914953] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.918828] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.120741] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.124451] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.325538] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.329390] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.376340] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 112.377954] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 112.379867] systemd[1]: nix-grpc-daemon.service: Consumed 2.319s CPU time over 1min 44.914s wall clock time, 62.9M memory peak, 444.6K incoming IP traffic, 436.6K outgoing IP traffic. lb: waiting until exactly ['worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker2'] are healthy members of x86_64-linux, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 112.530429] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.534264] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.563163] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 112.574756] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 112.590921] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5) worker2 # [ 112.624176] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5) worker2 # [ 112.735325] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.739275] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.810500] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 3/5) worker2 # [ 112.865450] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 285 ms (attempt 4/5) worker2 # [ 112.940074] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.943865] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.145833] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.149647] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.155622] nix-grpc-daemon[1258]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 113.158693] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 113.181441] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 113.192289] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 113.213511] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=niks3_push_started pid=1318 worker2 # [ 113.319346] nix-grpc-daemon[1318]: time=2026-09-25T16:51:32.609Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 113.351779] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.355143] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.410126] nix-daemon[858]: accepted connection from pid 1331, user nix-grpc-daemon (trusted) worker2 # [ 113.422178] nix-daemon[858]: reaped child process 1334, status = succeeded lb # [ 113.428897] niks3-server[957]: 2026/09/25 16:51:32 INFO Received push request method=POST path=/api/pushes worker2 # [ 113.439890] nix-grpc-daemon[1318]: time=2026-09-25T16:51:32.731Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 113.441438] nix-grpc-daemon[1318]: time=2026-09-25T16:51:32.732Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 113.443379] nix-grpc-daemon[1318]: time=2026-09-25T16:51:32.734Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 113.485253] niks3-server[957]: 2026/09/25 16:51:32 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign worker2 # [ 113.495570] nix-grpc-daemon[1318]: time=2026-09-25T16:51:32.786Z level=INFO msg="Uploading 2 narinfos" lb # [ 113.492995] niks3-server[957]: 2026/09/25 16:51:32 INFO Signed narinfos id=35 count=2 lb # [ 113.502673] niks3-server[957]: 2026/09/25 16:51:32 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 113.506847] niks3-server[957]: 2026/09/25 16:51:32 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 113.512070] niks3-server[957]: 2026/09/25 16:51:32 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 113.518750] niks3-server[957]: 2026/09/25 16:51:32 INFO Received complete push request method=POST path=/api/pushes/35/complete worker2 # [ 113.527921] nix-grpc-daemon[1318]: time=2026-09-25T16:51:32.819Z level=INFO msg="Upload complete. (209ms)" lb # [ 113.527185] niks3-server[957]: 2026/09/25 16:51:32 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 113.530318] niks3-server[957]: 2026/09/25 16:51:32 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo worker2 # [ 113.533125] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=0 paths=2 nar_bytes_in=312 lb # [ 113.531842] niks3-server[957]: 2026/09/25 16:51:32 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo worker2 # [ 113.544504] nix-daemon[858]: reaped child process 1316, status = succeeded worker2 # [ 113.553897] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.556754] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.15 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.01 seconds) worker1 # [ 113.619300] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 113.692652] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 113.694671] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 113.697794] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 113.703054] nix-grpc-daemon[1313]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 113.704476] nix-grpc-daemon[1313]: E0000 00:00:1790355093.024733 1313 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 113.707564] nix-grpc-daemon[1313]: E0000 00:00:1790355093.030117 1313 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 113.712070] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 113.715631] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 113.701268] niks3-server[957]: 2026/09/25 16:51:32 INFO lead: acquired remote=192.168.1.3:58284 worker1 # [ 113.721077] nix-grpc-daemon[1313]: E0000 00:00:1790355093.041639 1356 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 113.723550] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_take_over lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 113.733677] nix-grpc-daemon[1313]: E0000 00:00:1790355093.056246 1356 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 113.736144] nix-grpc-daemon[1313]: E0000 00:00:1790355093.058418 1356 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 113.747531] nix-grpc-daemon[1313]: E0000 00:00:1790355093.070119 1356 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 113.759626] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.761174] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.757994] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.761852] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 113.961856] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.963650] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.962790] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.966622] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.164210] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.165963] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.169182] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.172392] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.366606] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.368464] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.370163] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.373994] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.568769] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.572243] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60682 worker1 # [ 114.573733] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 114.574572] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.594645] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 114.596066] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60682 worker1 # [ 114.597711] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 1.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.69 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 114.883276] niks3-server[957]: 2026/09/25 16:51:34 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 114.885239] systemd[1]: Stopping niks3 server... worker2 # [ 114.886976] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:34Z level=info event=scheduler_lock_lost status=200 lb # [ 114.889794] niks3-server[957]: 2026/09/25 16:51:34 INFO lead: released remote=192.168.1.3:58284 worker1 # [ 114.908308] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:34Z level=info event=scheduler_lock_lost status=200 lb # [ 114.899192] systemd[1]: niks3.service: Deactivated successfully. lb # [ 114.900800] systemd[1]: Stopped niks3 server. lb # [ 114.902148] systemd[1]: niks3.service: Consumed 778ms CPU time over 1min 37.041s wall clock time, 28.9M memory peak, 96.8K incoming IP traffic, 139.8K outgoing IP traffic. lb # [ 114.908901] systemd[1]: Starting niks3 server... lb # [ 114.958758] niks3-server[1170]: 2026/09/25 16:51:34 goose: no migrations to run. current version: 20260923120000 lb # [ 114.966986] niks3-server[1170]: 2026/09/25 16:51:34 OK 1_commit_pending_closure.sql (6.28ms) lb # [ 114.970385] niks3-server[1170]: 2026/09/25 16:51:34 OK 2_object_stats_trigger.sql (3.35ms) lb # [ 114.973782] niks3-server[1170]: 2026/09/25 16:51:34 OK 3_commit_push.sql (2.99ms) lb # [ 114.974726] niks3-server[1170]: 2026/09/25 16:51:34 goose: up to current file version: 3 lb # [ 114.976078] niks3-server[1170]: 2026/09/25 16:51:34 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 114.986769] niks3-server[1170]: 2026/09/25 16:51:34 INFO Read proxy enabled — serving cache objects from S3 lb # [ 114.990224] niks3-server[1170]: 2026/09/25 16:51:34 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 114.991482] niks3-server[1170]: 2026/09/25 16:51:34 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 114.992625] systemd[1]: Started niks3 server. lb # [ 114.993603] niks3-server[1170]: 2026/09/25 16:51:34 INFO systemd watchdog enabled interval=15s lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.02 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 115.262596] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46114 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 115.271420] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46114 worker1 # [ 115.309677] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:34Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 115.311977] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:34Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 115.316260] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 115.321344] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 115.328366] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5) worker1 # [ 115.351560] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 2/5) worker1 # [ 115.483857] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 344 ms (attempt 3/5) worker1 # [ 115.828971] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 603 ms (attempt 4/5) lb # [ 115.893973] niks3-server[1170]: 2026/09/25 16:51:35 INFO lead: acquired remote=192.168.1.3:58298 worker1 # [ 116.433662] nix-grpc-daemon[1313]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 116.435466] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 116.447096] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60696 client # copying 1 paths to 'lb:50051'... worker1 # [ 116.456575] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60696 client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker1 # [ 116.463242] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 116.474424] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:35Z level=info event=niks3_push_started pid=1385 worker1 # [ 116.564084] nix-grpc-daemon[1385]: time=2026-09-25T16:51:35.886Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 116.659401] nix-daemon[864]: accepted connection from pid 1397, user nix-grpc-daemon (trusted) worker1 # [ 116.671720] nix-daemon[864]: reaped child process 1400, status = succeeded lb # [ 116.660896] niks3-server[1170]: 2026/09/25 16:51:35 INFO Received push request method=POST path=/api/pushes worker1 # [ 116.692223] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.014Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 116.693719] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.016Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 116.711802] niks3-server[1170]: 2026/09/25 16:51:35 INFO Received sign narinfos request method=POST path=/api/pushes/36/sign lb # [ 116.724770] niks3-server[1170]: 2026/09/25 16:51:35 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 116.740923] niks3-server[1170]: 2026/09/25 16:51:36 INFO Signed narinfos id=36 count=1 worker1 # [ 116.760569] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.083Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.748548] niks3-server[1170]: 2026/09/25 16:51:36 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 116.753035] niks3-server[1170]: 2026/09/25 16:51:36 INFO Received complete push request method=POST path=/api/pushes/36/complete lb # [ 116.760674] niks3-server[1170]: 2026/09/25 16:51:36 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker1 # [ 116.782111] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.104Z level=INFO msg="Upload complete. (214ms)" worker1 # [ 116.784353] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60696 duration_s=0 paths=1 nar_bytes_in=536 worker1 # [ 116.787828] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 116.794742] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 116.798084] nix-daemon[864]: reaped child process 1383, status = succeeded worker1 # [ 116.802677] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 117.333162] envoy[919]: conn peer=[2001:db8:1::4]:38510 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3017 tx=1038 ms=74975 lb # [ 117.337288] envoy[919]: conn peer=[2001:db8:1::1]:53772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=14 lb # [ 117.340715] envoy[919]: conn peer=[2001:db8:1::3]:43848 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2413 tx=1148 ms=78338 lb # [ 117.344601] envoy[919]: conn peer=[2001:db8:1::1]:53784 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1004 tx=282 ms=982 client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 117.414742] nix-daemon[864]: reaped child process 1404, status = succeeded worker1 # [ 117.488619] nix-daemon[864]: accepted connection from pid 1420, user nix-grpc-daemon (trusted) worker1 # [ 117.500886] nix-daemon[864]: reaped child process 1423, status = succeeded lb # [ 117.489997] niks3-server[1170]: 2026/09/25 16:51:36 INFO Received push request method=POST path=/api/pushes worker1 # [ 117.518494] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.841Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 117.519978] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.842Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 117.531482] niks3-server[1170]: 2026/09/25 16:51:36 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 117.543586] niks3-server[1170]: 2026/09/25 16:51:36 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 117.553947] niks3-server[1170]: 2026/09/25 16:51:36 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign lb # [ 117.561052] niks3-server[1170]: 2026/09/25 16:51:36 INFO Signed narinfos id=37 count=1 worker1 # [ 117.582284] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.904Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.569646] niks3-server[1170]: 2026/09/25 16:51:36 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 117.572550] niks3-server[1170]: 2026/09/25 16:51:36 INFO Received complete push request method=POST path=/api/pushes/37/complete lb # [ 117.579116] niks3-server[1170]: 2026/09/25 16:51:36 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker1 # [ 117.600751] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.923Z level=INFO msg="Upload complete. (193ms)" worker1 # [ 117.604835] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 duration_s=0 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 117.611152] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 117.613504] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 117.615614] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 117.620989] nix-daemon[864]: reaped child process 1402, status = succeeded worker1 # [ 117.622408] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 117.628431] nix-grpc-daemon[1385]: time=2026-09-25T16:51:36.951Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 117.633281] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60696 client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker1 # [ 117.638355] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 117.720757] nix-daemon[864]: accepted connection from pid 1429, user nix-grpc-daemon (trusted) worker1 # [ 117.733584] nix-daemon[864]: reaped child process 1432, status = succeeded lb # [ 117.722698] niks3-server[1170]: 2026/09/25 16:51:36 INFO Received push request method=POST path=/api/pushes worker1 # [ 117.750729] nix-grpc-daemon[1385]: time=2026-09-25T16:51:37.073Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 117.752757] nix-grpc-daemon[1385]: time=2026-09-25T16:51:37.074Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 117.756761] niks3-server[1170]: 2026/09/25 16:51:37 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign worker1 # [ 117.784873] nix-grpc-daemon[1385]: time=2026-09-25T16:51:37.107Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.766921] niks3-server[1170]: 2026/09/25 16:51:37 INFO Signed narinfos id=38 count=1 lb # [ 117.773270] niks3-server[1170]: 2026/09/25 16:51:37 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 117.777876] niks3-server[1170]: 2026/09/25 16:51:37 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 117.790584] niks3-server[1170]: 2026/09/25 16:51:37 INFO Received complete push request method=POST path=/api/pushes/38/complete worker1 # [ 117.815712] nix-grpc-daemon[1385]: time=2026-09-25T16:51:37.138Z level=INFO msg="Upload complete. (171ms)" lb # [ 117.798419] niks3-server[1170]: 2026/09/25 16:51:37 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker1 # [ 117.817851] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60696 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 117.820548] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 117.825564] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 117.830331] nix-daemon[864]: reaped child process 1427, status = succeeded worker1 # [ 117.835169] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker1 # [ 118.835458] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:60712 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 119.250492] nix-daemon[864]: reaped child process 1436, status = succeeded worker1 # [ 119.324227] nix-daemon[864]: accepted connection from pid 1452, user nix-grpc-daemon (trusted) worker1 # [ 119.335922] nix-daemon[864]: reaped child process 1455, status = succeeded lb # [ 119.326895] niks3-server[1170]: 2026/09/25 16:51:38 INFO Received push request method=POST path=/api/pushes worker1 # [ 119.351880] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.674Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 119.353948] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.676Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 119.362149] niks3-server[1170]: 2026/09/25 16:51:38 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 119.372266] niks3-server[1170]: 2026/09/25 16:51:38 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign worker1 # [ 119.400727] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.723Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.382782] niks3-server[1170]: 2026/09/25 16:51:38 INFO Signed narinfos id=39 count=1 lb # [ 119.384733] niks3-server[1170]: 2026/09/25 16:51:38 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 119.393052] niks3-server[1170]: 2026/09/25 16:51:38 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 119.404968] niks3-server[1170]: 2026/09/25 16:51:38 INFO Received complete push request method=POST path=/api/pushes/39/complete lb # [ 119.410415] niks3-server[1170]: 2026/09/25 16:51:38 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker1 # [ 119.433621] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.756Z level=INFO msg="Upload complete. (192ms)" worker1 # [ 119.435979] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 119.442342] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 119.445189] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 119.447118] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 119.453184] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 119.455360] nix-daemon[864]: reaped child process 1434, status = succeeded worker1 # [ 119.459605] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.782Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 119.464760] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60696 client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker1 # [ 119.470874] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 119.552215] nix-daemon[864]: accepted connection from pid 1461, user nix-grpc-daemon (trusted) worker1 # [ 119.566922] nix-daemon[864]: reaped child process 1464, status = succeeded lb # [ 119.553753] niks3-server[1170]: 2026/09/25 16:51:38 INFO Received push request method=POST path=/api/pushes worker1 # [ 119.580370] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.903Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 119.582574] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.904Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 119.585494] niks3-server[1170]: 2026/09/25 16:51:38 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign worker1 # [ 119.611500] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.933Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.593395] niks3-server[1170]: 2026/09/25 16:51:38 INFO Signed narinfos id=40 count=1 lb # [ 119.597365] niks3-server[1170]: 2026/09/25 16:51:38 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 119.602242] niks3-server[1170]: 2026/09/25 16:51:38 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 119.608980] niks3-server[1170]: 2026/09/25 16:51:38 INFO Received complete push request method=POST path=/api/pushes/40/complete worker1 # [ 119.632520] nix-grpc-daemon[1385]: time=2026-09-25T16:51:38.955Z level=INFO msg="Upload complete. (157ms)" lb # [ 119.616678] niks3-server[1170]: 2026/09/25 16:51:38 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker1 # [ 119.634673] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60696 duration_s=0 paths=1 nar_bytes_in=784 worker1 # [ 119.638387] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 worker1 # [ 119.644793] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 119.647081] nix-daemon[864]: reaped child process 1459, status = succeeded worker1 # [ 119.652244] nix-daemon[864]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 120.667424] nix-daemon[864]: reaped child process 1468, status = succeeded worker1 # [ 120.741199] nix-daemon[864]: accepted connection from pid 1485, user nix-grpc-daemon (trusted) worker1 # [ 120.753830] nix-daemon[864]: reaped child process 1488, status = succeeded lb # [ 120.741651] niks3-server[1170]: 2026/09/25 16:51:40 INFO Received push request method=POST path=/api/pushes worker1 # [ 120.769037] nix-grpc-daemon[1385]: time=2026-09-25T16:51:40.091Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 120.771442] nix-grpc-daemon[1385]: time=2026-09-25T16:51:40.093Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 120.784693] niks3-server[1170]: 2026/09/25 16:51:40 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign lb # [ 120.790757] niks3-server[1170]: 2026/09/25 16:51:40 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 120.796808] niks3-server[1170]: 2026/09/25 16:51:40 INFO Signed narinfos id=41 count=1 worker1 # [ 120.818659] nix-grpc-daemon[1385]: time=2026-09-25T16:51:40.141Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.804879] niks3-server[1170]: 2026/09/25 16:51:40 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 120.815706] niks3-server[1170]: 2026/09/25 16:51:40 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 120.819059] niks3-server[1170]: 2026/09/25 16:51:40 INFO Received complete push request method=POST path=/api/pushes/41/complete lb # [ 120.824097] niks3-server[1170]: 2026/09/25 16:51:40 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker1 # [ 120.845055] nix-grpc-daemon[1385]: time=2026-09-25T16:51:40.167Z level=INFO msg="Upload complete. (186ms)" worker1 # [ 120.847657] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60696 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 120.856130] nix-daemon[864]: reaped child process 1466, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.75 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.11 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.17 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 121.131220] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 121.714619] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:41Z level=info event=signal_exit lb # [ 121.898904] niks3-server[1170]: 2026/09/25 16:51:41 INFO lead: released remote=192.168.1.3:58298 worker1 # [ 122.914505] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:42Z level=info event=scheduler_restarting lb # [ 122.897712] envoy[919]: [2026-09-25 16:51:42.166][919][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 122.922406] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:42Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.926135] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60682 worker2 # [ 122.908727] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:42Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.927692] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:42Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 122.929086] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60682 worker1 # [ 122.930635] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:42Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 122.943516] nix-daemon[864]: reaped child process 1375, status = succeeded worker2 # [ 123.109379] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 123.128405] nix-grpc-daemon[1313]: ts=2026-09-25T16:51:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 123.113340] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.314357] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.318179] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.519123] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.522979] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.724462] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.728337] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.931269] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.934565] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.132286] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.136297] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.337469] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.341465] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.542419] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.546417] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.747599] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.751618] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.953337] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.957130] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 125.096632] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 125.098284] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 125.100110] systemd[1]: nix-grpc-daemon.service: Consumed 649ms CPU time over 11.482s wall clock time, 36.8M memory peak, 185.6K incoming IP traffic, 89.4K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 125.157483] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.159621] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.360921] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.364832] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.566255] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.570193] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.771323] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.775313] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.894268] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_take_over lb # [ 125.891761] niks3-server[1170]: 2026/09/25 16:51:45 INFO lead: acquired remote=192.168.1.4:56528 worker2 # [ 125.976794] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.980588] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 126.181860] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 126.186338] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.12 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 126.386845] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 126.390772] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 126.591686] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 126.609159] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 126.612602] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54346 worker2 # [ 126.616519] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 lb # [ 127.334282] envoy[919]: conn peer=[2001:db8:1::1]:54912 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9653 tx=4392 ms=5586 lb # [ 127.338128] envoy[919]: conn peer=[2001:db8:1::3]:42326 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1968 tx=702 ms=9371 worker2 # [ 127.420857] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46114 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 127.429099] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 127.451162] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 127.456621] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 127.461984] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 127.473226] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46114 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 127.485124] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 127.496237] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 127.595192] nix-daemon[858]: accepted connection from pid 1363, user nix-grpc-daemon (trusted) worker2 # [ 127.607347] nix-daemon[858]: reaped child process 1366, status = succeeded lb # [ 127.614325] niks3-server[1170]: 2026/09/25 16:51:46 INFO Received push request method=POST path=/api/pushes worker2 # [ 127.626691] nix-grpc-daemon[1318]: time=2026-09-25T16:51:46.917Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.628938] nix-grpc-daemon[1318]: time=2026-09-25T16:51:46.919Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 127.650431] niks3-server[1170]: 2026/09/25 16:51:46 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign lb # [ 127.657323] niks3-server[1170]: 2026/09/25 16:51:46 INFO Signed narinfos id=42 count=1 worker2 # [ 127.663295] nix-grpc-daemon[1318]: time=2026-09-25T16:51:46.954Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.661070] niks3-server[1170]: 2026/09/25 16:51:46 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 127.668195] niks3-server[1170]: 2026/09/25 16:51:46 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 127.679522] niks3-server[1170]: 2026/09/25 16:51:46 INFO Received complete push request method=POST path=/api/pushes/42/complete lb # [ 127.688208] niks3-server[1170]: 2026/09/25 16:51:46 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker2 # [ 127.693852] nix-grpc-daemon[1318]: time=2026-09-25T16:51:46.985Z level=INFO msg="Upload complete. (187ms)" worker2 # [ 127.698445] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 127.703839] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 127.715249] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 127.721664] nix-daemon[858]: reaped child process 1361, status = succeeded worker2 # [ 127.727230] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 128.543351] nix-daemon[858]: reaped child process 1370, status = succeeded worker2 # [ 128.620209] nix-daemon[858]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 128.632977] nix-daemon[858]: reaped child process 1389, status = succeeded lb # [ 128.638550] niks3-server[1170]: 2026/09/25 16:51:47 INFO Received push request method=POST path=/api/pushes worker2 # [ 128.649742] nix-grpc-daemon[1318]: time=2026-09-25T16:51:47.941Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 128.651382] nix-grpc-daemon[1318]: time=2026-09-25T16:51:47.942Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 128.678462] niks3-server[1170]: 2026/09/25 16:51:47 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign lb # [ 128.682853] niks3-server[1170]: 2026/09/25 16:51:47 INFO Signed narinfos id=43 count=1 worker2 # [ 128.688463] nix-grpc-daemon[1318]: time=2026-09-25T16:51:47.979Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.694910] niks3-server[1170]: 2026/09/25 16:51:47 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 128.705746] niks3-server[1170]: 2026/09/25 16:51:47 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 128.711570] niks3-server[1170]: 2026/09/25 16:51:47 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 128.718700] niks3-server[1170]: 2026/09/25 16:51:47 INFO Received complete push request method=POST path=/api/pushes/43/complete lb # [ 128.723226] niks3-server[1170]: 2026/09/25 16:51:47 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker2 # [ 128.725355] nix-grpc-daemon[1318]: time=2026-09-25T16:51:48.016Z level=INFO msg="Upload complete. (190ms)" worker2 # [ 128.737473] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 128.745725] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 128.749936] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 128.753481] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 128.761780] nix-daemon[858]: reaped child process 1368, status = succeeded worker2 # [ 128.763253] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 128.771316] nix-grpc-daemon[1318]: time=2026-09-25T16:51:48.062Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 128.776791] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 128.782649] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 128.869716] nix-daemon[858]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 128.882185] nix-daemon[858]: reaped child process 1398, status = succeeded lb # [ 128.888076] niks3-server[1170]: 2026/09/25 16:51:48 INFO Received push request method=POST path=/api/pushes worker2 # [ 128.898670] nix-grpc-daemon[1318]: time=2026-09-25T16:51:48.190Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 128.900647] nix-grpc-daemon[1318]: time=2026-09-25T16:51:48.191Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 128.916451] niks3-server[1170]: 2026/09/25 16:51:48 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign lb # [ 128.921265] niks3-server[1170]: 2026/09/25 16:51:48 INFO Signed narinfos id=44 count=1 worker2 # [ 128.927559] nix-grpc-daemon[1318]: time=2026-09-25T16:51:48.218Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.931077] niks3-server[1170]: 2026/09/25 16:51:48 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 128.941054] niks3-server[1170]: 2026/09/25 16:51:48 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 128.949136] niks3-server[1170]: 2026/09/25 16:51:48 INFO Received complete push request method=POST path=/api/pushes/44/complete worker2 # [ 128.959424] nix-grpc-daemon[1318]: time=2026-09-25T16:51:48.250Z level=INFO msg="Upload complete. (172ms)" lb # [ 128.958978] niks3-server[1170]: 2026/09/25 16:51:48 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 128.962769] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 128.967276] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 128.977752] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 128.981037] nix-daemon[858]: reaped child process 1393, status = succeeded worker2 # [ 128.985820] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 130.222990] nix-daemon[858]: reaped child process 1402, status = succeeded worker2 # [ 130.300158] nix-daemon[858]: accepted connection from pid 1418, user nix-grpc-daemon (trusted) worker2 # [ 130.312673] nix-daemon[858]: reaped child process 1421, status = succeeded lb # [ 130.318840] niks3-server[1170]: 2026/09/25 16:51:49 INFO Received push request method=POST path=/api/pushes worker2 # [ 130.329905] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.621Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 130.331726] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.622Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 130.362377] niks3-server[1170]: 2026/09/25 16:51:49 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign lb # [ 130.371316] niks3-server[1170]: 2026/09/25 16:51:49 INFO Signed narinfos id=45 count=1 worker2 # [ 130.377521] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.668Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.379068] niks3-server[1170]: 2026/09/25 16:51:49 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 130.384936] niks3-server[1170]: 2026/09/25 16:51:49 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 130.400146] niks3-server[1170]: 2026/09/25 16:51:49 INFO Received complete push request method=POST path=/api/pushes/45/complete lb # [ 130.406089] niks3-server[1170]: 2026/09/25 16:51:49 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls worker2 # [ 130.411445] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.702Z level=INFO msg="Upload complete. (216ms)" lb # [ 130.411095] niks3-server[1170]: 2026/09/25 16:51:49 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 130.418790] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 130.432190] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 130.435561] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 130.440204] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 130.450553] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 130.453716] nix-daemon[858]: reaped child process 1400, status = succeeded worker2 # [ 130.457764] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.749Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 130.462871] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 130.469063] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 130.553600] nix-daemon[858]: accepted connection from pid 1427, user nix-grpc-daemon (trusted) worker2 # [ 130.566443] nix-daemon[858]: reaped child process 1430, status = succeeded lb # [ 130.571965] niks3-server[1170]: 2026/09/25 16:51:49 INFO Received push request method=POST path=/api/pushes worker2 # [ 130.584700] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.876Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 130.586769] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.877Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 130.601390] niks3-server[1170]: 2026/09/25 16:51:49 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign worker2 # [ 130.611489] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.902Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.608651] niks3-server[1170]: 2026/09/25 16:51:49 INFO Signed narinfos id=46 count=1 lb # [ 130.612879] niks3-server[1170]: 2026/09/25 16:51:49 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 130.623588] niks3-server[1170]: 2026/09/25 16:51:49 INFO Received complete push request method=POST path=/api/pushes/46/complete lb # [ 130.626112] niks3-server[1170]: 2026/09/25 16:51:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 130.628571] niks3-server[1170]: 2026/09/25 16:51:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 130.634458] nix-grpc-daemon[1318]: time=2026-09-25T16:51:49.925Z level=INFO msg="Upload complete. (160ms)" worker2 # [ 130.636767] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 130.641550] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 130.651241] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 130.654271] nix-daemon[858]: reaped child process 1425, status = succeeded worker2 # [ 130.658229] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 130.913208] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:50Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:54350 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 131.471756] nix-daemon[858]: reaped child process 1434, status = succeeded worker2 # [ 131.549872] nix-daemon[858]: accepted connection from pid 1450, user nix-grpc-daemon (trusted) worker2 # [ 131.560807] nix-daemon[858]: reaped child process 1453, status = succeeded lb # [ 131.567763] niks3-server[1170]: 2026/09/25 16:51:50 INFO Received push request method=POST path=/api/pushes worker2 # [ 131.578915] nix-grpc-daemon[1318]: time=2026-09-25T16:51:50.870Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 131.580708] nix-grpc-daemon[1318]: time=2026-09-25T16:51:50.871Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 131.605095] niks3-server[1170]: 2026/09/25 16:51:50 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 131.615847] niks3-server[1170]: 2026/09/25 16:51:50 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign worker2 # [ 131.625298] nix-grpc-daemon[1318]: time=2026-09-25T16:51:50.916Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.622215] niks3-server[1170]: 2026/09/25 16:51:50 INFO Signed narinfos id=47 count=1 lb # [ 131.626433] niks3-server[1170]: 2026/09/25 16:51:50 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 131.633810] niks3-server[1170]: 2026/09/25 16:51:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 131.640034] niks3-server[1170]: 2026/09/25 16:51:50 INFO Received complete push request method=POST path=/api/pushes/47/complete worker2 # [ 131.646388] nix-grpc-daemon[1318]: time=2026-09-25T16:51:50.937Z level=INFO msg="Upload complete. (182ms)" lb # [ 131.645428] niks3-server[1170]: 2026/09/25 16:51:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 131.651570] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 131.665407] nix-daemon[858]: reaped child process 1432, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 4.41 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds) worker1 # [ 131.842220] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 131.916826] nix-grpc-daemon[1506]: ts=2026-09-25T16:51:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 131.918862] nix-grpc-daemon[1506]: ts=2026-09-25T16:51:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 131.922356] nix-grpc-daemon[1506]: ts=2026-09-25T16:51:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 131.926956] nix-grpc-daemon[1506]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 131.928344] nix-grpc-daemon[1506]: E0000 00:00:1790355111.248751 1506 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 131.931615] nix-grpc-daemon[1506]: E0000 00:00:1790355111.254183 1506 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 131.934750] nix-grpc-daemon[1506]: ts=2026-09-25T16:51:51Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 131.938679] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 131.945086] nix-grpc-daemon[1506]: E0000 00:00:1790355111.265674 1546 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 131.956749] nix-grpc-daemon[1506]: E0000 00:00:1790355111.279383 1546 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 131.960151] nix-grpc-daemon[1506]: E0000 00:00:1790355111.281733 1546 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 131.970853] nix-grpc-daemon[1506]: E0000 00:00:1790355111.293494 1546 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 131.980518] nix-grpc-daemon[1506]: ts=2026-09-25T16:51:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 131.966683] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54346 worker2 # [ 131.972257] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.13 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 132.158927] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: df1fcee639dc4976a7082cb98a2fa98c client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) worker1 # [ 132.304988] nix-grpc-daemon[1506]: ts=2026-09-25T16:51:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50238 worker1 # [ 132.308883] nix-daemon[864]: accepted connection from pid 1506, user nix-grpc-daemon (trusted) client # [ 132.300350] nix[1380]: don't know how to build these paths: client # [ 132.301287] nix[1380]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 132.309849] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 132.316589] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 132.321559] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 132.332243] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46114 client # [ 132.341113] nix[1380]: copying 1 paths to 'lb:50051'... client # [ 132.341884] nix[1380]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 132.342877] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 132.351300] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 132.449842] nix-daemon[858]: accepted connection from pid 1466, user nix-grpc-daemon (trusted) worker2 # [ 132.464448] nix-daemon[858]: reaped child process 1469, status = succeeded lb # [ 132.468922] niks3-server[1170]: 2026/09/25 16:51:51 INFO Received push request method=POST path=/api/pushes worker2 # [ 132.479533] nix-grpc-daemon[1318]: time=2026-09-25T16:51:51.771Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 132.481434] nix-grpc-daemon[1318]: time=2026-09-25T16:51:51.772Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 132.496228] niks3-server[1170]: 2026/09/25 16:51:51 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign worker2 # [ 132.504468] nix-grpc-daemon[1318]: time=2026-09-25T16:51:51.795Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.501459] niks3-server[1170]: 2026/09/25 16:51:51 INFO Signed narinfos id=48 count=1 lb # [ 132.513661] niks3-server[1170]: 2026/09/25 16:51:51 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 132.522202] niks3-server[1170]: 2026/09/25 16:51:51 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 132.528212] niks3-server[1170]: 2026/09/25 16:51:51 INFO Received complete push request method=POST path=/api/pushes/48/complete worker2 # [ 132.538851] nix-grpc-daemon[1318]: time=2026-09-25T16:51:51.830Z level=INFO msg="Upload complete. (174ms)" lb # [ 132.539108] niks3-server[1170]: 2026/09/25 16:51:51 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 132.541180] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 132.545432] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 worker2 # [ 132.556573] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 132.560272] nix-daemon[858]: reaped child process 1464, status = succeeded worker2 # [ 132.564843] nix-daemon[858]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) client # [ 132.564129] nix[1380]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 133.715292] systemd-journald[283]: Received client request to rotate journal, rotating. worker1 # [ 133.733637] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/bde8db7c60b143e1a933379f39c65834. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 133.627811] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker2 # [ 133.859105] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:53Z level=info event=draining lb # [ 137.335308] envoy[919]: conn peer=[2001:db8:1::1]:39890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9556 tx=4363 ms=4247 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 139.004418] nix-daemon[858]: reaped child process 1473, status = succeeded worker2 # [ 139.088182] nix-daemon[858]: accepted connection from pid 1510, user nix-grpc-daemon (trusted) worker2 # [ 139.100635] nix-daemon[858]: reaped child process 1513, status = succeeded lb # [ 139.106776] niks3-server[1170]: 2026/09/25 16:51:58 INFO Received push request method=POST path=/api/pushes worker2 # [ 139.117915] nix-grpc-daemon[1318]: time=2026-09-25T16:51:58.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 139.119386] nix-grpc-daemon[1318]: time=2026-09-25T16:51:58.410Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 139.150109] niks3-server[1170]: 2026/09/25 16:51:58 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 139.156731] niks3-server[1170]: 2026/09/25 16:51:58 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 139.163415] niks3-server[1170]: 2026/09/25 16:51:58 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign worker2 # [ 139.173927] nix-grpc-daemon[1318]: time=2026-09-25T16:51:58.465Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.171499] niks3-server[1170]: 2026/09/25 16:51:58 INFO Signed narinfos id=49 count=1 lb # [ 139.176240] niks3-server[1170]: 2026/09/25 16:51:58 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 139.187293] niks3-server[1170]: 2026/09/25 16:51:58 INFO Received complete push request method=POST path=/api/pushes/49/complete worker2 # [ 139.194360] nix-grpc-daemon[1318]: time=2026-09-25T16:51:58.485Z level=INFO msg="Upload complete. (217ms)" lb # [ 139.193283] niks3-server[1170]: 2026/09/25 16:51:58 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 139.201678] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46114 duration_s=6 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 139.217483] nix-daemon[858]: reaped child process 1471, status = succeeded client # [ 139.237333] systemd[1]: rs.service: Deactivated successfully. client # [ 139.241672] systemd[1]: rs.service: Consumed 127ms CPU time over 7.080s wall clock time, 41.4M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic. worker2 # [ 139.860928] nix-grpc-daemon[1258]: ts=2026-09-25T16:51:59Z level=info event=signal_exit lb # [ 139.898297] niks3-server[1170]: 2026/09/25 16:51:59 INFO lead: released remote=192.168.1.4:56528 worker2 # [ 140.902448] nix-grpc-daemon[1258]: ts=2026-09-25T16:52:00Z level=info event=scheduler_restarting lb # [ 140.898266] envoy[919]: [2026-09-25 16:52:00.166][919][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 140.909453] nix-grpc-daemon[1258]: ts=2026-09-25T16:52:00Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 140.924885] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:00Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 140.915671] nix-grpc-daemon[1258]: ts=2026-09-25T16:52:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54346 worker2 # [ 140.919389] nix-grpc-daemon[1258]: ts=2026-09-25T16:52:00Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 140.922929] nix-grpc-daemon[1258]: ts=2026-09-25T16:52:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54346 worker2 # [ 140.926350] nix-grpc-daemon[1258]: ts=2026-09-25T16:52:00Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 140.948667] nix-daemon[858]: reaped child process 1310, status = succeeded worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.13 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 141.129553] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.133668] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 141.122976] nix-grpc-daemon[1258]: ts=2026-09-25T16:52:00Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 141.334430] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.338543] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.539443] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.543603] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.744448] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.748556] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 141.927340] niks3-server[1170]: 2026/09/25 16:52:01 INFO lead: acquired remote=192.168.1.3:39784 worker1 # [ 141.949321] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_take_over worker1 # [ 141.952919] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.956783] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 142.067194] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 142.070165] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 142.072526] systemd[1]: nix-grpc-daemon.service: Consumed 1.175s CPU time over 33.313s wall clock time, 39.1M memory peak, 346.2K incoming IP traffic, 201.7K outgoing IP traffic. worker2 # [ 142.087448] systemd[1]: Starting scheduler-token.service... lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 142.139845] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 142.142191] systemd[1]: Finished scheduler-token.service. worker2 # [ 142.142974] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 53ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 142.157775] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.146701] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 142.161782] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 142.226344] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 142.228468] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 142.231692] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 142.236188] nix-grpc-daemon[1524]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 142.237522] nix-grpc-daemon[1524]: E0000 00:00:1790355121.527304 1524 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 142.241454] nix-grpc-daemon[1524]: E0000 00:00:1790355121.532855 1524 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 142.245287] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 142.249064] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 142.252097] nix-grpc-daemon[1524]: E0000 00:00:1790355121.543160 1566 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 142.263791] nix-grpc-daemon[1524]: E0000 00:00:1790355121.555216 1566 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 142.268057] nix-grpc-daemon[1524]: E0000 00:00:1790355121.557498 1566 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 142.277744] nix-grpc-daemon[1524]: E0000 00:00:1790355121.569185 1566 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 142.287402] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.288906] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 142.362693] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.366721] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 142.490369] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.494390] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 142.567606] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.571584] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 142.695198] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.726174] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 142.729959] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52750 worker1 # [ 142.733972] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 142.772175] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.776310] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:52750 worker1 # [ 142.779850] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 11.13 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 143.287679] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 01008c53d5d744d690c4521b371872ca client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker1 # [ 143.440603] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50238 client # [ 143.431101] nix[1416]: don't know how to build these paths: client # [ 143.432026] nix[1416]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 143.454880] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 143.459626] nix-grpc-daemon[1506]: ts=2026-09-25T16:52:02Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 143.446730] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48626 worker2 # [ 143.457776] nix-daemon[858]: accepted connection from pid 1524, user nix-grpc-daemon (trusted) worker2 # [ 143.473836] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5) worker2 # [ 143.545476] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 2/5) worker2 # [ 143.595131] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 3/5) worker2 # [ 143.683229] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 355 ms (attempt 4/5) worker2 # [ 144.040250] nix-grpc-daemon[1524]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 144.043978] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 144.061496] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48626 client # [ 144.070904] nix[1416]: copying 1 paths to 'lb:50051'... client # [ 144.075944] nix[1416]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker2 # [ 144.076737] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48626 worker2 # [ 144.086355] nix-daemon[858]: accepted connection from pid 1524, user nix-grpc-daemon (trusted) worker2 # [ 144.108628] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:03Z level=info event=niks3_push_started pid=1588 worker2 # [ 144.214294] nix-grpc-daemon[1588]: time=2026-09-25T16:52:03.505Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 144.304136] nix-daemon[858]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker2 # [ 144.315814] nix-daemon[858]: reaped child process 1604, status = succeeded lb # [ 144.322383] niks3-server[1170]: 2026/09/25 16:52:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 144.335576] nix-grpc-daemon[1588]: time=2026-09-25T16:52:03.627Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 144.337202] nix-grpc-daemon[1588]: time=2026-09-25T16:52:03.628Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 144.362684] niks3-server[1170]: 2026/09/25 16:52:03 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign lb # [ 144.371588] niks3-server[1170]: 2026/09/25 16:52:03 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst worker2 # [ 144.383034] nix-grpc-daemon[1588]: time=2026-09-25T16:52:03.674Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.380279] niks3-server[1170]: 2026/09/25 16:52:03 INFO Signed narinfos id=50 count=1 lb # [ 144.402890] niks3-server[1170]: 2026/09/25 16:52:03 INFO Received complete push request method=POST path=/api/pushes/50/complete lb # [ 144.405857] niks3-server[1170]: 2026/09/25 16:52:03 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls worker2 # [ 144.412234] nix-grpc-daemon[1588]: time=2026-09-25T16:52:03.703Z level=INFO msg="Upload complete. (194ms)" lb # [ 144.410591] niks3-server[1170]: 2026/09/25 16:52:03 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker2 # [ 144.416829] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48626 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 144.422631] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48626 worker2 # [ 144.432512] nix-daemon[858]: accepted connection from pid 1524, user nix-grpc-daemon (trusted) worker2 # [ 144.440411] nix-daemon[858]: reaped child process 1586, status = succeeded worker2 # [ 144.445259] nix-daemon[858]: accepted connection from pid 1524, user nix-grpc-daemon (trusted) client # [ 144.445275] nix[1416]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 145.776512] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1506 (nix-grpc-daemon) on client request. lb # [ 145.772824] niks3-server[1170]: 2026/09/25 16:52:05 INFO lead: released remote=192.168.1.3:39784 worker1 # [ 145.794573] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. worker2 # [ 145.783283] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:05Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" client # [ 145.783573] nix[1416]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 145.812274] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 145.813759] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 145.814939] systemd[1]: nix-grpc-daemon.service: Consumed 215ms CPU time over 13.967s wall clock time, 13.6M memory peak, 33.2K incoming IP traffic, 41K outgoing IP traffic. worker1 # [ 145.828259] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 145.829734] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 145.834349] nix-daemon[864]: reaped child process 1565, status = succeeded worker1 # [ 145.905657] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 145.907662] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 145.910777] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 145.915056] nix-grpc-daemon[1635]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 145.918199] nix-grpc-daemon[1635]: E0000 00:00:1790355125.237658 1635 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 145.920449] nix-grpc-daemon[1635]: E0000 00:00:1790355125.243021 1635 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 145.924564] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 145.926582] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 145.933080] nix-grpc-daemon[1635]: E0000 00:00:1790355125.254643 1677 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 145.914725] niks3-server[1170]: 2026/09/25 16:52:05 INFO lead: acquired remote=192.168.1.3:44478 worker1 # [ 145.937128] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=scheduler_take_over worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.19 seconds) client: must succeed: sleep 5.0 worker1 # [ 145.945974] nix-grpc-daemon[1635]: E0000 00:00:1790355125.268616 1677 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 145.949153] nix-grpc-daemon[1635]: E0000 00:00:1790355125.270859 1677 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 145.960234] nix-grpc-daemon[1635]: E0000 00:00:1790355125.282834 1677 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 145.969567] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.976191] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57722 worker1 # [ 145.977732] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 145.983469] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 146.003502] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 146.004885] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57722 worker1 # [ 146.006559] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=1 worker1 # [ 146.635325] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:05Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:57752 lb # [ 147.335260] envoy[919]: conn peer=[2001:db8:1::1]:39896 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2960 tx=1518 ms=6930 lb # [ 147.339191] envoy[919]: conn peer=[2001:db8:1::4]:47436 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=31014 tx=1808 ms=32221 lb # [ 147.342913] envoy[919]: conn peer=[2001:db8:1::3]:39464 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2386 tx=619 ms=13823 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 151.286797] nix-daemon[858]: reaped child process 1608, status = succeeded worker2 # [ 151.367323] nix-daemon[858]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker2 # [ 151.378629] nix-daemon[858]: reaped child process 1648, status = succeeded lb # [ 151.384721] niks3-server[1170]: 2026/09/25 16:52:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 151.397322] nix-grpc-daemon[1588]: time=2026-09-25T16:52:10.688Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 151.399051] nix-grpc-daemon[1588]: time=2026-09-25T16:52:10.690Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 151.429244] niks3-server[1170]: 2026/09/25 16:52:10 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 151.437629] niks3-server[1170]: 2026/09/25 16:52:10 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 151.446252] niks3-server[1170]: 2026/09/25 16:52:10 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign lb # [ 151.450475] niks3-server[1170]: 2026/09/25 16:52:10 INFO Signed narinfos id=51 count=1 worker2 # [ 151.457493] nix-grpc-daemon[1588]: time=2026-09-25T16:52:10.748Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.457926] niks3-server[1170]: 2026/09/25 16:52:10 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 151.467115] niks3-server[1170]: 2026/09/25 16:52:10 INFO Received complete push request method=POST path=/api/pushes/51/complete lb # [ 151.473166] niks3-server[1170]: 2026/09/25 16:52:10 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker2 # [ 151.474813] nix-grpc-daemon[1588]: time=2026-09-25T16:52:10.766Z level=INFO msg="Upload complete. (217ms)" worker2 # [ 151.480988] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48626 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 151.496722] nix-daemon[858]: reaped child process 1606, status = succeeded client # [ 151.512574] systemd[1]: mid.service: Deactivated successfully. client # [ 151.515979] systemd[1]: mid.service: Consumed 131ms CPU time over 8.227s wall clock time, 43.4M memory peak, 7.8K incoming IP traffic, 8.8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.00 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 152.261221] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 4b3c7bc73fd340459dc2d9d9d783e6ff client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker1 # [ 152.399577] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 152.410682] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) client # [ 152.407394] nix[1452]: don't know how to build these paths: client # [ 152.408328] nix[1452]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 152.432414] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:11Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 152.437272] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:11Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.444250] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 152.453648] nix-grpc-daemon[1635]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 1/5) worker1 # [ 152.516928] nix-grpc-daemon[1635]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 2/5) worker1 # [ 152.585983] nix-grpc-daemon[1635]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 3/5) worker1 # [ 152.680119] nix-grpc-daemon[1635]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 152 ms (attempt 4/5) worker1 # [ 152.834445] nix-grpc-daemon[1635]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 152.837360] nix-grpc-daemon[1635]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 152.855064] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 client # [ 152.849208] nix[1452]: copying 1 paths to 'lb:50051'... client # [ 152.853154] nix[1452]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker1 # [ 152.869345] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 152.879162] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 152.900200] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:12Z level=info event=niks3_push_started pid=1709 worker1 # [ 153.000289] nix-grpc-daemon[1709]: time=2026-09-25T16:52:12.322Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 153.084704] nix-daemon[864]: accepted connection from pid 1722, user nix-grpc-daemon (trusted) worker1 # [ 153.095825] nix-daemon[864]: reaped child process 1725, status = succeeded lb # [ 153.086553] niks3-server[1170]: 2026/09/25 16:52:12 INFO Received push request method=POST path=/api/pushes worker1 # [ 153.115725] nix-grpc-daemon[1709]: time=2026-09-25T16:52:12.438Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.117444] nix-grpc-daemon[1709]: time=2026-09-25T16:52:12.440Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 153.129794] niks3-server[1170]: 2026/09/25 16:52:12 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign lb # [ 153.139615] niks3-server[1170]: 2026/09/25 16:52:12 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls worker1 # [ 153.164274] nix-grpc-daemon[1709]: time=2026-09-25T16:52:12.486Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.146364] niks3-server[1170]: 2026/09/25 16:52:12 INFO Signed narinfos id=52 count=1 lb # [ 153.166271] niks3-server[1170]: 2026/09/25 16:52:12 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 153.172447] niks3-server[1170]: 2026/09/25 16:52:12 INFO Received complete push request method=POST path=/api/pushes/52/complete lb # [ 153.179078] niks3-server[1170]: 2026/09/25 16:52:12 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker1 # [ 153.200914] nix-grpc-daemon[1709]: time=2026-09-25T16:52:12.523Z level=INFO msg="Upload complete. (197ms)" worker1 # [ 153.205868] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 153.212301] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 153.225115] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 153.232262] nix-daemon[864]: reaped child process 1707, status = succeeded worker1 # [ 153.239822] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) client # [ 153.223553] nix[1452]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 154.581799] systemd[1]: intr.service: Sent signal SIGINT to main process 1452 (nix) on client request. worker1 # [ 154.604641] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:13Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds) client # [ 154.590329] nix[1452]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 154.597406] nix[1452]: error: interrupted by the user client # [ 154.623691] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 154.626433] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 154.630114] systemd[1]: intr.service: Consumed 115ms CPU time over 2.367s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.2K outgoing IP traffic. worker1 # [ 154.658969] nix-daemon[864]: reaped child process 1727, status = succeeded worker1 # [ 154.660547] nix-daemon[1729]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 154.665158] nix-daemon[864]: reaped child process 1729, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 2.44 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 154.721970] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 1522946fc08741a3b088a48cfaedb254 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.05 seconds) worker1 # [ 154.860385] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57754 client # [ 154.850968] nix[1472]: don't know how to build these paths: client # [ 154.851872] nix[1472]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 154.874824] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:14Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 154.864456] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48626 worker1 # [ 154.879348] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:14Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 154.875942] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48626 client # [ 154.885073] nix[1472]: copying 1 paths to 'lb:50051'... client # [ 154.885826] nix[1472]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker2 # [ 154.886751] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48626 worker2 # [ 154.897907] nix-daemon[858]: accepted connection from pid 1524, user nix-grpc-daemon (trusted) worker2 # [ 154.997421] nix-daemon[858]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 155.009491] nix-daemon[858]: reaped child process 1675, status = succeeded lb # [ 155.016576] niks3-server[1170]: 2026/09/25 16:52:14 INFO Received push request method=POST path=/api/pushes worker2 # [ 155.031525] nix-grpc-daemon[1588]: time=2026-09-25T16:52:14.322Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 155.033394] nix-grpc-daemon[1588]: time=2026-09-25T16:52:14.324Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 155.049706] niks3-server[1170]: 2026/09/25 16:52:14 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign lb # [ 155.055583] niks3-server[1170]: 2026/09/25 16:52:14 INFO Signed narinfos id=53 count=1 worker2 # [ 155.063843] nix-grpc-daemon[1588]: time=2026-09-25T16:52:14.355Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.063533] niks3-server[1170]: 2026/09/25 16:52:14 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 155.070171] niks3-server[1170]: 2026/09/25 16:52:14 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 155.081275] niks3-server[1170]: 2026/09/25 16:52:14 INFO Received complete push request method=POST path=/api/pushes/53/complete lb # [ 155.090057] niks3-server[1170]: 2026/09/25 16:52:14 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker2 # [ 155.092128] nix-grpc-daemon[1588]: time=2026-09-25T16:52:14.383Z level=INFO msg="Upload complete. (183ms)" worker2 # [ 155.096837] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48626 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 155.102685] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48626 worker2 # [ 155.112948] nix-daemon[858]: accepted connection from pid 1524, user nix-grpc-daemon (trusted) worker2 # [ 155.120506] nix-daemon[858]: reaped child process 1670, status = succeeded worker2 # [ 155.125308] nix-daemon[858]: accepted connection from pid 1524, user nix-grpc-daemon (trusted) client # [ 155.124566] nix[1472]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done lb # [ 157.335989] envoy[919]: conn peer=[2001:db8:1::1]:32968 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3074 tx=1608 ms=8070 lb # [ 157.339807] envoy[919]: conn peer=[2001:db8:1::1]:32980 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2967 tx=826 ms=2228 worker2 # [ 157.455853] nixos[1711]: switching to system configuration /nix/store/nwjk341l9c9p4n6yzngl25ykgzs3hzyr-nixos-system-worker2-test worker2 # [ 157.459026] systemd[1]: Stopped target Remote File Systems. worker2 # activating the configuration... worker2 # [ 157.461180] systemd[1]: Stopped target Local File Systems. worker2 # setting up /etc... worker2 # [ 157.882931] systemd[1]: Reload requested from client PID 1711 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 157.885264] systemd[1]: Reloading... worker2 # [ 159.233406] systemd[1]: Reloading finished in 1346 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 159.292454] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 159.395318] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 159.397657] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 159.402771] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 159.406369] dbus-broker-launch[518]: Caught SIGHUP, trigger reload. worker2 # [ 159.407701] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 159.424177] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 159.428058] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' worker2 # [ 159.432732] dbus-broker-launch[518]: Invalid user-name in /nix/store/9f31zf0wixjfmyvwg6m53sif40vrkysg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 159.441645] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 159.450252] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 159.457061] systemd[1]: Reached target Remote File Systems. worker2 # [ 159.459091] systemd[1]: Starting linger-users.service... worker2 # [ 159.463184] systemd[1]: Reached target Local File Systems. worker2 # [ 159.465075] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 159.470129] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 159.470979] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 159.473039] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 159.475158] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 159.478988] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 159.483541] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 159.485815] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 159.487064] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 159.519468] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 159.520495] systemd[1]: Finished linger-users.service. worker2 # [ 159.739889] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 159.741067] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 159.997406] nixos[1711]: finished switching to system configuration /nix/store/nwjk341l9c9p4n6yzngl25ykgzs3hzyr-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.91 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker1 # [ 160.203321] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57754 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker1 # [ 160.215215] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 160.239204] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 160.244319] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 160.251654] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 160.263886] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker2 # [ 160.253886] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:19Z level=info event=draining client # copying 1 paths to 'lb:50051'... worker1 # [ 160.280616] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker1 # [ 160.306229] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 160.404680] nix-daemon[864]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 160.417508] nix-daemon[864]: reaped child process 1783, status = succeeded lb # [ 160.406733] niks3-server[1170]: 2026/09/25 16:52:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 160.434285] nix-grpc-daemon[1709]: time=2026-09-25T16:52:19.756Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.436152] nix-grpc-daemon[1709]: time=2026-09-25T16:52:19.758Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 160.442309] niks3-server[1170]: 2026/09/25 16:52:19 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign lb # [ 160.449109] niks3-server[1170]: 2026/09/25 16:52:19 INFO Signed narinfos id=54 count=1 worker1 # [ 160.470661] nix-grpc-daemon[1709]: time=2026-09-25T16:52:19.792Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.457742] niks3-server[1170]: 2026/09/25 16:52:19 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 160.463243] niks3-server[1170]: 2026/09/25 16:52:19 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 160.472208] niks3-server[1170]: 2026/09/25 16:52:19 INFO Received complete push request method=POST path=/api/pushes/54/complete lb # [ 160.480120] niks3-server[1170]: 2026/09/25 16:52:19 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker1 # [ 160.497524] nix-grpc-daemon[1709]: time=2026-09-25T16:52:19.820Z level=INFO msg="Upload complete. (179ms)" worker1 # [ 160.502406] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 160.509138] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 160.519567] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 160.525565] nix-daemon[864]: reaped child process 1778, status = succeeded worker1 # [ 160.529840] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker1 # [ 161.546192] nix-daemon[864]: reaped child process 1787, status = succeeded worker1 # [ 161.617769] nix-daemon[864]: accepted connection from pid 1803, user nix-grpc-daemon (trusted) worker1 # [ 161.630727] nix-daemon[864]: reaped child process 1806, status = succeeded lb # [ 161.622560] niks3-server[1170]: 2026/09/25 16:52:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 161.647467] nix-grpc-daemon[1709]: time=2026-09-25T16:52:20.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 161.649164] nix-grpc-daemon[1709]: time=2026-09-25T16:52:20.971Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 161.661773] niks3-server[1170]: 2026/09/25 16:52:20 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 161.671854] niks3-server[1170]: 2026/09/25 16:52:20 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign worker1 # [ 161.703241] nix-grpc-daemon[1709]: time=2026-09-25T16:52:21.025Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.685213] niks3-server[1170]: 2026/09/25 16:52:20 INFO Signed narinfos id=55 count=1 lb # [ 161.689155] niks3-server[1170]: 2026/09/25 16:52:20 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 161.698147] niks3-server[1170]: 2026/09/25 16:52:20 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 161.704189] niks3-server[1170]: 2026/09/25 16:52:20 INFO Received complete push request method=POST path=/api/pushes/55/complete lb # [ 161.710960] niks3-server[1170]: 2026/09/25 16:52:20 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker1 # [ 161.727259] nix-grpc-daemon[1709]: time=2026-09-25T16:52:21.049Z level=INFO msg="Upload complete. (190ms)" worker1 # [ 161.736402] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 161.748964] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 161.754515] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.759259] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 161.769539] nix-daemon[864]: reaped child process 1785, status = succeeded worker1 # [ 161.771169] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 161.779539] nix-grpc-daemon[1709]: time=2026-09-25T16:52:21.102Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker1 # [ 161.785314] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 161.796603] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 161.879189] nix-daemon[864]: accepted connection from pid 1812, user nix-grpc-daemon (trusted) worker1 # [ 161.891761] nix-daemon[864]: reaped child process 1815, status = succeeded lb # [ 161.881363] niks3-server[1170]: 2026/09/25 16:52:21 INFO Received push request method=POST path=/api/pushes worker1 # [ 161.909257] nix-grpc-daemon[1709]: time=2026-09-25T16:52:21.231Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 161.911494] nix-grpc-daemon[1709]: time=2026-09-25T16:52:21.233Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 161.914168] niks3-server[1170]: 2026/09/25 16:52:21 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 161.921609] niks3-server[1170]: 2026/09/25 16:52:21 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign worker1 # [ 161.945772] nix-grpc-daemon[1709]: time=2026-09-25T16:52:21.268Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.927484] niks3-server[1170]: 2026/09/25 16:52:21 INFO Signed narinfos id=56 count=1 lb # [ 161.938472] niks3-server[1170]: 2026/09/25 16:52:21 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 161.943111] niks3-server[1170]: 2026/09/25 16:52:21 INFO Received complete push request method=POST path=/api/pushes/56/complete lb # [ 161.953477] niks3-server[1170]: 2026/09/25 16:52:21 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker1 # [ 161.970391] nix-grpc-daemon[1709]: time=2026-09-25T16:52:21.292Z level=INFO msg="Upload complete. (168ms)" worker1 # [ 161.975058] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 161.981293] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 161.990536] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 161.995303] nix-daemon[864]: reaped child process 1810, status = succeeded worker1 # [ 162.000396] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker1 # [ 163.244468] nix-daemon[864]: reaped child process 1819, status = succeeded worker1 # [ 163.318829] nix-daemon[864]: accepted connection from pid 1835, user nix-grpc-daemon (trusted) worker1 # [ 163.331151] nix-daemon[864]: reaped child process 1838, status = succeeded lb # [ 163.319496] niks3-server[1170]: 2026/09/25 16:52:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 163.346256] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.668Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.347929] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.670Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 163.362647] niks3-server[1170]: 2026/09/25 16:52:22 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign lb # [ 163.366983] niks3-server[1170]: 2026/09/25 16:52:22 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 163.378569] niks3-server[1170]: 2026/09/25 16:52:22 INFO Signed narinfos id=57 count=1 worker1 # [ 163.399566] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.721Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.383710] niks3-server[1170]: 2026/09/25 16:52:22 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 163.386959] niks3-server[1170]: 2026/09/25 16:52:22 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 163.397786] niks3-server[1170]: 2026/09/25 16:52:22 INFO Received complete push request method=POST path=/api/pushes/57/complete lb # [ 163.404163] niks3-server[1170]: 2026/09/25 16:52:22 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker1 # [ 163.420662] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.743Z level=INFO msg="Upload complete. (212ms)" worker1 # [ 163.431313] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 163.443076] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:22Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 163.448183] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:22Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.452597] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 163.462555] nix-daemon[864]: reaped child process 1817, status = succeeded worker1 # [ 163.464699] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 163.472808] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.795Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 163.478608] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker1 # [ 163.494944] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 163.579469] nix-daemon[864]: accepted connection from pid 1844, user nix-grpc-daemon (trusted) worker1 # [ 163.592775] nix-daemon[864]: reaped child process 1847, status = succeeded lb # [ 163.581400] niks3-server[1170]: 2026/09/25 16:52:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 163.607564] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.930Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.609518] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.931Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 163.615306] niks3-server[1170]: 2026/09/25 16:52:22 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign worker1 # [ 163.639168] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.961Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.622367] niks3-server[1170]: 2026/09/25 16:52:22 INFO Signed narinfos id=58 count=1 lb # [ 163.628172] niks3-server[1170]: 2026/09/25 16:52:22 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 163.634560] niks3-server[1170]: 2026/09/25 16:52:22 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 163.644084] niks3-server[1170]: 2026/09/25 16:52:22 INFO Received complete push request method=POST path=/api/pushes/58/complete lb # [ 163.653227] niks3-server[1170]: 2026/09/25 16:52:22 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker1 # [ 163.676833] nix-grpc-daemon[1709]: time=2026-09-25T16:52:22.999Z level=INFO msg="Upload complete. (175ms)" worker1 # [ 163.682133] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 163.688752] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 163.701188] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 163.709361] nix-daemon[864]: reaped child process 1842, status = succeeded worker1 # [ 163.713973] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker1 # [ 164.752550] nix-daemon[864]: reaped child process 1851, status = succeeded worker1 # [ 164.834301] nix-daemon[864]: accepted connection from pid 1867, user nix-grpc-daemon (trusted) worker1 # [ 164.847537] nix-daemon[864]: reaped child process 1870, status = succeeded lb # [ 164.836758] niks3-server[1170]: 2026/09/25 16:52:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 164.863393] nix-grpc-daemon[1709]: time=2026-09-25T16:52:24.185Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.865178] nix-grpc-daemon[1709]: time=2026-09-25T16:52:24.187Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 164.878524] niks3-server[1170]: 2026/09/25 16:52:24 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign lb # [ 164.886655] niks3-server[1170]: 2026/09/25 16:52:24 INFO Signed narinfos id=59 count=1 worker1 # [ 164.910868] nix-grpc-daemon[1709]: time=2026-09-25T16:52:24.233Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.893270] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 164.898633] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 164.905622] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 164.915920] niks3-server[1170]: 2026/09/25 16:52:24 INFO Received complete push request method=POST path=/api/pushes/59/complete lb # [ 164.922340] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker1 # [ 164.939073] nix-grpc-daemon[1709]: time=2026-09-25T16:52:24.261Z level=INFO msg="Upload complete. (217ms)" worker1 # [ 164.945772] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 164.961649] nix-daemon[864]: reaped child process 1849, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.93 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 165.149629] nix-daemon[858]: reaped child process 1679, status = succeeded worker2 # [ 165.224536] nix-daemon[858]: accepted connection from pid 1851, user nix-grpc-daemon (trusted) worker2 # [ 165.236989] nix-daemon[858]: reaped child process 1854, status = succeeded lb # [ 165.242535] niks3-server[1170]: 2026/09/25 16:52:24 INFO Received push request method=POST path=/api/pushes worker2 # [ 165.253453] nix-grpc-daemon[1588]: time=2026-09-25T16:52:24.544Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 165.255172] nix-grpc-daemon[1588]: time=2026-09-25T16:52:24.546Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 165.279385] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 165.290603] niks3-server[1170]: 2026/09/25 16:52:24 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign worker2 # [ 165.299112] nix-grpc-daemon[1588]: time=2026-09-25T16:52:24.590Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.296723] niks3-server[1170]: 2026/09/25 16:52:24 INFO Signed narinfos id=60 count=1 lb # [ 165.304515] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 165.308909] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 165.318473] niks3-server[1170]: 2026/09/25 16:52:24 INFO Received complete push request method=POST path=/api/pushes/60/complete lb # [ 165.326039] niks3-server[1170]: 2026/09/25 16:52:24 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker2 # [ 165.331716] nix-grpc-daemon[1588]: time=2026-09-25T16:52:24.623Z level=INFO msg="Upload complete. (190ms)" worker2 # [ 165.335057] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48626 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 165.342175] nix-daemon[858]: reaped child process 1677, status = succeeded client # [ 165.366136] systemd[1]: sw.service: Deactivated successfully. client # [ 165.369168] systemd[1]: sw.service: Consumed 120ms CPU time over 10.643s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.02 seconds) lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 166.255588] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:25Z level=info event=signal_exit lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 167.279264] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57722 worker1 # [ 167.286644] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:26Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 167.263698] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:26Z level=info event=scheduler_restarting lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 167.279184] nix-grpc-daemon[1524]: ts=2026-09-25T16:52:26Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 167.301572] nix-daemon[858]: reaped child process 1580, status = succeeded lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb # [ 167.336476] envoy[919]: conn peer=[2001:db8:1::1]:48216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=4382 ms=4769 lb # [ 167.339533] envoy[919]: conn peer=[2001:db8:1::1]:48210 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2945 tx=1524 ms=10501 lb # [ 167.342371] envoy[919]: conn peer=[2001:db8:1::4]:33186 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4101 tx=509 ms=24988 worker2 # [ 168.280256] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 168.284238] systemd[1]: nix-grpc-daemon.service: Consumed 638ms CPU time over 26.136s wall clock time, 35.6M memory peak, 52.2K incoming IP traffic, 63.5K outgoing IP traffic. lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 168.440942] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 168.449742] systemd[1]: Starting scheduler-token.service... worker2 # [ 168.506735] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 168.510921] systemd[1]: Finished scheduler-token.service. worker2 # [ 168.512465] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 60ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 168.520514] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 168.600680] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 168.602724] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 168.605898] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 168.610051] nix-grpc-daemon[1870]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 168.611616] nix-grpc-daemon[1870]: E0000 00:00:1790355147.901422 1870 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 168.615397] nix-grpc-daemon[1870]: E0000 00:00:1790355147.906796 1870 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 168.619175] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:27Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 168.622640] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 168.626066] nix-grpc-daemon[1870]: E0000 00:00:1790355147.916823 1912 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 168.637411] nix-grpc-daemon[1870]: E0000 00:00:1790355147.928836 1912 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 168.641122] nix-grpc-daemon[1870]: E0000 00:00:1790355147.931137 1912 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 168.651441] nix-grpc-daemon[1870]: E0000 00:00:1790355147.942883 1912 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 168.660785] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 168.678876] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:28Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57722 worker1 # [ 168.684695] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 3.19 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.81 seconds) subtest: queue gauges show a burst while every build blocks lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]' client # [ 169.643865] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # Running as unit: burst.service; invocation ID: 65104cc29c364ee19cbc65c3a4d1f20e client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 169.793771] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57754 client # [ 169.783368] nix[1528]: don't know how to build these paths: client # [ 169.784298] nix[1528]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv client # [ 169.785249] nix[1528]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv client # [ 169.786449] nix[1528]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv client # [ 169.787681] nix[1528]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker1 # [ 169.809726] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=want client=5 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=0 worker1 # [ 169.815935] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 169.822231] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=want client=5 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=0 worker2 # [ 169.808422] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 169.825875] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.4:50051 clients=1 worker1 # [ 169.829867] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=want client=5 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=0 worker2 # [ 169.818223] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker1 # [ 169.834122] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=want client=5 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=0 worker1 # [ 169.838532] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 169.843340] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 client # [ 169.834112] nix[1528]: copying 1 paths to 'lb:50051'... client # [ 169.834935] nix[1528]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'... worker1 # [ 169.850311] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker2 # [ 169.834271] nix-grpc-daemon[1870]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5) worker1 # [ 169.855545] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker2 # [ 169.846570] nix-grpc-daemon[1870]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 2/5) worker1 # [ 169.939316] nix-daemon[864]: accepted connection from pid 1885, user nix-grpc-daemon (trusted) worker1 # [ 169.952943] nix-daemon[864]: reaped child process 1888, status = succeeded lb # [ 169.941265] niks3-server[1170]: 2026/09/25 16:52:29 INFO Received push request method=POST path=/api/pushes worker1 # [ 169.969215] nix-grpc-daemon[1709]: time=2026-09-25T16:52:29.291Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 169.971406] nix-grpc-daemon[1709]: time=2026-09-25T16:52:29.293Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)" lb # [ 169.973447] niks3-server[1170]: 2026/09/25 16:52:29 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls lb # [ 169.980397] niks3-server[1170]: 2026/09/25 16:52:29 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign lb # [ 169.985281] niks3-server[1170]: 2026/09/25 16:52:29 INFO Signed narinfos id=61 count=1 worker1 # [ 170.007112] nix-grpc-daemon[1709]: time=2026-09-25T16:52:29.329Z level=INFO msg="Uploading 1 narinfos" worker2 # [ 169.989571] nix-grpc-daemon[1870]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 108 ms (attempt 3/5) lb # [ 170.001760] niks3-server[1170]: 2026/09/25 16:52:29 INFO Received complete push request method=POST path=/api/pushes/61/complete lb # [ 170.012336] niks3-server[1170]: 2026/09/25 16:52:29 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst lb # [ 170.020171] niks3-server[1170]: 2026/09/25 16:52:29 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo worker1 # [ 170.043056] nix-grpc-daemon[1709]: time=2026-09-25T16:52:29.365Z level=INFO msg="Upload complete. (182ms)" worker1 # [ 170.049232] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 170.056183] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 170.069304] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 170.079360] nix-daemon[864]: reaped child process 1883, status = succeeded worker1 # [ 170.084753] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) client # [ 170.068744] nix[1528]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051... worker2 # [ 170.099592] nix-grpc-daemon[1870]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 192 ms (attempt 4/5) worker2 # [ 170.306499] nix-grpc-daemon[1870]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 170.310133] nix-grpc-daemon[1870]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 170.326810] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56752 client # [ 170.337370] nix[1528]: copying 1 paths to 'lb:50051'... client # [ 170.341217] nix[1528]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'... worker2 # [ 170.341825] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 170.352223] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 170.373119] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:29Z level=info event=niks3_push_started pid=1930 worker2 # [ 170.478500] nix-grpc-daemon[1930]: time=2026-09-25T16:52:29.769Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 170.565156] nix-daemon[858]: accepted connection from pid 1943, user nix-grpc-daemon (trusted) worker2 # [ 170.578204] nix-daemon[858]: reaped child process 1946, status = succeeded lb # [ 170.582768] niks3-server[1170]: 2026/09/25 16:52:29 INFO Received push request method=POST path=/api/pushes worker2 # [ 170.593262] nix-grpc-daemon[1930]: time=2026-09-25T16:52:29.884Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 170.594770] nix-grpc-daemon[1930]: time=2026-09-25T16:52:29.886Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)" lb # [ 170.621127] niks3-server[1170]: 2026/09/25 16:52:29 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign lb # [ 170.625290] niks3-server[1170]: 2026/09/25 16:52:29 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls worker2 # [ 170.634486] nix-grpc-daemon[1930]: time=2026-09-25T16:52:29.925Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.632209] niks3-server[1170]: 2026/09/25 16:52:29 INFO Signed narinfos id=62 count=1 lb # [ 170.638995] niks3-server[1170]: 2026/09/25 16:52:29 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst lb # [ 170.651077] niks3-server[1170]: 2026/09/25 16:52:29 INFO Received complete push request method=POST path=/api/pushes/62/complete worker2 # [ 170.659111] nix-grpc-daemon[1930]: time=2026-09-25T16:52:29.950Z level=INFO msg="Upload complete. (177ms)" lb # [ 170.657258] niks3-server[1170]: 2026/09/25 16:52:29 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo worker2 # [ 170.661329] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 170.664442] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 170.671845] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 170.675610] nix-daemon[858]: reaped child process 1928, status = succeeded worker2 # [ 170.680245] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) client # [ 170.679164] nix[1528]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 172.099907] nix-daemon[864]: reaped child process 1892, status = succeeded worker1 # [ 172.173450] nix-daemon[864]: accepted connection from pid 1920, user nix-grpc-daemon (trusted) worker1 # [ 172.185628] nix-daemon[864]: reaped child process 1923, status = succeeded lb # [ 172.176294] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received push request method=POST path=/api/pushes worker1 # [ 172.202599] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.524Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.204418] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.526Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)" lb # [ 172.227077] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls lb # [ 172.236963] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv lb # [ 172.239955] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign lb # [ 172.244553] niks3-server[1170]: 2026/09/25 16:52:31 INFO Signed narinfos id=63 count=1 worker1 # [ 172.262800] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.585Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.254973] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received complete push request method=POST path=/api/pushes/63/complete lb # [ 172.258143] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst lb # [ 172.263199] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo worker1 # [ 172.279767] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.602Z level=INFO msg="Upload complete. (187ms)" worker1 # [ 172.289735] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=2 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=6 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 172.297383] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 172.301437] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 172.313307] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 172.316195] nix-daemon[864]: reaped child process 1890, status = succeeded client # [ 172.303809] nix[1528]: copying 1 paths to 'lb:50051'... worker1 # [ 172.322215] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 client # [ 172.307161] nix[1528]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'... worker1 # [ 172.328707] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker2 # [ 172.329168] nix-daemon[858]: reaped child process 1950, status = succeeded worker1 # [ 172.411919] nix-daemon[864]: accepted connection from pid 1927, user nix-grpc-daemon (trusted) worker2 # [ 172.406085] nix-daemon[858]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker1 # [ 172.426113] nix-daemon[864]: reaped child process 1930, status = succeeded worker2 # [ 172.418387] nix-daemon[858]: reaped child process 1978, status = succeeded lb # [ 172.414141] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received push request method=POST path=/api/pushes lb # [ 172.421476] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received push request method=POST path=/api/pushes worker1 # [ 172.445801] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.768Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.447561] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.770Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)" worker2 # [ 172.433428] nix-grpc-daemon[1930]: time=2026-09-25T16:52:31.724Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 172.435316] nix-grpc-daemon[1930]: time=2026-09-25T16:52:31.726Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)" lb # [ 172.457723] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv lb # [ 172.463394] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign lb # [ 172.464824] niks3-server[1170]: 2026/09/25 16:52:31 INFO Signed narinfos id=64 count=1 worker1 # [ 172.484935] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.807Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.469574] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign lb # [ 172.472834] niks3-server[1170]: 2026/09/25 16:52:31 INFO Signed narinfos id=65 count=1 worker2 # [ 172.476808] nix-grpc-daemon[1930]: time=2026-09-25T16:52:31.768Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.475324] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst lb # [ 172.478441] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls lb # [ 172.480790] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst lb # [ 172.485574] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls lb # [ 172.491436] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received complete push request method=POST path=/api/pushes/65/complete lb # [ 172.492852] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received complete push request method=POST path=/api/pushes/64/complete worker1 # [ 172.516125] nix-grpc-daemon[1709]: time=2026-09-25T16:52:31.838Z level=INFO msg="Upload complete. (181ms)" lb # [ 172.500366] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo worker2 # [ 172.502522] nix-grpc-daemon[1930]: time=2026-09-25T16:52:31.793Z level=INFO msg="Upload complete. (214ms)" lb # [ 172.503093] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo worker1 # [ 172.521739] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 172.508606] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=7 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 172.530353] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 172.519337] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 172.535687] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker2 # [ 172.528524] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 172.545484] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker2 # [ 172.535444] nix-daemon[858]: reaped child process 1948, status = succeeded worker1 # [ 172.554061] nix-daemon[864]: reaped child process 1925, status = succeeded client # [ 172.539170] nix[1528]: copying 1 paths to 'lb:50051'... worker2 # [ 172.540326] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 172.559140] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) client # [ 172.542252] nix[1528]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'... client # [ 172.545828] nix[1528]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051... worker2 # [ 172.554133] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 172.641788] nix-daemon[858]: accepted connection from pid 1982, user nix-grpc-daemon (trusted) worker2 # [ 172.654479] nix-daemon[858]: reaped child process 1985, status = succeeded lb # [ 172.659161] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received push request method=POST path=/api/pushes worker2 # [ 172.671469] nix-grpc-daemon[1930]: time=2026-09-25T16:52:31.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 172.673907] nix-grpc-daemon[1930]: time=2026-09-25T16:52:31.964Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)" lb # [ 172.688910] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign lb # [ 172.692495] niks3-server[1170]: 2026/09/25 16:52:31 INFO Signed narinfos id=66 count=1 worker2 # [ 172.698091] nix-grpc-daemon[1930]: time=2026-09-25T16:52:31.989Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.701607] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls lb # [ 172.708949] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst lb # [ 172.714229] niks3-server[1170]: 2026/09/25 16:52:31 INFO Received complete push request method=POST path=/api/pushes/66/complete worker2 # [ 172.721352] nix-grpc-daemon[1930]: time=2026-09-25T16:52:32.012Z level=INFO msg="Upload complete. (159ms)" lb # [ 172.719732] niks3-server[1170]: 2026/09/25 16:52:31 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo worker2 # [ 172.723346] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 172.726712] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 172.734314] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 172.736864] nix-daemon[858]: reaped child process 1980, status = succeeded worker2 # [ 172.740726] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) client # [ 172.739686] nix[1528]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051... worker1 # [ 174.375317] nix-daemon[864]: reaped child process 1934, status = succeeded worker1 # [ 174.449084] nix-daemon[864]: accepted connection from pid 1959, user nix-grpc-daemon (trusted) worker1 # [ 174.461392] nix-daemon[864]: reaped child process 1962, status = succeeded lb # [ 174.449907] niks3-server[1170]: 2026/09/25 16:52:33 INFO Received push request method=POST path=/api/pushes worker1 # [ 174.477323] nix-grpc-daemon[1709]: time=2026-09-25T16:52:33.799Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 174.479897] nix-grpc-daemon[1709]: time=2026-09-25T16:52:33.801Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)" lb # [ 174.497456] niks3-server[1170]: 2026/09/25 16:52:33 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign lb # [ 174.503883] niks3-server[1170]: 2026/09/25 16:52:33 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst worker1 # [ 174.526434] nix-grpc-daemon[1709]: time=2026-09-25T16:52:33.848Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.508663] niks3-server[1170]: 2026/09/25 16:52:33 INFO Signed narinfos id=67 count=1 lb # [ 174.516401] niks3-server[1170]: 2026/09/25 16:52:33 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv lb # [ 174.520414] niks3-server[1170]: 2026/09/25 16:52:33 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls lb # [ 174.530666] niks3-server[1170]: 2026/09/25 16:52:33 INFO Received complete push request method=POST path=/api/pushes/67/complete lb # [ 174.536555] niks3-server[1170]: 2026/09/25 16:52:33 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo worker1 # [ 174.553730] nix-grpc-daemon[1709]: time=2026-09-25T16:52:33.876Z level=INFO msg="Upload complete. (187ms)" worker1 # [ 174.560690] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 174.576699] nix-daemon[864]: reaped child process 1932, status = succeeded worker2 # [ 174.602118] nix-daemon[858]: reaped child process 1989, status = succeeded worker2 # [ 174.655468] nix-daemon[858]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker2 # [ 174.667505] nix-daemon[858]: reaped child process 2017, status = succeeded lb # [ 174.673194] niks3-server[1170]: 2026/09/25 16:52:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 174.686406] nix-grpc-daemon[1930]: time=2026-09-25T16:52:33.977Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 174.687892] nix-grpc-daemon[1930]: time=2026-09-25T16:52:33.979Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)" lb # [ 174.719577] niks3-server[1170]: 2026/09/25 16:52:33 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign worker2 # [ 174.727854] nix-grpc-daemon[1930]: time=2026-09-25T16:52:34.019Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.724948] niks3-server[1170]: 2026/09/25 16:52:33 INFO Signed narinfos id=68 count=1 lb # [ 174.731664] niks3-server[1170]: 2026/09/25 16:52:34 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 174.741940] niks3-server[1170]: 2026/09/25 16:52:34 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv lb # [ 174.751970] niks3-server[1170]: 2026/09/25 16:52:34 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls lb # [ 174.754905] niks3-server[1170]: 2026/09/25 16:52:34 INFO Received complete push request method=POST path=/api/pushes/68/complete worker2 # [ 174.764300] nix-grpc-daemon[1930]: time=2026-09-25T16:52:34.055Z level=INFO msg="Upload complete. (215ms)" lb # [ 174.765052] niks3-server[1170]: 2026/09/25 16:52:34 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo worker2 # [ 174.769477] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=9 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 174.782321] nix-daemon[858]: reaped child process 1987, status = succeeded client # [ 174.802252] systemd[1]: burst.service: Deactivated successfully. client # [ 174.804774] systemd[1]: burst.service: Consumed 155ms CPU time over 5.158s wall clock time, 53.7M memory peak, 13.9K incoming IP traffic, 18.8K outgoing IP traffic. client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; } client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: queue gauges show a burst while every build blocks, in 6.30 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 175.952202] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57754 worker2 # [ 175.940269] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 175.993866] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=want client=6 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker1 # [ 175.999973] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 176.006851] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=want client=6 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker1 # [ 176.011462] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=want client=6 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 176.016470] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 176.025580] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 176.037981] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 176.049291] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 176.141115] nix-daemon[864]: accepted connection from pid 1978, user nix-grpc-daemon (trusted) worker1 # [ 176.153439] nix-daemon[864]: reaped child process 1981, status = succeeded lb # [ 176.143917] niks3-server[1170]: 2026/09/25 16:52:35 INFO Received push request method=POST path=/api/pushes worker1 # [ 176.169937] nix-grpc-daemon[1709]: time=2026-09-25T16:52:35.492Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 176.172117] nix-grpc-daemon[1709]: time=2026-09-25T16:52:35.494Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 176.173598] niks3-server[1170]: 2026/09/25 16:52:35 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign lb # [ 176.179141] niks3-server[1170]: 2026/09/25 16:52:35 INFO Signed narinfos id=69 count=1 worker1 # [ 176.200143] nix-grpc-daemon[1709]: time=2026-09-25T16:52:35.522Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.187865] niks3-server[1170]: 2026/09/25 16:52:35 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 176.204095] niks3-server[1170]: 2026/09/25 16:52:35 INFO Received complete push request method=POST path=/api/pushes/69/complete lb # [ 176.208911] niks3-server[1170]: 2026/09/25 16:52:35 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls worker1 # [ 176.232848] nix-grpc-daemon[1709]: time=2026-09-25T16:52:35.555Z level=INFO msg="Upload complete. (173ms)" lb # [ 176.216380] niks3-server[1170]: 2026/09/25 16:52:35 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 176.237444] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 176.243405] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 176.254784] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 176.258420] nix-daemon[864]: reaped child process 1976, status = succeeded worker1 # [ 176.263365] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 177.300869] nix-daemon[864]: reaped child process 1985, status = succeeded lb # [ 177.338144] envoy[919]: conn peer=[2001:db8:1::1]:53296 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9660 tx=5179 ms=5002 worker1 # [ 177.384367] nix-daemon[864]: accepted connection from pid 2001, user nix-grpc-daemon (trusted) worker1 # [ 177.396961] nix-daemon[864]: reaped child process 2004, status = succeeded lb # [ 177.385693] niks3-server[1170]: 2026/09/25 16:52:36 INFO Received push request method=POST path=/api/pushes worker1 # [ 177.411271] nix-grpc-daemon[1709]: time=2026-09-25T16:52:36.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 177.412749] nix-grpc-daemon[1709]: time=2026-09-25T16:52:36.735Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 177.429437] niks3-server[1170]: 2026/09/25 16:52:36 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 177.433774] niks3-server[1170]: 2026/09/25 16:52:36 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign lb # [ 177.438455] niks3-server[1170]: 2026/09/25 16:52:36 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 177.445144] niks3-server[1170]: 2026/09/25 16:52:36 INFO Signed narinfos id=70 count=1 worker1 # [ 177.466167] nix-grpc-daemon[1709]: time=2026-09-25T16:52:36.788Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.451902] niks3-server[1170]: 2026/09/25 16:52:36 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 177.462354] niks3-server[1170]: 2026/09/25 16:52:36 INFO Received complete push request method=POST path=/api/pushes/70/complete lb # [ 177.467171] niks3-server[1170]: 2026/09/25 16:52:36 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 177.484630] nix-grpc-daemon[1709]: time=2026-09-25T16:52:36.807Z level=INFO msg="Upload complete. (214ms)" worker1 # [ 177.493574] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=10 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 177.503348] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:36Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 177.508230] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 177.511318] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:36Z level=debug event=want client=6 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 177.520967] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 177.525506] nix-daemon[864]: reaped child process 1983, status = succeeded worker1 # [ 177.527679] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 177.531420] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 177.618604] nix-daemon[864]: accepted connection from pid 2010, user nix-grpc-daemon (trusted) worker1 # [ 177.631196] nix-daemon[864]: reaped child process 2013, status = succeeded lb # [ 177.620853] niks3-server[1170]: 2026/09/25 16:52:36 INFO Received push request method=POST path=/api/pushes worker1 # [ 177.646492] nix-grpc-daemon[1709]: time=2026-09-25T16:52:36.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 177.648433] nix-grpc-daemon[1709]: time=2026-09-25T16:52:36.970Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 177.650183] niks3-server[1170]: 2026/09/25 16:52:36 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign lb # [ 177.654971] niks3-server[1170]: 2026/09/25 16:52:36 INFO Signed narinfos id=71 count=1 worker1 # [ 177.677170] nix-grpc-daemon[1709]: time=2026-09-25T16:52:36.999Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.664144] niks3-server[1170]: 2026/09/25 16:52:36 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 177.675924] niks3-server[1170]: 2026/09/25 16:52:36 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 177.682708] niks3-server[1170]: 2026/09/25 16:52:36 INFO Received complete push request method=POST path=/api/pushes/71/complete lb # [ 177.690701] niks3-server[1170]: 2026/09/25 16:52:36 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 177.712251] nix-grpc-daemon[1709]: time=2026-09-25T16:52:37.034Z level=INFO msg="Upload complete. (175ms)" worker1 # [ 177.716210] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 177.720647] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 177.730056] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 177.739440] nix-daemon[864]: reaped child process 2008, status = succeeded worker1 # [ 177.742252] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 178.556458] nix-daemon[864]: reaped child process 2017, status = succeeded worker1 # [ 178.633771] nix-daemon[864]: accepted connection from pid 2033, user nix-grpc-daemon (trusted) worker1 # [ 178.646757] nix-daemon[864]: reaped child process 2036, status = succeeded lb # [ 178.637828] niks3-server[1170]: 2026/09/25 16:52:37 INFO Received push request method=POST path=/api/pushes worker1 # [ 178.662585] nix-grpc-daemon[1709]: time=2026-09-25T16:52:37.984Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 178.664168] nix-grpc-daemon[1709]: time=2026-09-25T16:52:37.986Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 178.674210] niks3-server[1170]: 2026/09/25 16:52:37 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 178.684342] niks3-server[1170]: 2026/09/25 16:52:37 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign lb # [ 178.687968] niks3-server[1170]: 2026/09/25 16:52:37 INFO Signed narinfos id=72 count=1 worker1 # [ 178.708832] nix-grpc-daemon[1709]: time=2026-09-25T16:52:38.031Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.696462] niks3-server[1170]: 2026/09/25 16:52:37 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 178.700260] niks3-server[1170]: 2026/09/25 16:52:37 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 178.704595] niks3-server[1170]: 2026/09/25 16:52:37 INFO Received complete push request method=POST path=/api/pushes/72/complete worker1 # [ 178.729330] nix-grpc-daemon[1709]: time=2026-09-25T16:52:38.051Z level=INFO msg="Upload complete. (180ms)" lb # [ 178.713125] niks3-server[1170]: 2026/09/25 16:52:37 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 178.737685] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 178.745236] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 178.750281] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 178.753328] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=debug event=want client=6 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 178.760258] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 178.762463] nix-daemon[864]: reaped child process 2015, status = succeeded worker1 # [ 178.765866] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 178.769750] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 178.854636] nix-daemon[864]: accepted connection from pid 2042, user nix-grpc-daemon (trusted) worker1 # [ 178.867134] nix-daemon[864]: reaped child process 2045, status = succeeded lb # [ 178.857166] niks3-server[1170]: 2026/09/25 16:52:38 INFO Received push request method=POST path=/api/pushes worker1 # [ 178.883327] nix-grpc-daemon[1709]: time=2026-09-25T16:52:38.205Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 178.884769] nix-grpc-daemon[1709]: time=2026-09-25T16:52:38.207Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 178.887973] niks3-server[1170]: 2026/09/25 16:52:38 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign worker1 # [ 178.910613] nix-grpc-daemon[1709]: time=2026-09-25T16:52:38.233Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.892444] niks3-server[1170]: 2026/09/25 16:52:38 INFO Signed narinfos id=73 count=1 lb # [ 178.898303] niks3-server[1170]: 2026/09/25 16:52:38 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 178.908984] niks3-server[1170]: 2026/09/25 16:52:38 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 178.911707] niks3-server[1170]: 2026/09/25 16:52:38 INFO Received complete push request method=POST path=/api/pushes/73/complete worker1 # [ 178.935412] nix-grpc-daemon[1709]: time=2026-09-25T16:52:38.258Z level=INFO msg="Upload complete. (160ms)" lb # [ 178.919859] niks3-server[1170]: 2026/09/25 16:52:38 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 178.937870] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 178.941967] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 178.947564] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 178.952109] nix-daemon[864]: reaped child process 2040, status = succeeded worker1 # [ 178.955392] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 180.371652] nix-daemon[864]: reaped child process 2049, status = succeeded worker1 # [ 180.450086] nix-daemon[864]: accepted connection from pid 2065, user nix-grpc-daemon (trusted) worker1 # [ 180.463238] nix-daemon[864]: reaped child process 2068, status = succeeded lb # [ 180.449392] niks3-server[1170]: 2026/09/25 16:52:39 INFO Received push request method=POST path=/api/pushes worker1 # [ 180.476131] nix-grpc-daemon[1709]: time=2026-09-25T16:52:39.798Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 180.478718] nix-grpc-daemon[1709]: time=2026-09-25T16:52:39.800Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 180.486356] niks3-server[1170]: 2026/09/25 16:52:39 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 180.499156] niks3-server[1170]: 2026/09/25 16:52:39 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 180.505653] niks3-server[1170]: 2026/09/25 16:52:39 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign worker1 # [ 180.528704] nix-grpc-daemon[1709]: time=2026-09-25T16:52:39.851Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.510912] niks3-server[1170]: 2026/09/25 16:52:39 INFO Signed narinfos id=74 count=1 lb # [ 180.522123] niks3-server[1170]: 2026/09/25 16:52:39 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 180.526746] niks3-server[1170]: 2026/09/25 16:52:39 INFO Received complete push request method=POST path=/api/pushes/74/complete lb # [ 180.532247] niks3-server[1170]: 2026/09/25 16:52:39 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 180.549615] nix-grpc-daemon[1709]: time=2026-09-25T16:52:39.872Z level=INFO msg="Upload complete. (186ms)" worker1 # [ 180.558905] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 180.568834] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:39Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 180.574256] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 180.577353] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:39Z level=debug event=want client=6 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 180.587317] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 180.590260] nix-daemon[864]: reaped child process 2047, status = succeeded worker1 # [ 180.595707] nix-grpc-daemon[1709]: time=2026-09-25T16:52:39.918Z level=INFO msg="All 1 paths already cached" worker1 # [ 180.600258] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 180.604853] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 180.686962] nix-daemon[864]: accepted connection from pid 2074, user nix-grpc-daemon (trusted) worker1 # [ 180.699637] nix-daemon[864]: reaped child process 2077, status = succeeded lb # [ 180.687243] niks3-server[1170]: 2026/09/25 16:52:39 INFO Received push request method=POST path=/api/pushes worker1 # [ 180.714211] nix-grpc-daemon[1709]: time=2026-09-25T16:52:40.036Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 180.716192] nix-grpc-daemon[1709]: time=2026-09-25T16:52:40.038Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 180.719198] niks3-server[1170]: 2026/09/25 16:52:39 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign lb # [ 180.727646] niks3-server[1170]: 2026/09/25 16:52:39 INFO Signed narinfos id=75 count=1 worker1 # [ 180.748963] nix-grpc-daemon[1709]: time=2026-09-25T16:52:40.071Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.731324] niks3-server[1170]: 2026/09/25 16:52:40 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 180.740103] niks3-server[1170]: 2026/09/25 16:52:40 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 180.750235] niks3-server[1170]: 2026/09/25 16:52:40 INFO Received complete push request method=POST path=/api/pushes/75/complete worker1 # [ 180.775849] nix-grpc-daemon[1709]: time=2026-09-25T16:52:40.098Z level=INFO msg="Upload complete. (166ms)" lb # [ 180.758549] niks3-server[1170]: 2026/09/25 16:52:40 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 180.779715] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 180.784409] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 180.795113] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 180.799501] nix-daemon[864]: reaped child process 2072, status = succeeded worker1 # [ 180.804193] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 182.242698] nix-daemon[864]: reaped child process 2081, status = succeeded worker1 # [ 182.327087] nix-daemon[864]: accepted connection from pid 2097, user nix-grpc-daemon (trusted) worker1 # [ 182.340632] nix-daemon[864]: reaped child process 2100, status = succeeded lb # [ 182.326636] niks3-server[1170]: 2026/09/25 16:52:41 INFO Received push request method=POST path=/api/pushes worker1 # [ 182.353979] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.676Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 182.356056] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.678Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 182.369654] niks3-server[1170]: 2026/09/25 16:52:41 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 182.380765] niks3-server[1170]: 2026/09/25 16:52:41 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign lb # [ 182.386737] niks3-server[1170]: 2026/09/25 16:52:41 INFO Signed narinfos id=76 count=1 worker1 # [ 182.407844] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.730Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.394397] niks3-server[1170]: 2026/09/25 16:52:41 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 182.405438] niks3-server[1170]: 2026/09/25 16:52:41 INFO Received complete push request method=POST path=/api/pushes/76/complete lb # [ 182.410495] niks3-server[1170]: 2026/09/25 16:52:41 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 182.427867] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.750Z level=INFO msg="Upload complete. (215ms)" lb # [ 182.413305] niks3-server[1170]: 2026/09/25 16:52:41 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst worker1 # [ 182.438535] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=13 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 182.447288] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 182.451196] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 182.454206] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=debug event=want client=6 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 182.463297] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 182.466297] nix-daemon[864]: reaped child process 2079, status = succeeded worker1 # [ 182.470495] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.793Z level=INFO msg="All 1 paths already cached" worker1 # [ 182.474937] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 182.479558] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 182.561388] nix-daemon[864]: accepted connection from pid 2106, user nix-grpc-daemon (trusted) worker1 # [ 182.575519] nix-daemon[864]: reaped child process 2109, status = succeeded lb # [ 182.561666] niks3-server[1170]: 2026/09/25 16:52:41 INFO Received push request method=POST path=/api/pushes worker1 # [ 182.587975] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.910Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 182.589497] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.910Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 182.588948] niks3-server[1170]: 2026/09/25 16:52:41 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign lb # [ 182.593969] niks3-server[1170]: 2026/09/25 16:52:41 INFO Signed narinfos id=77 count=1 worker1 # [ 182.615591] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.938Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.603257] niks3-server[1170]: 2026/09/25 16:52:41 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 182.609340] niks3-server[1170]: 2026/09/25 16:52:41 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 182.620630] niks3-server[1170]: 2026/09/25 16:52:41 INFO Received complete push request method=POST path=/api/pushes/77/complete worker1 # [ 182.644959] nix-grpc-daemon[1709]: time=2026-09-25T16:52:41.967Z level=INFO msg="Upload complete. (160ms)" lb # [ 182.628422] niks3-server[1170]: 2026/09/25 16:52:41 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 182.648498] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 182.653313] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 182.662720] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 182.668112] nix-daemon[864]: reaped child process 2104, status = succeeded worker1 # [ 182.674891] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 183.908755] nix-daemon[864]: reaped child process 2113, status = succeeded worker1 # [ 183.979695] nix-daemon[864]: accepted connection from pid 2129, user nix-grpc-daemon (trusted) worker1 # [ 183.990782] nix-daemon[864]: reaped child process 2132, status = succeeded lb # [ 183.979742] niks3-server[1170]: 2026/09/25 16:52:43 INFO Received push request method=POST path=/api/pushes worker1 # [ 184.007947] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.330Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 184.009523] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.332Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 184.017876] niks3-server[1170]: 2026/09/25 16:52:43 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 184.030905] niks3-server[1170]: 2026/09/25 16:52:43 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign lb # [ 184.035883] niks3-server[1170]: 2026/09/25 16:52:43 INFO Signed narinfos id=78 count=1 worker1 # [ 184.056850] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.379Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.043250] niks3-server[1170]: 2026/09/25 16:52:43 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 184.049705] niks3-server[1170]: 2026/09/25 16:52:43 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 184.058224] niks3-server[1170]: 2026/09/25 16:52:43 INFO Received complete push request method=POST path=/api/pushes/78/complete lb # [ 184.064884] niks3-server[1170]: 2026/09/25 16:52:43 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 184.081302] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.403Z level=INFO msg="Upload complete. (198ms)" worker1 # [ 184.092456] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=14 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 184.102330] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 184.106397] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 184.110182] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=debug event=want client=6 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 184.119520] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 184.123548] nix-daemon[864]: reaped child process 2111, status = succeeded worker1 # [ 184.127932] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.450Z level=INFO msg="All 1 paths already cached" worker1 # [ 184.132491] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 184.135909] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 184.215800] nix-daemon[864]: accepted connection from pid 2138, user nix-grpc-daemon (trusted) worker1 # [ 184.229433] nix-daemon[864]: reaped child process 2141, status = succeeded lb # [ 184.216307] niks3-server[1170]: 2026/09/25 16:52:43 INFO Received push request method=POST path=/api/pushes worker1 # [ 184.241850] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.564Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 184.243749] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.565Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 184.245789] niks3-server[1170]: 2026/09/25 16:52:43 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 184.255633] niks3-server[1170]: 2026/09/25 16:52:43 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign worker1 # [ 184.277873] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.600Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.259920] niks3-server[1170]: 2026/09/25 16:52:43 INFO Signed narinfos id=79 count=1 lb # [ 184.268349] niks3-server[1170]: 2026/09/25 16:52:43 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 184.279791] niks3-server[1170]: 2026/09/25 16:52:43 INFO Received complete push request method=POST path=/api/pushes/79/complete worker1 # [ 184.305492] nix-grpc-daemon[1709]: time=2026-09-25T16:52:43.628Z level=INFO msg="Upload complete. (164ms)" lb # [ 184.288408] niks3-server[1170]: 2026/09/25 16:52:43 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 184.309606] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 184.315287] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 184.324699] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 184.332469] nix-daemon[864]: reaped child process 2136, status = succeeded worker1 # [ 184.337092] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 185.372564] nix-daemon[864]: reaped child process 2145, status = succeeded worker1 # [ 185.455359] nix-daemon[864]: accepted connection from pid 2161, user nix-grpc-daemon (trusted) worker1 # [ 185.468590] nix-daemon[864]: reaped child process 2164, status = succeeded lb # [ 185.458376] niks3-server[1170]: 2026/09/25 16:52:44 INFO Received push request method=POST path=/api/pushes worker1 # [ 185.484282] nix-grpc-daemon[1709]: time=2026-09-25T16:52:44.806Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 185.485802] nix-grpc-daemon[1709]: time=2026-09-25T16:52:44.808Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 185.500634] niks3-server[1170]: 2026/09/25 16:52:44 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 185.505496] niks3-server[1170]: 2026/09/25 16:52:44 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 185.513974] niks3-server[1170]: 2026/09/25 16:52:44 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign lb # [ 185.517628] niks3-server[1170]: 2026/09/25 16:52:44 INFO Signed narinfos id=80 count=1 worker1 # [ 185.535935] nix-grpc-daemon[1709]: time=2026-09-25T16:52:44.858Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.523703] niks3-server[1170]: 2026/09/25 16:52:44 INFO Received complete push request method=POST path=/api/pushes/80/complete lb # [ 185.525393] niks3-server[1170]: 2026/09/25 16:52:44 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 185.529939] niks3-server[1170]: 2026/09/25 16:52:44 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 185.551207] nix-grpc-daemon[1709]: time=2026-09-25T16:52:44.873Z level=INFO msg="Upload complete. (206ms)" worker1 # [ 185.557767] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=15 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 185.569203] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:44Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 185.573380] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 185.576445] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:44Z level=debug event=want client=6 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 185.585300] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 185.587841] nix-daemon[864]: reaped child process 2143, status = succeeded worker1 # [ 185.591972] nix-grpc-daemon[1709]: time=2026-09-25T16:52:44.914Z level=INFO msg="All 2 paths already cached" worker1 # [ 185.596720] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 185.600404] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 185.685629] nix-daemon[864]: accepted connection from pid 2170, user nix-grpc-daemon (trusted) worker1 # [ 185.698423] nix-daemon[864]: reaped child process 2173, status = succeeded lb # [ 185.687918] niks3-server[1170]: 2026/09/25 16:52:44 INFO Received push request method=POST path=/api/pushes worker1 # [ 185.714177] nix-grpc-daemon[1709]: time=2026-09-25T16:52:45.036Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 185.716120] nix-grpc-daemon[1709]: time=2026-09-25T16:52:45.038Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 185.718368] niks3-server[1170]: 2026/09/25 16:52:44 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign lb # [ 185.722293] niks3-server[1170]: 2026/09/25 16:52:44 INFO Signed narinfos id=81 count=1 worker1 # [ 185.743336] nix-grpc-daemon[1709]: time=2026-09-25T16:52:45.065Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.731961] niks3-server[1170]: 2026/09/25 16:52:45 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 185.737626] niks3-server[1170]: 2026/09/25 16:52:45 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 185.751288] niks3-server[1170]: 2026/09/25 16:52:45 INFO Received complete push request method=POST path=/api/pushes/81/complete lb # [ 185.758868] niks3-server[1170]: 2026/09/25 16:52:45 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 185.781118] nix-grpc-daemon[1709]: time=2026-09-25T16:52:45.103Z level=INFO msg="Upload complete. (175ms)" worker1 # [ 185.783666] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 185.789464] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 185.800109] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 185.807995] nix-daemon[864]: reaped child process 2168, status = succeeded worker1 # [ 185.812758] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 187.450418] nix-daemon[864]: reaped child process 2177, status = succeeded worker1 # [ 187.533922] nix-daemon[864]: accepted connection from pid 2193, user nix-grpc-daemon (trusted) worker1 # [ 187.547128] nix-daemon[864]: reaped child process 2196, status = succeeded lb # [ 187.536594] niks3-server[1170]: 2026/09/25 16:52:46 INFO Received push request method=POST path=/api/pushes worker1 # [ 187.565429] nix-grpc-daemon[1709]: time=2026-09-25T16:52:46.887Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 187.566916] nix-grpc-daemon[1709]: time=2026-09-25T16:52:46.889Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 187.581370] niks3-server[1170]: 2026/09/25 16:52:46 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 187.587090] niks3-server[1170]: 2026/09/25 16:52:46 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 187.594324] niks3-server[1170]: 2026/09/25 16:52:46 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign worker1 # [ 187.618208] nix-grpc-daemon[1709]: time=2026-09-25T16:52:46.940Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.601126] niks3-server[1170]: 2026/09/25 16:52:46 INFO Signed narinfos id=82 count=1 lb # [ 187.605985] niks3-server[1170]: 2026/09/25 16:52:46 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 187.616358] niks3-server[1170]: 2026/09/25 16:52:46 INFO Received complete push request method=POST path=/api/pushes/82/complete lb # [ 187.625769] niks3-server[1170]: 2026/09/25 16:52:46 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 187.642326] nix-grpc-daemon[1709]: time=2026-09-25T16:52:46.964Z level=INFO msg="Upload complete. (220ms)" worker1 # [ 187.648705] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=16 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 187.658268] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:46Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 187.663324] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 187.674605] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 187.681069] nix-daemon[864]: reaped child process 2175, status = succeeded worker1 # [ 187.688207] nix-grpc-daemon[1709]: time=2026-09-25T16:52:47.010Z level=INFO msg="All 2 paths already cached" worker1 # [ 187.695774] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 187.705427] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 187.793799] nix-daemon[864]: accepted connection from pid 2200, user nix-grpc-daemon (trusted) worker1 # [ 187.806051] nix-daemon[864]: reaped child process 2203, status = succeeded lb # [ 187.796397] niks3-server[1170]: 2026/09/25 16:52:47 INFO Received push request method=POST path=/api/pushes worker1 # [ 187.823465] nix-grpc-daemon[1709]: time=2026-09-25T16:52:47.146Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 187.824931] nix-grpc-daemon[1709]: time=2026-09-25T16:52:47.147Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 187.833354] niks3-server[1170]: 2026/09/25 16:52:47 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign lb # [ 187.839814] niks3-server[1170]: 2026/09/25 16:52:47 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls worker1 # [ 187.865838] nix-grpc-daemon[1709]: time=2026-09-25T16:52:47.188Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.847312] niks3-server[1170]: 2026/09/25 16:52:47 INFO Signed narinfos id=83 count=1 lb # [ 187.852870] niks3-server[1170]: 2026/09/25 16:52:47 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 187.866160] niks3-server[1170]: 2026/09/25 16:52:47 INFO Received complete push request method=POST path=/api/pushes/83/complete worker1 # [ 187.891289] nix-grpc-daemon[1709]: time=2026-09-25T16:52:47.213Z level=INFO msg="Upload complete. (175ms)" lb # [ 187.874880] niks3-server[1170]: 2026/09/25 16:52:47 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 187.895340] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 187.900112] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 187.909702] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 187.918403] nix-daemon[864]: reaped child process 2198, status = succeeded worker1 # [ 187.925056] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 189.366309] nix-daemon[864]: reaped child process 2207, status = succeeded worker1 # [ 189.441906] nix-daemon[864]: accepted connection from pid 2223, user nix-grpc-daemon (trusted) worker1 # [ 189.454860] nix-daemon[864]: reaped child process 2226, status = succeeded lb # [ 189.446267] niks3-server[1170]: 2026/09/25 16:52:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 189.472918] nix-grpc-daemon[1709]: time=2026-09-25T16:52:48.795Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 189.474627] nix-grpc-daemon[1709]: time=2026-09-25T16:52:48.797Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 189.490707] niks3-server[1170]: 2026/09/25 16:52:48 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 189.497988] niks3-server[1170]: 2026/09/25 16:52:48 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign worker1 # [ 189.521867] nix-grpc-daemon[1709]: time=2026-09-25T16:52:48.844Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.505282] niks3-server[1170]: 2026/09/25 16:52:48 INFO Signed narinfos id=84 count=1 lb # [ 189.515412] niks3-server[1170]: 2026/09/25 16:52:48 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 189.523899] niks3-server[1170]: 2026/09/25 16:52:48 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 189.533335] niks3-server[1170]: 2026/09/25 16:52:48 INFO Received complete push request method=POST path=/api/pushes/84/complete lb # [ 189.540638] niks3-server[1170]: 2026/09/25 16:52:48 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 189.562005] nix-grpc-daemon[1709]: time=2026-09-25T16:52:48.884Z level=INFO msg="Upload complete. (229ms)" worker1 # [ 189.569707] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=17 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 189.578248] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:48Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 189.582901] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 189.594502] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 189.600953] nix-daemon[864]: reaped child process 2205, status = succeeded worker1 # [ 189.607204] nix-grpc-daemon[1709]: time=2026-09-25T16:52:48.929Z level=INFO msg="All 2 paths already cached" worker1 # [ 189.614391] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 189.622128] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 189.708256] nix-daemon[864]: accepted connection from pid 2230, user nix-grpc-daemon (trusted) worker1 # [ 189.721481] nix-daemon[864]: reaped child process 2233, status = succeeded lb # [ 189.710860] niks3-server[1170]: 2026/09/25 16:52:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 189.738179] nix-grpc-daemon[1709]: time=2026-09-25T16:52:49.060Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 189.740251] nix-grpc-daemon[1709]: time=2026-09-25T16:52:49.062Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 189.744997] niks3-server[1170]: 2026/09/25 16:52:49 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 189.753599] niks3-server[1170]: 2026/09/25 16:52:49 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign lb # [ 189.759562] niks3-server[1170]: 2026/09/25 16:52:49 INFO Signed narinfos id=85 count=1 worker1 # [ 189.783173] nix-grpc-daemon[1709]: time=2026-09-25T16:52:49.105Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.767170] niks3-server[1170]: 2026/09/25 16:52:49 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 189.783606] niks3-server[1170]: 2026/09/25 16:52:49 INFO Received complete push request method=POST path=/api/pushes/85/complete worker1 # [ 189.809667] nix-grpc-daemon[1709]: time=2026-09-25T16:52:49.132Z level=INFO msg="Upload complete. (180ms)" lb # [ 189.792394] niks3-server[1170]: 2026/09/25 16:52:49 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 189.814582] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 189.820448] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 worker1 # [ 189.831234] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 189.841798] nix-daemon[864]: reaped child process 2228, status = succeeded worker1 # [ 189.849651] nix-daemon[864]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker1 # [ 191.080419] nix-daemon[864]: reaped child process 2237, status = succeeded worker1 # [ 191.156424] nix-daemon[864]: accepted connection from pid 2253, user nix-grpc-daemon (trusted) worker1 # [ 191.168338] nix-daemon[864]: reaped child process 2256, status = succeeded lb # [ 191.157348] niks3-server[1170]: 2026/09/25 16:52:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 191.185983] nix-grpc-daemon[1709]: time=2026-09-25T16:52:50.508Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 191.187498] nix-grpc-daemon[1709]: time=2026-09-25T16:52:50.510Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 191.198305] niks3-server[1170]: 2026/09/25 16:52:50 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 191.207446] niks3-server[1170]: 2026/09/25 16:52:50 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 191.214753] niks3-server[1170]: 2026/09/25 16:52:50 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign worker1 # [ 191.236425] nix-grpc-daemon[1709]: time=2026-09-25T16:52:50.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 191.218255] niks3-server[1170]: 2026/09/25 16:52:50 INFO Signed narinfos id=86 count=1 lb # [ 191.223764] niks3-server[1170]: 2026/09/25 16:52:50 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 191.227316] niks3-server[1170]: 2026/09/25 16:52:50 INFO Received complete push request method=POST path=/api/pushes/86/complete worker1 # [ 191.250195] nix-grpc-daemon[1709]: time=2026-09-25T16:52:50.572Z level=INFO msg="Upload complete. (193ms)" lb # [ 191.233632] niks3-server[1170]: 2026/09/25 16:52:50 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 191.256141] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57754 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=18 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 191.269411] nix-daemon[864]: reaped child process 2235, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.49 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 191.369738] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: df21da13d65a4e42886a1ecb006e4728 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 191.503847] nix-grpc-daemon[1870]: ts=2026-09-25T16:52:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56752 client # [ 191.509660] nix[1598]: don't know how to build these paths: client # [ 191.510623] nix[1598]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 191.526740] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57754 client # [ 191.530218] nix[1598]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker worker1 # [ 191.545419] nix-grpc-daemon[1635]: ts=2026-09-25T16:52:50Z level=debug event=want client=7 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 197.338322] envoy[919]: conn peer=[2001:db8:1::1]:49532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27098 tx=12298 ms=15321 client # [ 221.531572] nix[1598]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 221.540849] nix[1598]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 221.571704] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 221.574727] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 221.579088] systemd[1]: gpu.service: Consumed 154ms CPU time over 30.202s wall clock time, 35.6M memory peak, 5.6K incoming IP traffic, 5.2K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.40 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 46.37 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.91 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 223.954640] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:23Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 224.301846] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 224.308462] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 224.344556] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:23Z level=debug event=want client=8 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker1 # [ 224.349284] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:23Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 224.336126] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 224.348127] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56752 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 224.361530] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 224.372316] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 224.477023] nix-daemon[858]: accepted connection from pid 2025, user nix-grpc-daemon (trusted) worker2 # [ 224.489372] nix-daemon[858]: reaped child process 2028, status = succeeded lb # [ 224.494363] niks3-server[1170]: 2026/09/25 16:53:23 INFO Received push request method=POST path=/api/pushes worker2 # [ 224.508880] nix-grpc-daemon[1930]: time=2026-09-25T16:53:23.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 224.510523] nix-grpc-daemon[1930]: time=2026-09-25T16:53:23.801Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 224.534070] niks3-server[1170]: 2026/09/25 16:53:23 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 224.549164] niks3-server[1170]: 2026/09/25 16:53:23 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign lb # [ 224.554238] niks3-server[1170]: 2026/09/25 16:53:23 INFO Signed narinfos id=87 count=1 worker2 # [ 224.560887] nix-grpc-daemon[1930]: time=2026-09-25T16:53:23.851Z level=INFO msg="Uploading 1 narinfos" lb # [ 224.572262] niks3-server[1170]: 2026/09/25 16:53:23 INFO Received complete push request method=POST path=/api/pushes/87/complete lb # [ 224.576216] niks3-server[1170]: 2026/09/25 16:53:23 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 224.583191] niks3-server[1170]: 2026/09/25 16:53:23 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 224.585366] nix-grpc-daemon[1930]: time=2026-09-25T16:53:23.876Z level=INFO msg="Upload complete. (198ms)" worker2 # [ 224.590823] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 224.597636] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 224.611108] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 224.620355] nix-daemon[858]: reaped child process 2023, status = succeeded client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... worker2 # [ 224.628319] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 225.268611] nix-daemon[858]: reaped child process 2032, status = succeeded worker2 # [ 225.353891] nix-daemon[858]: accepted connection from pid 2048, user nix-grpc-daemon (trusted) worker2 # [ 225.366464] nix-daemon[858]: reaped child process 2051, status = succeeded lb # [ 225.370625] niks3-server[1170]: 2026/09/25 16:53:24 INFO Received push request method=POST path=/api/pushes worker2 # [ 225.383303] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.674Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 225.385160] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.676Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 225.410500] niks3-server[1170]: 2026/09/25 16:53:24 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 225.424108] niks3-server[1170]: 2026/09/25 16:53:24 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign lb # [ 225.435104] niks3-server[1170]: 2026/09/25 16:53:24 INFO Signed narinfos id=88 count=1 worker2 # [ 225.440049] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.731Z level=INFO msg="Uploading 1 narinfos" lb # [ 225.437358] niks3-server[1170]: 2026/09/25 16:53:24 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 225.440867] niks3-server[1170]: 2026/09/25 16:53:24 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 225.447079] niks3-server[1170]: 2026/09/25 16:53:24 INFO Received complete push request method=POST path=/api/pushes/88/complete lb # [ 225.453997] niks3-server[1170]: 2026/09/25 16:53:24 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 225.455692] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.747Z level=INFO msg="Upload complete. (218ms)" worker2 # [ 225.462803] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=0 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=19 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 225.484829] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:24Z level=debug event=want client=8 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 225.473406] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 225.489233] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:24Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 225.485507] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 225.492266] nix-daemon[858]: reaped child process 2030, status = succeeded worker2 # [ 225.498376] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.789Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 225.505480] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 225.513806] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 225.596075] nix-daemon[858]: accepted connection from pid 2055, user nix-grpc-daemon (trusted) worker2 # [ 225.608956] nix-daemon[858]: reaped child process 2058, status = succeeded lb # [ 225.613580] niks3-server[1170]: 2026/09/25 16:53:24 INFO Received push request method=POST path=/api/pushes worker2 # [ 225.625245] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.916Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 225.626966] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.918Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 225.645804] niks3-server[1170]: 2026/09/25 16:53:24 INFO Received sign narinfos request method=POST path=/api/pushes/89/sign worker2 # [ 225.654930] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.946Z level=INFO msg="Uploading 1 narinfos" lb # [ 225.651927] niks3-server[1170]: 2026/09/25 16:53:24 INFO Signed narinfos id=89 count=1 lb # [ 225.656066] niks3-server[1170]: 2026/09/25 16:53:24 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 225.663193] niks3-server[1170]: 2026/09/25 16:53:24 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 225.670727] niks3-server[1170]: 2026/09/25 16:53:24 INFO Received complete push request method=POST path=/api/pushes/89/complete worker2 # [ 225.679873] nix-grpc-daemon[1930]: time=2026-09-25T16:53:24.971Z level=INFO msg="Upload complete. (160ms)" lb # [ 225.678224] niks3-server[1170]: 2026/09/25 16:53:24 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 225.682960] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 225.688209] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 225.697629] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 225.701465] nix-daemon[858]: reaped child process 2053, status = succeeded worker2 # [ 225.706295] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 226.519701] nix-daemon[858]: reaped child process 2062, status = succeeded worker2 # [ 226.595084] nix-daemon[858]: accepted connection from pid 2078, user nix-grpc-daemon (trusted) worker2 # [ 226.606653] nix-daemon[858]: reaped child process 2081, status = succeeded lb # [ 226.610360] niks3-server[1170]: 2026/09/25 16:53:25 INFO Received push request method=POST path=/api/pushes worker2 # [ 226.622536] nix-grpc-daemon[1930]: time=2026-09-25T16:53:25.914Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 226.623978] nix-grpc-daemon[1930]: time=2026-09-25T16:53:25.915Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 226.650921] niks3-server[1170]: 2026/09/25 16:53:25 INFO Received sign narinfos request method=POST path=/api/pushes/90/sign lb # [ 226.653883] niks3-server[1170]: 2026/09/25 16:53:25 INFO Signed narinfos id=90 count=1 worker2 # [ 226.656450] nix-grpc-daemon[1930]: time=2026-09-25T16:53:25.947Z level=INFO msg="Uploading 1 narinfos" lb # [ 226.656815] niks3-server[1170]: 2026/09/25 16:53:25 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 226.659671] niks3-server[1170]: 2026/09/25 16:53:25 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 226.662152] niks3-server[1170]: 2026/09/25 16:53:25 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 226.668662] niks3-server[1170]: 2026/09/25 16:53:25 INFO Received complete push request method=POST path=/api/pushes/90/complete worker2 # [ 226.674348] nix-grpc-daemon[1930]: time=2026-09-25T16:53:25.965Z level=INFO msg="Upload complete. (162ms)" lb # [ 226.673473] niks3-server[1170]: 2026/09/25 16:53:25 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 226.676805] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=0 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=20 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 226.684214] nix-daemon[858]: reaped child process 2060, status = succeeded worker2 # [ 226.687029] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 226.701356] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:26Z level=debug event=want client=8 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 226.692983] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56752 worker1 # [ 226.705667] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:26Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 226.698771] nix-grpc-daemon[1930]: time=2026-09-25T16:53:25.990Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 226.703865] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 226.709646] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 226.793451] nix-daemon[858]: accepted connection from pid 2085, user nix-grpc-daemon (trusted) worker2 # [ 226.805717] nix-daemon[858]: reaped child process 2088, status = succeeded lb # [ 226.810822] niks3-server[1170]: 2026/09/25 16:53:26 INFO Received push request method=POST path=/api/pushes worker2 # [ 226.822228] nix-grpc-daemon[1930]: time=2026-09-25T16:53:26.113Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 226.824214] nix-grpc-daemon[1930]: time=2026-09-25T16:53:26.115Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 226.845841] niks3-server[1170]: 2026/09/25 16:53:26 INFO Received sign narinfos request method=POST path=/api/pushes/91/sign lb # [ 226.850756] niks3-server[1170]: 2026/09/25 16:53:26 INFO Signed narinfos id=91 count=1 worker2 # [ 226.857784] nix-grpc-daemon[1930]: time=2026-09-25T16:53:26.149Z level=INFO msg="Uploading 1 narinfos" lb # [ 226.857301] niks3-server[1170]: 2026/09/25 16:53:26 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 226.870980] niks3-server[1170]: 2026/09/25 16:53:26 INFO Received complete push request method=POST path=/api/pushes/91/complete worker2 # [ 226.882575] nix-grpc-daemon[1930]: time=2026-09-25T16:53:26.174Z level=INFO msg="Upload complete. (167ms)" lb # [ 226.882821] niks3-server[1170]: 2026/09/25 16:53:26 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 226.885686] niks3-server[1170]: 2026/09/25 16:53:26 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 226.886582] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 226.891466] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 worker2 # [ 226.900539] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 226.907541] nix-daemon[858]: reaped child process 2083, status = succeeded worker2 # [ 226.912498] nix-daemon[858]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 227.340266] envoy[919]: conn peer=[2001:db8:1::1]:49948 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=929 tx=596 ms=30048 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 228.355757] nix-daemon[858]: reaped child process 2092, status = succeeded worker2 # [ 228.439086] nix-daemon[858]: accepted connection from pid 2108, user nix-grpc-daemon (trusted) worker2 # [ 228.451784] nix-daemon[858]: reaped child process 2111, status = succeeded lb # [ 228.456659] niks3-server[1170]: 2026/09/25 16:53:27 INFO Received push request method=POST path=/api/pushes worker2 # [ 228.468515] nix-grpc-daemon[1930]: time=2026-09-25T16:53:27.759Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 228.470306] nix-grpc-daemon[1930]: time=2026-09-25T16:53:27.761Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 228.503860] niks3-server[1170]: 2026/09/25 16:53:27 INFO Received sign narinfos request method=POST path=/api/pushes/92/sign worker2 # [ 228.511365] nix-grpc-daemon[1930]: time=2026-09-25T16:53:27.802Z level=INFO msg="Uploading 1 narinfos" lb # [ 228.509663] niks3-server[1170]: 2026/09/25 16:53:27 INFO Signed narinfos id=92 count=1 lb # [ 228.517144] niks3-server[1170]: 2026/09/25 16:53:27 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 228.524248] niks3-server[1170]: 2026/09/25 16:53:27 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 228.530939] niks3-server[1170]: 2026/09/25 16:53:27 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 228.539112] niks3-server[1170]: 2026/09/25 16:53:27 INFO Received complete push request method=POST path=/api/pushes/92/complete worker2 # [ 228.547939] nix-grpc-daemon[1930]: time=2026-09-25T16:53:27.839Z level=INFO msg="Upload complete. (227ms)" lb # [ 228.547791] niks3-server[1170]: 2026/09/25 16:53:27 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 228.555281] nix-grpc-daemon[1870]: ts=2026-09-25T16:53:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56752 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=21 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 228.570157] nix-daemon[858]: reaped child process 2090, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 4.43 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.12 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 228.960355] nix-grpc-daemon[1635]: ts=2026-09-25T16:53:28Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 7.78 seconds) (finished: run the VM test script, in 230.91 seconds) test script finished in 231.09s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-25T16:53:30Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-25T16:53:31Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-25T16:53:31Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-25T16:53:31Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.05 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh