tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.mQYsSxmsbr', fmt=raw size=1073741824 client: QEMU running (pid 49) lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) lb # Formatting '/build/vm-state-lb/tmp.4ro5bdNmLV', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) lb # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done lb # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: 95830c48-09f8-4980-a821-1a3c2658b02c lb # Filesystem UUID: 86e65e3a-d71a-476b-99c1-afe1eaa27d79 client # Superblock backups stored on blocks: lb # Superblock backups stored on blocks: client # 32768, 98304, 163840, 229376 lb # 32768, 98304, 163840, 229376 client # lb # client # Allocating group tables: 0/8 done lb # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done lb # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done lb # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done client # lb # client # Virtualisation disk image created. lb # Virtualisation disk image created. client # Starting virtiofs daemons... lb # Starting virtiofs daemons... client # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2: QEMU running (pid 52) client # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) client # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # Formatting '/build/vm-state-worker1/tmp.kmDfEb3xJd', fmt=raw size=1073741824 lb # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Disk image does not exist, creating the virtualisation disk image... client # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) (finished: start all VMs, in 0.23 seconds) worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Formatting '/build/vm-state-worker2/tmp.irL26K5AEK', fmt=raw size=1073741824 client: waiting for unit network-addresses-eth1.service worker1 # Discarding device blocks: 0/262144 done worker2 # mke2fs 1.47.4 (6-Mar-2025) client: waiting for the VM to finish booting worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Discarding device blocks: 0/262144 done client # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # Filesystem UUID: 7129ed64-7510-46d7-bff0-0b537e13403b worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # Superblock backups stored on blocks: worker2 # Filesystem UUID: 2679bd0b-f316-4cc7-b526-db7c0c2f47d4 client # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker1 # 32768, 98304, 163840, 229376 worker2 # Superblock backups stored on blocks: client # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker2 # 32768, 98304, 163840, 229376 lb # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker1 # client # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker1 # Allocating group tables: 0/8 done client # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker1 # Writing inode tables: 0/8 done worker2 # worker1 # Creating journal (8192 blocks): done worker2 # Allocating group tables: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing inode tables: 0/8 done worker1 # worker2 # Creating journal (8192 blocks): done worker1 # Virtualisation disk image created. worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Starting virtiofs daemons... worker2 # worker1 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Virtualisation disk image created. worker1 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Starting virtiofs daemons... worker1 # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T13:45:14Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T13:45:14Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T13:45:14Z INFO virtiofsd] Client connected, servicing requests client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # lb # lb # worker1 # worker1 # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # client # Booting from ROM... worker2 # Booting from ROM... worker1 # Booting from ROM... lb # Booting from ROM... client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test/init regInfo=/nix/store/j0bs04qrv7kdcmc859n70b50kc7sz3gd-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lvqq63fax2ya6fsm3d7s7hfg0rmfbnl4-nixos-system-worker2-test/init regInfo=/nix/store/6pd0cf3aa37mjz7663lg8n7pgkfbwknl-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] kvm-clock: using sched offset of 474330809 cycles worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002719] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.002731] Using GB pages for direct mapping worker2 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.002822] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.002838] ACPI: Early table checksum verification disabled client # [ 0.002840] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.002844] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002849] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002855] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] kvm-clock: using sched offset of 470558837 cycles client # [ 0.002857] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dn8gqamk2zyr2nvpgiwfbpgwzjyrjlpw-nixos-system-worker1-test/init regInfo=/nix/store/ndzr4x0h49369zkyn79cnanic26lxrvk-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.002859] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000004] tsc: Detected 2400.012 MHz processor client # [ 0.002860] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.002862] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.002863] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.002865] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002738] Using GB pages for direct mapping worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.002856] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.002866] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.002866] ACPI: Early table checksum verification disabled client # [ 0.002866] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.002869] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.002867] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.002873] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002867] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.002868] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.002877] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.002868] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002885] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.003093] No NUMA configuration found worker2 # [ 0.002887] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.003094] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.002888] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.003096] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.005586] Zone ranges: worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.002890] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.005587] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.002891] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005588] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.005589] Normal empty lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.005590] Device empty worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.002893] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005590] Movable zone start for each node lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] kvm-clock: using sched offset of 499658053 cycles client # [ 0.005591] Early memory node ranges worker2 # [ 0.002894] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.005592] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.002895] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.005593] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.002896] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.000000] SMBIOS 2.8 present. client # [ 0.005594] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002896] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.005614] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.002897] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.005902] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002897] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.036099] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.036566] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.002738] Using GB pages for direct mapping lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.003136] No NUMA configuration found client # [ 0.036581] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.002898] RAMDISK: [mem 0x5e370000-0x5ffcffff] lb # [ 0.000000] kvm-clock: using sched offset of 498145849 cycles worker2 # [ 0.003137] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.036607] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.002906] ACPI: Early table checksum verification disabled worker2 # [ 0.003140] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.036610] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.002909] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.005542] Zone ranges: lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.036612] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.005543] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.002913] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000816] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.036613] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.005544] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.005545] Normal empty worker1 # [ 0.002917] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005546] Device empty lb # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.036614] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.005546] Movable zone start for each node worker1 # [ 0.002924] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000846] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.036615] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.005547] Early memory node ranges worker1 # [ 0.002926] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.002730] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.036618] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.005547] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.002741] Using GB pages for direct mapping client # [ 0.036619] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.002927] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005548] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.002878] RAMDISK: [mem 0x5e36e000-0x5ffcffff] client # [ 0.036623] TSC deadline timer available lb # [ 0.002885] ACPI: Early table checksum verification disabled client # [ 0.036627] CPU topo: Max. logical packages: 1 worker1 # [ 0.002929] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005549] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.036628] CPU topo: Max. logical dies: 1 lb # [ 0.002889] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.005573] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.036628] CPU topo: Max. dies per package: 1 worker1 # [ 0.002930] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005849] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.002892] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036632] CPU topo: Max. threads per core: 1 worker1 # [ 0.002932] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.034000] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.036633] CPU topo: Num. cores per package: 1 worker2 # [ 0.034474] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.002897] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036633] CPU topo: Num. threads per package: 1 worker1 # [ 0.002933] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.034486] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.002904] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036633] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.002934] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.002906] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.034516] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.036657] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.002935] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.034519] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.002907] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036690] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.002935] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.034521] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.002909] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036692] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.002936] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.034522] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.036693] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.002936] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.002910] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.034523] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.036695] Booting paravirtualized kernel on KVM worker1 # [ 0.002937] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.034524] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.002912] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003162] No NUMA configuration found client # [ 0.036699] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.034526] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002913] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.003163] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.034527] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.041197] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.002914] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.034531] TSC deadline timer available worker1 # [ 0.003166] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005645] Zone ranges: client # [ 0.043401] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.034535] CPU topo: Max. logical packages: 1 lb # [ 0.002915] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.005646] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.034536] CPU topo: Max. logical dies: 1 client # [ 0.043445] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.002915] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.034536] CPU topo: Max. dies per package: 1 worker1 # [ 0.005647] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.034539] CPU topo: Max. threads per core: 1 worker1 # [ 0.005649] Normal empty worker1 # [ 0.005649] Device empty lb # [ 0.002916] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.034540] CPU topo: Num. cores per package: 1 worker1 # [ 0.005650] Movable zone start for each node lb # [ 0.002916] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.034540] CPU topo: Num. threads per package: 1 worker1 # [ 0.005651] Early memory node ranges lb # [ 0.002916] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.005651] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.034541] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.003156] No NUMA configuration found worker1 # [ 0.005652] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.034559] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.043446] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test/init regInfo=/nix/store/j0bs04qrv7kdcmc859n70b50kc7sz3gd-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.003157] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.005653] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.034591] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.003160] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005583] Zone ranges: worker1 # [ 0.005677] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.043541] Unknown kernel command line parameters "regInfo=/nix/store/j0bs04qrv7kdcmc859n70b50kc7sz3gd-closure-info/registration", will be passed to user space. worker2 # [ 0.034592] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.043554] random: crng init done lb # [ 0.005584] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.005960] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.034594] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.033485] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.005585] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.034595] Booting paravirtualized kernel on KVM client # [ 0.043555] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.005586] Normal empty worker1 # [ 0.033951] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.005587] Device empty client # [ 0.045708] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.033964] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.005588] Movable zone start for each node worker2 # [ 0.034598] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.005589] Early memory node ranges client # [ 0.047072] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.033992] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.039095] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.005589] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.047107] Fallback order for Node 0: 0 worker1 # [ 0.033995] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.005590] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.041366] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.047110] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.033996] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.047111] Policy zone: DMA32 worker2 # [ 0.041411] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.005591] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.033997] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.049628] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.005611] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.033998] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.052890] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.005887] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.056249] allocated 3145728 bytes of page_ext worker1 # [ 0.033999] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.034103] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.066186] ftrace: allocating 48787 entries in 192 pages lb # [ 0.034571] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.034002] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.066188] ftrace: allocated 192 pages with 2 groups lb # [ 0.034583] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.067026] Dynamic Preempt: lazy worker1 # [ 0.034003] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.041413] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lvqq63fax2ya6fsm3d7s7hfg0rmfbnl4-nixos-system-worker2-test/init regInfo=/nix/store/6pd0cf3aa37mjz7663lg8n7pgkfbwknl-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.034007] TSC deadline timer available client # [ 0.067161] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.034611] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.034011] CPU topo: Max. logical packages: 1 client # [ 0.067162] rcu: RCU event tracing is enabled. lb # [ 0.034613] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.034011] CPU topo: Max. logical dies: 1 worker2 # [ 0.041509] Unknown kernel command line parameters "regInfo=/nix/store/6pd0cf3aa37mjz7663lg8n7pgkfbwknl-closure-info/registration", will be passed to user space. client # [ 0.067162] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.034012] CPU topo: Max. dies per package: 1 worker2 # [ 0.041522] random: crng init done lb # [ 0.034615] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.067164] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.034015] CPU topo: Max. threads per core: 1 lb # [ 0.034616] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.041522] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.034016] CPU topo: Num. cores per package: 1 client # [ 0.067164] Rude variant of Tasks RCU enabled. client # [ 0.067165] Tracing variant of Tasks RCU enabled. worker1 # [ 0.034016] CPU topo: Num. threads per package: 1 lb # [ 0.034617] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.043771] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.034016] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.034618] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.067165] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.045169] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.034620] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.034037] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.067166] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.045202] Fallback order for Node 0: 0 lb # [ 0.034621] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.034069] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.045205] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.034625] TSC deadline timer available worker2 # [ 0.045206] Policy zone: DMA32 client # [ 0.067182] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.034629] CPU topo: Max. logical packages: 1 worker1 # [ 0.034071] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.047807] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.034629] CPU topo: Max. logical dies: 1 client # [ 0.067183] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.034072] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.034630] CPU topo: Max. dies per package: 1 worker2 # [ 0.051193] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.034074] Booting paravirtualized kernel on KVM lb # [ 0.034633] CPU topo: Max. threads per core: 1 client # [ 0.067184] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.054682] allocated 3145728 bytes of page_ext lb # [ 0.034634] CPU topo: Num. cores per package: 1 worker2 # [ 0.064716] ftrace: allocating 48787 entries in 192 pages client # [ 0.071907] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.034077] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.034634] CPU topo: Num. threads per package: 1 worker2 # [ 0.064718] ftrace: allocated 192 pages with 2 groups client # [ 0.072198] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.065606] Dynamic Preempt: lazy worker1 # [ 0.038559] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.034634] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.065739] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.041044] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.072204] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.034654] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.065740] rcu: RCU event tracing is enabled. worker1 # [ 0.041087] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.034684] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.065741] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.072308] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.075872] Console: colour VGA+ 80x25 worker2 # [ 0.065742] Trampoline variant of Tasks RCU enabled. lb # [ 0.034686] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.075875] printk: legacy console [tty0] enabled worker2 # [ 0.065743] Rude variant of Tasks RCU enabled. lb # [ 0.034687] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.065743] Tracing variant of Tasks RCU enabled. client # [ 0.105514] printk: legacy console [ttyS0] enabled lb # [ 0.034688] Booting paravirtualized kernel on KVM client # [ 0.203480] ACPI: Core revision 20250807 worker2 # [ 0.065744] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.034691] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.041089] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dn8gqamk2zyr2nvpgiwfbpgwzjyrjlpw-nixos-system-worker1-test/init regInfo=/nix/store/ndzr4x0h49369zkyn79cnanic26lxrvk-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.065744] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.039177] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.204320] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.065764] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.041749] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.041189] Unknown kernel command line parameters "regInfo=/nix/store/ndzr4x0h49369zkyn79cnanic26lxrvk-closure-info/registration", will be passed to user space. client # [ 0.205839] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.041202] random: crng init done lb # [ 0.041796] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.065766] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.206795] x2apic enabled worker1 # [ 0.041203] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.065767] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.207557] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.043369] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.070567] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.044448] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.070846] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.044480] Fallback order for Node 0: 0 client # [ 0.209332] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.041798] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.070854] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.044483] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.044484] Policy zone: DMA32 worker2 # [ 0.070964] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.210301] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.047041] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.041894] Unknown kernel command line parameters "regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration", will be passed to user space. worker2 # [ 0.074517] Console: colour VGA+ 80x25 lb # [ 0.041906] random: crng init done worker1 # [ 0.050234] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.074520] printk: legacy console [tty0] enabled client # [ 0.211936] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.053904] allocated 3145728 bytes of page_ext worker2 # [ 0.104265] printk: legacy console [ttyS0] enabled lb # [ 0.041907] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.063703] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.200691] ACPI: Core revision 20250807 client # [ 0.213021] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.044151] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.063705] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.064559] Dynamic Preempt: lazy lb # [ 0.045336] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.214071] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.064678] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.201559] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.045368] Fallback order for Node 0: 0 worker1 # [ 0.064679] rcu: RCU event tracing is enabled. client # [ 0.214934] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.045371] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.203059] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.064679] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.045372] Policy zone: DMA32 worker2 # [ 0.204049] x2apic enabled worker1 # [ 0.064681] Trampoline variant of Tasks RCU enabled. lb # [ 0.047994] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.064681] Rude variant of Tasks RCU enabled. client # [ 0.215937] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.204815] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.064681] Tracing variant of Tasks RCU enabled. lb # [ 0.051318] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.055211] allocated 3145728 bytes of page_ext worker1 # [ 0.064682] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.216934] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.065240] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.064683] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.065242] ftrace: allocated 192 pages with 2 groups client # [ 0.217934] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.206636] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.066126] Dynamic Preempt: lazy worker1 # [ 0.064742] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.066309] rcu: Preemptible hierarchical RCU implementation. client # [ 0.218933] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.066310] rcu: RCU event tracing is enabled. worker2 # [ 0.207605] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.064744] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.219934] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.066311] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.066312] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.064744] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.209242] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.066313] Rude variant of Tasks RCU enabled. worker1 # [ 0.069154] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.066313] Tracing variant of Tasks RCU enabled. worker2 # [ 0.210328] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.069433] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.066314] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.211374] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.066315] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.069440] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.220933] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.212239] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.066331] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.222941] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.069540] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.073061] Console: colour VGA+ 80x25 lb # [ 0.066332] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.073064] printk: legacy console [tty0] enabled worker2 # [ 0.213243] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.223934] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.102629] printk: legacy console [ttyS0] enabled lb # [ 0.066333] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.224934] active return thunk: srso_alias_return_thunk worker1 # [ 0.198053] ACPI: Core revision 20250807 worker2 # [ 0.215239] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.070801] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.225955] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.071083] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.216239] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.198921] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.226933] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.217238] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.071089] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.200409] APIC: Switch to symmetric I/O mode setup client # [ 0.227933] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.201338] x2apic enabled worker2 # [ 0.218238] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.071201] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.074728] Console: colour VGA+ 80x25 client # [ 0.228933] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.202063] APIC: Switched APIC routing to: physical x2apic lb # [ 0.074731] printk: legacy console [tty0] enabled lb # [ 0.104204] printk: legacy console [ttyS0] enabled client # [ 0.229934] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.198905] ACPI: Core revision 20250807 worker1 # [ 0.203851] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.230934] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.219238] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.199809] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.231933] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.204821] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.221246] Spectre V2 : Enabling IBPB for BPF lb # [ 0.201296] APIC: Switch to symmetric I/O mode setup client # [ 0.232934] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.202228] x2apic enabled worker1 # [ 0.206455] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.222239] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.234643] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.202963] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.223239] active return thunk: srso_alias_return_thunk worker1 # [ 0.207538] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.235632] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.235934] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.208570] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.224259] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.204766] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.236933] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.209452] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.225238] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.226238] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.205744] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.237933] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.210456] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.227238] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.207376] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.211452] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.228238] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.208463] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.212452] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.229238] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.209544] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.213452] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.230238] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.210373] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.214452] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.232239] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.233238] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.211377] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.234238] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.213373] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.235239] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.215452] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.214374] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.236238] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.217460] Spectre V2 : Enabling IBPB for BPF lb # [ 0.215373] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.216373] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.218453] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.237238] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.219453] active return thunk: srso_alias_return_thunk worker1 # [ 0.220473] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.221452] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.217373] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.222452] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.219380] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.223452] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.220374] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.224452] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.221374] active return thunk: srso_alias_return_thunk worker1 # [ 0.225452] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.222395] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.226452] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.223373] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.227452] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.224373] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.228452] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.225373] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.229452] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.226373] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.230452] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.227373] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.231452] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.228373] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.232452] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.229373] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.231083] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.232087] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.232373] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.233373] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.234373] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.272354] Freeing SMP alternatives memory: 44K client # [ 0.272936] pid_max: default: 32768 minimum: 301 client # [ 0.274018] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.275038] landlock: Up and running. client # [ 0.275683] Yama: becoming mindful. client # [ 0.276593] LSM support for eBPF active client # [ 0.277063] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.277978] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.281206] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.272244] Freeing SMP alternatives memory: 44K client # [ 0.282550] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.273039] pid_max: default: 32768 minimum: 301 client # [ 0.282942] ... version: 2 worker2 # [ 0.273900] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.283682] ... bit width: 48 worker2 # [ 0.274336] landlock: Up and running. client # [ 0.283936] ... generic counters: 6 worker2 # [ 0.275673] Yama: becoming mindful. client # [ 0.284643] ... generic bitmap: 000000000000003f worker2 # [ 0.276450] LSM support for eBPF active client # [ 0.284936] ... fixed-purpose counters: 0 client # [ 0.285660] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.277372] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.285936] ... value mask: 0000ffffffffffff worker2 # [ 0.278283] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.286861] ... max period: 00007fffffffffff client # [ 0.287685] ... global_ctrl mask: 000000000000003f client # [ 0.288032] signal: max sigframe size: 3376 worker2 # [ 0.281136] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.288791] rcu: Hierarchical SRCU implementation. client # [ 0.289492] rcu: Max phase no-delay instances is 400. worker2 # [ 0.281817] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.282243] ... version: 2 worker2 # [ 0.282974] ... bit width: 48 worker2 # [ 0.283241] ... generic counters: 6 worker1 # [ 0.267285] Freeing SMP alternatives memory: 44K worker2 # [ 0.284009] ... generic bitmap: 000000000000003f worker1 # [ 0.267997] pid_max: default: 32768 minimum: 301 worker2 # [ 0.284253] ... fixed-purpose counters: 0 worker1 # [ 0.268536] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.285004] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.294625] smp: Bringing up secondary CPUs ... worker1 # [ 0.269554] landlock: Up and running. client # [ 0.294950] smp: Brought up 1 node, 1 CPU worker2 # [ 0.285241] ... value mask: 0000ffffffffffff worker1 # [ 0.270452] Yama: becoming mindful. client # [ 0.295589] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.286097] ... max period: 00007fffffffffff worker1 # [ 0.271239] LSM support for eBPF active worker2 # [ 0.286889] ... global_ctrl mask: 000000000000003f worker1 # [ 0.272019] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.287365] signal: max sigframe size: 3376 client # [ 0.296083] Memory: 1454600K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) lb # [ 0.268996] Freeing SMP alternatives memory: 44K worker1 # [ 0.273328] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.288191] rcu: Hierarchical SRCU implementation. client # [ 0.297185] devtmpfs: initialized lb # [ 0.269376] pid_max: default: 32768 minimum: 301 worker2 # [ 0.288837] rcu: Max phase no-delay instances is 400. client # [ 0.297896] x86/mm: Memory block size: 128MB lb # [ 0.270473] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.275612] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.271478] landlock: Up and running. lb # [ 0.272373] Yama: becoming mindful. client # [ 0.299470] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.273174] LSM support for eBPF active worker1 # [ 0.277018] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.277461] ... version: 2 client # [ 0.299960] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.273950] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.278136] ... bit width: 48 client # [ 0.301028] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.278454] ... generic counters: 6 worker2 # [ 0.293794] smp: Bringing up secondary CPUs ... lb # [ 0.274413] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.302132] PM: RTC time: 13:45:14, date: 2026-09-22 worker2 # [ 0.294254] smp: Brought up 1 node, 1 CPU worker1 # [ 0.279160] ... generic bitmap: 000000000000003f worker1 # [ 0.279454] ... fixed-purpose counters: 0 worker2 # [ 0.294956] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.280128] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.277636] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.280454] ... value mask: 0000ffffffffffff worker1 # [ 0.281327] ... max period: 00007fffffffffff worker2 # [ 0.295448] Memory: 1454600K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) client # [ 0.305773] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.278962] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.282109] ... global_ctrl mask: 000000000000003f worker2 # [ 0.296516] devtmpfs: initialized lb # [ 0.279382] ... version: 2 worker1 # [ 0.282549] signal: max sigframe size: 3376 worker2 # [ 0.297296] x86/mm: Memory block size: 128MB client # [ 0.307108] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.280105] ... bit width: 48 worker1 # [ 0.283369] rcu: Hierarchical SRCU implementation. lb # [ 0.280375] ... generic counters: 6 client # [ 0.307957] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.284009] rcu: Max phase no-delay instances is 400. lb # [ 0.281085] ... generic bitmap: 000000000000003f worker2 # [ 0.299093] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.281376] ... fixed-purpose counters: 0 client # [ 0.309226] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.282102] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.309946] audit: initializing netlink subsys (disabled) worker2 # [ 0.300145] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.282375] ... value mask: 0000ffffffffffff worker2 # [ 0.301334] pinctrl core: initialized pinctrl subsystem client # [ 0.311062] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.283258] ... max period: 00007fffffffffff worker2 # [ 0.302430] PM: RTC time: 13:45:14, date: 2026-09-22 client # [ 0.311065] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.284050] ... global_ctrl mask: 000000000000003f client # [ 0.311937] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.288999] smp: Bringing up secondary CPUs ... lb # [ 0.284472] signal: max sigframe size: 3376 worker1 # [ 0.289469] smp: Brought up 1 node, 1 CPU client # [ 0.312903] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.285299] rcu: Hierarchical SRCU implementation. worker1 # [ 0.290119] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.285997] rcu: Max phase no-delay instances is 400. client # [ 0.313651] audit: type=2000 audit(1790084715.635:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.306196] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.314939] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.314953] cpuidle: using governor menu worker1 # [ 0.290629] Memory: 1454604K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.307532] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.291697] devtmpfs: initialized client # [ 0.317131] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.292460] x86/mm: Memory block size: 128MB worker2 # [ 0.308266] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.318234] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.291146] smp: Bringing up secondary CPUs ... worker2 # [ 0.309532] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.294176] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.318939] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.291390] smp: Brought up 1 node, 1 CPU worker2 # [ 0.310251] audit: initializing netlink subsys (disabled) client # [ 0.319948] PCI: Using configuration type 1 for base access lb # [ 0.292036] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.295285] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.311409] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.296524] pinctrl core: initialized pinctrl subsystem client # [ 0.321006] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.311411] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.297647] PM: RTC time: 13:45:14, date: 2026-09-22 lb # [ 0.292514] Memory: 1454588K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) worker2 # [ 0.312242] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.293642] devtmpfs: initialized worker2 # [ 0.313137] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.294443] x86/mm: Memory block size: 128MB worker2 # [ 0.313935] audit: type=2000 audit(1790084715.650:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.315244] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.301504] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.296295] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.315258] cpuidle: using governor menu client # [ 0.326213] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.326937] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.297241] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.302964] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.317449] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.298457] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.303475] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.318481] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.299610] PM: RTC time: 13:45:14, date: 2026-09-22 worker1 # [ 0.304721] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.319244] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.305466] audit: initializing netlink subsys (disabled) worker2 # [ 0.320253] PCI: Using configuration type 1 for base access worker1 # [ 0.306574] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.327930] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.321392] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.306577] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.332936] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.303479] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.307455] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.308378] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.304873] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.309175] audit: type=2000 audit(1790084715.664:1): state=initialized audit_enabled=0 res=1 lb # [ 0.305401] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.310457] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.310480] cpuidle: using governor menu lb # [ 0.306646] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.307393] audit: initializing netlink subsys (disabled) worker1 # [ 0.312633] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.328490] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.308577] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.313685] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.308579] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.329242] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.314458] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.309377] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.315467] PCI: Using configuration type 1 for base access lb # [ 0.310326] thermal_sys: Registered thermal governor 'user_space' client # [ 0.343308] ACPI: Added _OSI(Module Device) client # [ 0.343938] ACPI: Added _OSI(Processor Device) worker1 # [ 0.316547] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.311172] audit: type=2000 audit(1790084715.673:1): state=initialized audit_enabled=0 res=1 client # [ 0.344652] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.313378] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.313404] cpuidle: using governor menu worker2 # [ 0.334242] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.335242] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.315623] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.316628] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.321720] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.317379] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.322455] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.318387] PCI: Using configuration type 1 for base access lb # [ 0.319523] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.353480] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.343938] ACPI: Added _OSI(Module Device) worker1 # [ 0.327455] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.354856] ACPI: Interpreter enabled worker2 # [ 0.344243] ACPI: Added _OSI(Processor Device) client # [ 0.355380] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.328455] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.345012] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.324494] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.357938] ACPI: Using IOAPIC for interrupt routing lb # [ 0.325376] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.358826] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.361936] PCI: Using E820 reservations for host bridge windows lb # [ 0.330377] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.363056] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.351830] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.331375] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.338847] ACPI: Added _OSI(Module Device) worker1 # [ 0.339457] ACPI: Added _OSI(Processor Device) worker1 # [ 0.340200] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.355147] ACPI: Interpreter enabled worker2 # [ 0.355709] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.356242] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.357154] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.371718] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.341723] ACPI: Added _OSI(Module Device) client # [ 0.373383] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.342377] ACPI: Added _OSI(Processor Device) worker2 # [ 0.362242] PCI: Using E820 reservations for host bridge windows client # [ 0.374060] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.343210] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.363378] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.349004] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.375058] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.350400] ACPI: Interpreter enabled client # [ 0.376314] PCI host bridge to bus 0000:00 worker1 # [ 0.350927] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.376940] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.377937] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.378936] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.353476] ACPI: Using IOAPIC for interrupt routing client # [ 0.379936] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.354515] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.380937] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.372052] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.352426] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.381936] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.357454] PCI: Using E820 reservations for host bridge windows client # [ 0.382937] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.373544] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.358547] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.383914] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.374328] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.356287] ACPI: Interpreter enabled lb # [ 0.356839] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.375363] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.385451] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.357376] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.376621] PCI host bridge to bus 0000:00 lb # [ 0.358246] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.377246] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.378241] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.379241] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.380242] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.367188] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.363376] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.381242] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.364466] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.382241] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.368226] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.388022] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.383241] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.388949] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.369534] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.384202] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.370577] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.389922] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.371801] PCI host bridge to bus 0000:00 worker2 # [ 0.385682] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.391171] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.372458] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.373454] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.392698] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.374454] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.372178] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.375455] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.373166] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.376455] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.395972] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.374452] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.396811] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.377455] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.375498] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.397758] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.378461] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.376751] PCI host bridge to bus 0000:00 client # [ 0.398736] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.388395] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.379468] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.377380] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.389332] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.378377] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.380919] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.400440] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.390306] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.379380] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.391570] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.380413] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.402971] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.381376] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.392958] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.403830] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.382376] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.404782] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.383376] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.395279] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.384377] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.406384] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.396127] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.385810] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.383556] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.397041] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.384467] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.398098] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.385438] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.409975] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.399823] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.410842] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.386667] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.411692] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.401250] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.388159] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.412516] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.402102] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.402980] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.388472] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.391494] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.414882] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.403796] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.389389] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.392358] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.415563] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.390331] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.393197] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.415958] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.391554] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.393461] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.416943] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.406249] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.395043] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.393117] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.407248] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.418507] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.408185] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.419949] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.397494] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.396417] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.409664] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.398287] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.420874] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.397265] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.399174] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.398098] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.411281] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.422345] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.412138] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.398382] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.400032] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.412999] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.399965] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.413247] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.424429] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.425735] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.414853] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.401416] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.403462] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.402276] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.404314] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.427443] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.416109] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.405156] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.403103] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.416989] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.428949] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.406020] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.404754] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.429913] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.417845] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.431344] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.408504] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.419289] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.407423] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.409388] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.420263] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.408280] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.433949] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.409119] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.410214] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.421850] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.434887] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.410461] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.410743] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.423022] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.436289] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.412005] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.424006] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.412446] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.413467] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.437975] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.425712] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.413287] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.414454] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.438839] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.414069] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.427290] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.439710] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.416004] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.414382] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.428257] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.415918] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.441336] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.429775] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.417906] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.417389] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.419251] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.444639] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.431301] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.418398] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.444943] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.432153] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.420911] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.445876] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.419931] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.433008] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.447324] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.422467] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.433785] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.423454] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.421389] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.448647] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.422399] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.425024] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.435487] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.449165] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.423981] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.436248] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.450884] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.437262] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.427122] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.425423] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.427477] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.451798] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.426398] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.438836] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.453663] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.429038] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.427919] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.439930] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.440440] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.429411] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.431310] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.441802] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.432159] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.430398] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.432476] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.442449] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.431947] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.443760] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.434456] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.433425] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.434339] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.437153] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.435179] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.437462] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.438454] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.436836] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.454157] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.440034] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.456698] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.438431] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.441195] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.439306] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.457309] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.440096] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.458228] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.441656] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.440950] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.459194] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.444467] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.444286] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.442037] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.446759] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.460965] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.445291] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.442573] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.461816] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.447523] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.447182] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.444434] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.463008] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.448528] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.445486] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.449494] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.464573] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.447039] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.451083] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.451964] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.468701] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.452556] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.469048] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.453781] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.470036] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.471037] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.472035] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.473033] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.457337] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.447698] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.474044] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.458344] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.475045] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.459342] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.450265] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.475977] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.460341] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.447639] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.451743] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.476951] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.461342] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.477951] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.449988] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.462340] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.452743] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.478920] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.463341] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.450666] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.479720] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.453743] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.464336] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.480681] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.451760] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.465275] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.480948] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.455483] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.466252] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.452639] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.481929] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.456327] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.467259] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.468251] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.454404] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.483770] iommu: Default domain type: Translated worker1 # [ 0.457513] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.469248] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.455245] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.484537] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.470192] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.485209] ACPI: bus type USB registered worker1 # [ 0.459911] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.456403] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.470998] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.485982] usbcore: registered new interface driver usbfs worker2 # [ 0.471254] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.486887] usbcore: registered new interface driver hub lb # [ 0.458030] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.487604] usbcore: registered new device driver usb worker2 # [ 0.473219] iommu: Default domain type: Translated client # [ 0.488984] NetLabel: Initializing worker1 # [ 0.463600] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.473870] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.489582] NetLabel: domain hash size = 128 worker2 # [ 0.474513] ACPI: bus type USB registered worker1 # [ 0.464558] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.489936] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.475249] usbcore: registered new interface driver usbfs lb # [ 0.461874] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.465551] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.490905] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.476139] usbcore: registered new interface driver hub lb # [ 0.462483] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.466549] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.491613] PCI: Using ACPI for IRQ routing worker2 # [ 0.476903] usbcore: registered new device driver usb lb # [ 0.463476] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.467550] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.464470] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.478153] NetLabel: Initializing worker1 # [ 0.468554] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.478655] NetLabel: domain hash size = 128 lb # [ 0.465469] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.469585] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.479241] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.466480] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.470555] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.480205] NetLabel: unlabeled traffic allowed by default lb # [ 0.467478] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.480969] PCI: Using ACPI for IRQ routing worker1 # [ 0.471488] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.468472] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.472467] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.469423] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.473470] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.470393] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.474467] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.471391] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.475402] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.472387] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.476180] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.476468] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.473359] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.474139] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.477405] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.474390] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.475388] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.480017] iommu: Default domain type: Translated worker1 # [ 0.480469] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.481819] ACPI: bus type USB registered worker1 # [ 0.482553] usbcore: registered new interface driver usbfs lb # [ 0.477685] iommu: Default domain type: Translated worker1 # [ 0.483435] usbcore: registered new interface driver hub lb # [ 0.478389] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.484250] usbcore: registered new device driver usb lb # [ 0.479669] ACPI: bus type USB registered lb # [ 0.480509] usbcore: registered new interface driver usbfs worker1 # [ 0.486103] NetLabel: Initializing lb # [ 0.481393] usbcore: registered new interface driver hub worker1 # [ 0.486456] NetLabel: domain hash size = 128 lb # [ 0.482282] usbcore: registered new device driver usb worker1 # [ 0.487217] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.487509] NetLabel: unlabeled traffic allowed by default lb # [ 0.484045] NetLabel: Initializing worker1 # [ 0.488419] PCI: Using ACPI for IRQ routing lb # [ 0.484377] NetLabel: domain hash size = 128 lb # [ 0.485132] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.485436] NetLabel: unlabeled traffic allowed by default lb # [ 0.486387] PCI: Using ACPI for IRQ routing client # [ 0.535978] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.536932] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.536932] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.536940] vgaarb: loaded client # [ 0.537691] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.537938] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.543026] clocksource: Switched to clocksource kvm-clock client # [ 0.544710] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.531924] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.532237] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.547267] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.532237] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.548644] pnp: PnP ACPI init worker2 # [ 0.532255] vgaarb: loaded client # [ 0.549484] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.533036] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.533864] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.550445] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.552033] pnp: PnP ACPI: found 5 devices worker2 # [ 0.538341] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.531872] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.532451] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.540235] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.532451] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.530577] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.532460] vgaarb: loaded lb # [ 0.531372] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.559677] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.533261] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.542860] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.531372] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.561107] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.534034] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.544189] pnp: PnP ACPI init lb # [ 0.531380] vgaarb: loaded client # [ 0.562020] NET: Registered PF_INET protocol family worker2 # [ 0.545020] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.532119] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.532378] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.563335] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.546005] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.547553] pnp: PnP ACPI: found 5 devices worker1 # [ 0.537562] clocksource: Switched to clocksource kvm-clock lb # [ 0.536465] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.541382] VFS: Disk quotas dquot_6.6.0 lb # [ 0.538272] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.542101] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.543574] pnp: PnP ACPI init worker1 # [ 0.544438] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.540863] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.542243] pnp: PnP ACPI init worker2 # [ 0.555211] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.545406] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.556685] clocksource: Switched to clocksource acpi_pm lb # [ 0.543069] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.546936] pnp: PnP ACPI: found 5 devices worker2 # [ 0.557739] NET: Registered PF_INET protocol family lb # [ 0.544047] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.545629] pnp: PnP ACPI: found 5 devices worker2 # [ 0.558975] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.581606] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.554707] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.556224] clocksource: Switched to clocksource acpi_pm client # [ 0.583545] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.557246] NET: Registered PF_INET protocol family lb # [ 0.553232] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.584931] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.554699] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.558414] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.586276] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.555648] NET: Registered PF_INET protocol family client # [ 0.587500] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.556787] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.588722] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.590075] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.591244] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.592550] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.593597] NET: Registered PF_XDP protocol family worker2 # [ 0.575944] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.594564] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.577542] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.595611] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.578863] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.596678] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.597820] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.580264] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.581536] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.598913] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.600090] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.582674] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.583962] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.601965] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.585092] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.586372] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.576193] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.587348] NET: Registered PF_XDP protocol family client # [ 0.604856] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.573964] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.588165] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.577647] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.606836] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.589165] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.578924] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.575503] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.590150] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.576803] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.580241] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.608780] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.591242] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.581460] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.578132] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.592310] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.610494] PCI: CLS 0 bytes, default 64 worker1 # [ 0.582587] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.579433] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.593408] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.583822] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.580512] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.611430] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.595083] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.584881] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.581739] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.613184] Trying to unpack rootfs image as initramfs... worker1 # [ 0.586092] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.582832] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.587076] NET: Registered PF_XDP protocol family worker2 # [ 0.597823] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.584078] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.587942] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.585025] NET: Registered PF_XDP protocol family worker1 # [ 0.588963] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.599839] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.585909] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.590006] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.586906] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.591129] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.601839] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.587948] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.592232] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.589044] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.603622] PCI: CLS 0 bytes, default 64 worker1 # [ 0.593311] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.590189] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.604521] Trying to unpack rootfs image as initramfs... lb # [ 0.591327] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.595129] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.593153] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.598605] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.595880] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.600617] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.610707] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.597879] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.602571] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.600069] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.604289] PCI: CLS 0 bytes, default 64 lb # [ 0.601841] PCI: CLS 0 bytes, default 64 worker1 # [ 0.605198] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.602707] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.606873] Trying to unpack rootfs image as initramfs... lb # [ 0.604446] Trying to unpack rootfs image as initramfs... client # [ 0.658260] Initialise system trusted keyrings client # [ 0.660809] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.652588] Initialise system trusted keyrings worker2 # [ 0.655563] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.652482] Initialise system trusted keyrings lb # [ 0.649274] Initialise system trusted keyrings worker1 # [ 0.655085] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.652359] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.683835] Key type asymmetric registered client # [ 0.684645] Asymmetric key parser 'x509' registered client # [ 0.685628] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.688886] io scheduler mq-deadline registered client # [ 0.689700] io scheduler kyber registered client # [ 0.693769] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.677505] Key type asymmetric registered client # [ 0.695131] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.678229] Asymmetric key parser 'x509' registered worker2 # [ 0.679143] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.701433] Linux agpgart interface v0.103 worker2 # [ 0.684613] io scheduler mq-deadline registered client # [ 0.702281] ACPI: bus type drm_connector registered worker2 # [ 0.685377] io scheduler kyber registered lb # [ 0.673612] Key type asymmetric registered worker1 # [ 0.677216] Key type asymmetric registered client # [ 0.705335] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.677935] Asymmetric key parser 'x509' registered worker2 # [ 0.689003] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.706484] usbserial: USB Serial support registered for generic worker1 # [ 0.678820] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.676323] Asymmetric key parser 'x509' registered worker2 # [ 0.690283] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.677211] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.709770] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.709770] Please enable it if your BIOS has the CPPC option. lb # [ 0.680411] io scheduler mq-deadline registered worker1 # [ 0.684187] io scheduler mq-deadline registered lb # [ 0.681201] io scheduler kyber registered client # [ 0.712152] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.684943] io scheduler kyber registered worker2 # [ 0.695468] Linux agpgart interface v0.103 worker2 # [ 0.696211] ACPI: bus type drm_connector registered lb # [ 0.683852] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.715935] drop_monitor: Initializing network drop monitor service worker2 # [ 0.698552] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.688644] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.685202] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.717091] NET: Registered PF_INET6 protocol family worker2 # [ 0.699621] usbserial: USB Serial support registered for generic worker1 # [ 0.689874] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.720287] Segment Routing with IPv6 worker2 # [ 0.702426] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.702426] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.693809] Linux agpgart interface v0.103 lb # [ 0.691264] Linux agpgart interface v0.103 worker1 # [ 0.694638] ACPI: bus type drm_connector registered worker2 # [ 0.704734] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.722780] In-situ OAM (IOAM) with IPv6 lb # [ 0.692047] ACPI: bus type drm_connector registered client # [ 0.723901] IPI shorthand broadcast: enabled worker1 # [ 0.697509] usbcore: registered new interface driver usbserial_generic lb # [ 0.694813] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.698645] usbserial: USB Serial support registered for generic lb # [ 0.695932] usbserial: USB Serial support registered for generic worker2 # [ 0.710553] drop_monitor: Initializing network drop monitor service worker2 # [ 0.711775] NET: Registered PF_INET6 protocol family worker1 # [ 0.702047] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.702047] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.714887] Segment Routing with IPv6 lb # [ 0.700320] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.704370] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.700320] Please enable it if your BIOS has the CPPC option. client # [ 0.732499] sched_clock: Marking stable (596015694, 135728731)->(805650051, -73905626) lb # [ 0.702528] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.717444] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.707166] drop_monitor: Initializing network drop monitor service worker2 # [ 0.718509] IPI shorthand broadcast: enabled worker1 # [ 0.708359] NET: Registered PF_INET6 protocol family lb # [ 0.705467] drop_monitor: Initializing network drop monitor service lb # [ 0.706650] NET: Registered PF_INET6 protocol family client # [ 0.737977] registered taskstats version 1 client # [ 0.738958] Loading compiled-in X.509 certificates lb # [ 0.709736] Segment Routing with IPv6 worker1 # [ 0.713336] Segment Routing with IPv6 worker1 # [ 0.713966] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.715111] IPI shorthand broadcast: enabled lb # [ 0.712346] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.726553] sched_clock: Marking stable (592014788, 134384038)->(804945895, -78547069) lb # [ 0.713486] IPI shorthand broadcast: enabled worker2 # [ 0.730651] registered taskstats version 1 worker2 # [ 0.731622] Loading compiled-in X.509 certificates worker1 # [ 0.723542] sched_clock: Marking stable (590016854, 133011725)->(794038359, -71009780) lb # [ 0.721823] sched_clock: Marking stable (589015973, 132283219)->(790966895, -69667703) worker1 # [ 0.728142] registered taskstats version 1 worker1 # [ 0.729182] Loading compiled-in X.509 certificates client # [ 0.757751] Demotion targets for Node 0: null lb # [ 0.727486] registered taskstats version 1 client # [ 0.758702] Key type .fscrypt registered lb # [ 0.728463] Loading compiled-in X.509 certificates client # [ 0.760756] Key type fscrypt-provisioning registered client # [ 0.761712] ima: No TPM chip found, activating TPM-bypass! client # [ 0.762691] ima: Allocated hash algorithm: sha1 client # [ 0.766798] ima: No architecture policies found client # [ 0.767840] PM: Magic number: 10:287:787 worker2 # [ 0.750417] Demotion targets for Node 0: null worker2 # [ 0.751279] Key type .fscrypt registered client # [ 0.769625] RAS: Correctable Errors collector initialized. worker2 # [ 0.754403] Key type fscrypt-provisioning registered worker2 # [ 0.755351] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.756308] ima: Allocated hash algorithm: sha1 worker1 # [ 0.748041] Demotion targets for Node 0: null worker2 # [ 0.758434] ima: No architecture policies found lb # [ 0.744982] Demotion targets for Node 0: null worker1 # [ 0.748931] Key type .fscrypt registered worker2 # [ 0.759351] PM: Magic number: 10:287:787 client # [ 0.778466] clk: Disabling unused clocks lb # [ 0.748343] Key type .fscrypt registered worker1 # [ 0.752032] Key type fscrypt-provisioning registered lb # [ 0.749055] Key type fscrypt-provisioning registered worker2 # [ 0.763033] RAS: Correctable Errors collector initialized. worker1 # [ 0.752992] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.750023] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.753936] ima: Allocated hash algorithm: sha1 client # [ 0.781780] PM: genpd: Disabling unused power domains worker1 # [ 0.754769] ima: No architecture policies found lb # [ 0.752310] ima: Allocated hash algorithm: sha1 lb # [ 0.753143] ima: No architecture policies found worker1 # [ 0.757038] PM: Magic number: 10:287:787 worker1 # [ 0.758680] RAS: Correctable Errors collector initialized. worker2 # [ 0.770652] clk: Disabling unused clocks lb # [ 0.757319] PM: Magic number: 10:287:787 worker2 # [ 0.771361] PM: genpd: Disabling unused power domains lb # [ 0.759009] RAS: Correctable Errors collector initialized. worker1 # [ 0.767696] clk: Disabling unused clocks worker1 # [ 0.771044] PM: genpd: Disabling unused power domains lb # [ 0.767972] clk: Disabling unused clocks lb # [ 0.770323] PM: genpd: Disabling unused power domains worker2 # [ 0.936435] Freeing initrd memory: 29060K client # [ 0.954587] Freeing initrd memory: 29056K worker2 # [ 0.939736] Freeing unused decrypted memory: 2028K client # [ 0.958217] Freeing unused decrypted memory: 2028K worker2 # [ 0.943233] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.961292] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.962398] Write protecting the kernel read-only data: 32768k worker2 # [ 0.944783] Write protecting the kernel read-only data: 32768k client # [ 0.964473] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.947371] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.966062] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.949364] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.942585] Freeing initrd memory: 29056K worker1 # [ 0.945798] Freeing unused decrypted memory: 2028K worker1 # [ 0.948536] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.949660] Write protecting the kernel read-only data: 32768k worker1 # [ 0.951574] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.953149] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.971437] Freeing initrd memory: 29064K lb # [ 0.975658] Freeing unused decrypted memory: 2028K lb # [ 0.979200] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.981388] Write protecting the kernel read-only data: 32768k lb # [ 0.983871] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.985462] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 1.017056] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 1.018181] Run /init as init process worker2 # [ 1.005997] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.007065] Run /init as init process client # [ 1.029959] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.003769] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.004871] Run /init as init process worker2 # [ 1.019493] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.015655] systemd[1]: Inserted module 'autofs4' client # [ 1.050074] fuse: init (API version 7.45) worker2 # [ 1.039885] fuse: init (API version 7.45) client # [ 1.057648] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.060354] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.035426] fuse: init (API version 7.45) client # [ 1.063973] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.047516] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.066203] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.050176] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.036214] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.037346] Run /init as init process worker1 # [ 1.042732] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.053524] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.072350] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.045198] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.055853] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.073998] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.048223] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.050223] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.062186] virtiofs virtio5: discovered new tag: nix-store client # [ 1.081483] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.064154] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.051643] systemd[1]: Inserted module 'autofs4' client # [ 1.083011] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.055565] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.057128] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.086363] virtiofs virtio7: discovered new tag: xchg client # [ 1.087842] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.072375] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.074573] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.066040] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.067720] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.078837] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.081058] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.071608] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.073292] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.074355] fuse: init (API version 7.45) client # [ 1.109657] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.081976] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.084409] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.087456] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.102535] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.089787] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.095846] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.095085] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.096722] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.103757] virtiofs virtio6: discovered new tag: shared lb # [ 1.105538] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.109574] virtiofs virtio7: discovered new tag: xchg lb # [ 1.111062] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.132276] systemd[1]: Successfully made /usr/ read-only. client # [ 1.445278] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.450433] systemd[1]: Detected virtualization kvm. client # [ 1.451327] systemd[1]: Detected architecture x86-64. client # [ 1.452237] systemd[1]: Running in initrd. client # [ 1.453323] systemd[1]: Initializing machine ID from random generator. client # [ 1.454588] systemd[1]: Hostname set to . worker2 # [ 1.438061] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.431485] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.449085] systemd[1]: Detected virtualization kvm. worker1 # [ 1.440325] systemd[1]: Detected virtualization kvm. worker2 # [ 1.451564] systemd[1]: Detected architecture x86-64. worker1 # [ 1.442791] systemd[1]: Detected architecture x86-64. worker2 # [ 1.454005] systemd[1]: Running in initrd. worker1 # [ 1.445247] systemd[1]: Running in initrd. worker2 # [ 1.456759] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.447841] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.459719] systemd[1]: Hostname set to . worker1 # [ 1.451364] systemd[1]: Hostname set to . lb # [ 1.468949] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.481273] systemd[1]: Detected virtualization kvm. lb # [ 1.483548] systemd[1]: Detected architecture x86-64. lb # [ 1.485790] systemd[1]: Running in initrd. lb # [ 1.488433] systemd[1]: Initializing machine ID from random generator. lb # [ 1.491500] systemd[1]: Hostname set to . client # [ 1.656989] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.672108] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.675077] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.709007] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.713049] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.714297] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.715759] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.716874] systemd[1]: Reached target Path Units. client # [ 1.717774] systemd[1]: Reached target Slice Units. client # [ 1.718637] systemd[1]: Reached target Swaps. client # [ 1.719464] systemd[1]: Reached target Timer Units. client # [ 1.720451] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.721680] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.722907] systemd[1]: Listening on Journal Sockets. client # [ 1.723911] systemd[1]: Listening on udev Control Socket. client # [ 1.725006] systemd[1]: Listening on udev Kernel Socket. client # [ 1.725988] systemd[1]: Reached target Socket Units. client # [ 1.727772] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.712018] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.731553] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.715816] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.717003] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.718492] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.719611] systemd[1]: Reached target Path Units. worker2 # [ 1.720477] systemd[1]: Reached target Slice Units. worker2 # [ 1.721328] systemd[1]: Reached target Swaps. worker2 # [ 1.722131] systemd[1]: Reached target Timer Units. worker2 # [ 1.723120] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.724340] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.725523] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.726478] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.727504] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.728413] systemd[1]: Reached target Socket Units. worker2 # [ 1.730242] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.717652] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.739388] systemd[1]: Starting Journal Service... worker1 # [ 1.723339] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.734481] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.727363] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.728712] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.730294] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.731553] systemd[1]: Reached target Path Units. worker1 # [ 1.732553] systemd[1]: Reached target Slice Units. worker1 # [ 1.733531] systemd[1]: Reached target Swaps. worker1 # [ 1.734396] systemd[1]: Reached target Timer Units. worker1 # [ 1.735462] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.736818] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.765939] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.738149] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.739265] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.740354] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.741421] systemd[1]: Reached target Socket Units. client # [ 1.769837] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.743321] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.744489] systemd[1]: Starting Journal Service... worker1 # [ 1.748095] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.776812] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.788273] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.772620] systemd[1]: Starting Load Kernel Modules... client # [ 1.792113] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.776514] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.796045] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.758162] systemd[1]: Starting Journal Service... lb # [ 1.772495] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.786645] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.805035] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.776702] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.777928] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.809180] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.779378] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.783216] systemd[1]: Starting Load Kernel Modules... lb # [ 1.780508] systemd[1]: Reached target Path Units. lb # [ 1.781414] systemd[1]: Reached target Slice Units. lb # [ 1.782326] systemd[1]: Reached target Swaps. lb # [ 1.783139] systemd[1]: Reached target Timer Units. worker2 # [ 1.797507] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.784162] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.787121] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.785424] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.800042] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.786610] systemd[1]: Listening on Journal Sockets. lb # [ 1.787591] systemd[1]: Listening on udev Control Socket. lb # [ 1.788651] systemd[1]: Listening on udev Kernel Socket. client # [ 1.819510] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.789600] systemd[1]: Reached target Socket Units. lb # [ 1.791663] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.806144] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.796264] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.797407] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.813862] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.805635] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.832869] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.809411] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.819884] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.840983] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.816659] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.806543] systemd[1]: Starting Journal Service... worker2 # [ 1.832652] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.824442] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.840739] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.830461] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.831950] systemd[1]: Starting Load Kernel Modules... client # [ 1.863309] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.836488] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.851655] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.842097] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.874094] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.846545] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.851307] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.883264] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.863059] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.861709] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.863072] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.894851] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.869391] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.884580] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.904036] systemd[1]: Started Journal Service. client # [ 1.765792] systemd-modules-load[68]: Inserted module 'dm_mod' client # [ 1.770953] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 1.875381] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.771959] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.893692] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.884613] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.881707] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.903975] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.895243] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.892500] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.790084] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.791072] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.791993] systemd[1]: Reached target Local File Systems. worker2 # [ 1.913114] systemd[1]: Starting Apply Kernel Variables... client # [ 1.796097] systemd[1]: Starting Create System Files and Directories... lb # [ 1.902134] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.801105] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.909169] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.782856] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.786969] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.789292] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.924828] systemd[1]: Started Journal Service. client # [ 1.807645] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.913496] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.918229] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.805966] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.798191] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.932415] systemd[1]: Started Journal Service. worker1 # worker1 # [ 1.800468] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.810148] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.801737] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.828286] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.812948] systemd[1]: Reached target Local File Systems. lb # [ 1.935915] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.817103] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.810067] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.824704] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.945505] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.816087] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.819073] systemd[1]: Reached target Local File Systems. worker2 # [ 1.830235] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.821248] systemd[1]: Starting Create System Files and Directories... lb # [ 1.957373] systemd[1]: Finished Load Kernel Modules. client # [ 1.854323] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 1.830650] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.831967] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.966510] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.853085] systemd[1]: Finished Create System Files and Directories. client # [ 1.875914] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.982447] systemd[1]: Started Journal Service. worker1 # [ 1.856897] systemd[1]: Finished Create System Files and Directories. lb # [ 1.854307] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.856348] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.859275] systemd-modules-load[67]: Inserted module 'virtio_gpu' lb # [ 1.860376] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.877838] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.869080] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.871982] systemd[1]: Reached target Local File Systems. lb # [ 1.875142] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.878952] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.880262] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.886163] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.902439] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.926426] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.902441] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.927807] systemd[1]: Reached target System Initialization. client # [ 1.928695] systemd[1]: Reached target Basic System. lb # [ 1.912767] systemd[1]: Finished Create System Files and Directories. lb # [ 1.935072] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.953101] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.953915] systemd[1]: Reached target System Initialization. worker2 # [ 1.955168] systemd[1]: Reached target Basic System. worker1 # [ 1.956092] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.958626] systemd[1]: Reached target System Initialization. worker1 # [ 1.959564] systemd[1]: Reached target Basic System. lb # [ 1.958337] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.013146] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.015123] systemd[1]: Reached target System Initialization. lb # [ 2.017479] systemd[1]: Reached target Basic System. client # [ 2.244364] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.257424] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.260498] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.261246] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.266962] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.284472] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.285393] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.287343] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.273848] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.297782] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.269762] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.298647] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.271522] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.300149] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.302060] usb usb1: Product: EHCI Host Controller worker2 # [ 2.284751] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.302712] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.286333] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.304362] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.289407] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.307361] hub 1-0:1.0: USB hub found client # [ 2.308380] hub 1-0:1.0: 6 ports detected worker1 # [ 2.281618] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.296209] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.286730] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.300906] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.301661] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.302880] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.293453] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.322945] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.323660] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.309416] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.310265] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.312760] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.331781] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.315102] usb usb1: Product: EHCI Host Controller client # [ 2.332559] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.316304] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.306411] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.317411] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.307271] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.319452] hub 1-0:1.0: USB hub found worker1 # [ 2.309179] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.320680] hub 1-0:1.0: 6 ports detected worker1 # [ 2.316303] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.328360] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.345708] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.318963] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.321685] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.325102] usb usb1: Product: EHCI Host Controller worker1 # [ 2.325904] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.326964] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.355416] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.330196] hub 1-0:1.0: USB hub found worker1 # [ 2.330846] hub 1-0:1.0: 6 ports detected client # [ 2.362208] usb usb2: Product: UHCI Host Controller worker2 # [ 2.344519] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.362934] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.363638] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.230289] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.340955] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.341821] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.342029] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.356241] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.343556] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.357798] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.240793] (udev-worker)[86]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.350648] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.384944] hub 2-0:1.0: USB hub found lb # [ 2.355638] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.356343] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.388101] hub 2-0:1.0: 2 ports detected worker2 # [ 2.370485] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.360822] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.371631] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.362714] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.257448] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.362708] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.363610] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.259454] systemd[1]: Starting Virtual Console Setup... lb # [ 2.366530] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.400548] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.375362] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.373320] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.376681] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.374673] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.375815] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.389884] usb usb2: Product: UHCI Host Controller lb # [ 2.377985] usb usb1: Product: EHCI Host Controller worker1 # [ 2.248080] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.380304] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.381055] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.260627] systemd[1]: Starting Virtual Console Setup... client # [ 2.412973] SCSI subsystem initialized lb # [ 2.382558] hub 1-0:1.0: USB hub found worker2 # [ 2.396511] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.397264] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.384330] hub 1-0:1.0: 6 ports detected client # [ 2.416780] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.417481] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.258064] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.267048] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.405779] SCSI subsystem initialized lb # [ 2.391962] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.290514] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.265781] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.268075] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.293937] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.279181] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.281489] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.406096] usb usb2: Product: UHCI Host Controller worker1 # [ 2.406875] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.418050] hub 2-0:1.0: USB hub found worker1 # [ 2.407764] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.405351] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.301144] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.419603] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.409864] SCSI subsystem initialized client # [ 2.302368] systemd[1]: Reached target Initrd Root Device. client # [ 2.438872] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.439686] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.306299] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.425509] hub 2-0:1.0: 2 ports detected lb # [ 2.416317] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.417122] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.455552] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.426202] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.300366] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.303626] systemd[1]: Finished Virtual Console Setup. client # [ 2.464198] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.465570] usb usb3: Product: UHCI Host Controller client # [ 2.467778] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.468558] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.437357] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.471403] hub 3-0:1.0: USB hub found client # [ 2.473803] hub 3-0:1.0: 2 ports detected worker1 # [ 2.446572] hub 2-0:1.0: USB hub found worker2 # [ 2.321981] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.458860] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.459643] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.447616] usb usb2: Product: UHCI Host Controller worker1 # [ 2.450966] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.327814] systemd[1]: Finished Virtual Console Setup. client # [ 2.481048] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.318931] systemd[1]: Starting Virtual Console Setup... client # [ 2.482844] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.456278] hub 2-0:1.0: 2 ports detected client # [ 2.348875] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.455349] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.336715] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.329073] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.330139] systemd[1]: Reached target Initrd Root Device. client # [ 2.355881] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.327265] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.340726] systemd[1]: Reached target Initrd Root Device. client # [ 2.493363] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.462472] SCSI subsystem initialized worker1 # [ 2.332718] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.494989] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.343068] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.478594] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.479367] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.497149] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.333901] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.499795] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.483610] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.501796] usb usb4: Product: UHCI Host Controller lb # [ 2.470986] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.502563] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.474860] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.475747] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.504788] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.488520] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.507315] hub 4-0:1.0: USB hub found lb # [ 2.343688] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.508796] hub 4-0:1.0: 2 ports detected worker2 # [ 2.495423] usb usb3: Product: UHCI Host Controller worker2 # [ 2.496118] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.485886] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.487183] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.501137] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.491297] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.502837] hub 3-0:1.0: USB hub found lb # [ 2.489435] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.503792] hub 3-0:1.0: 2 ports detected worker1 # [ 2.494058] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.496051] usb usb3: Product: UHCI Host Controller worker1 # [ 2.496898] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.362530] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.510137] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.364257] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.500051] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.503452] hub 3-0:1.0: USB hub found worker2 # [ 2.514185] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.504567] hub 3-0:1.0: 2 ports detected lb # [ 2.501215] hub 2-0:1.0: USB hub found lb # [ 2.502181] hub 2-0:1.0: 2 ports detected worker2 # [ 2.515908] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.518618] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.385620] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.522604] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.380377] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.514651] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.515558] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.544782] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.394530] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.530022] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.531619] usb usb4: Product: UHCI Host Controller worker2 # [ 2.532318] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.389363] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.523686] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.551209] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.552322] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.521581] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.522362] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.553809] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.527392] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.538031] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.539494] hub 4-0:1.0: USB hub found lb # [ 2.393398] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.557713] scsi host0: ahci worker2 # [ 2.541450] hub 4-0:1.0: 2 ports detected client # [ 2.559211] scsi host1: ahci lb # [ 2.396880] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.532134] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.561001] scsi host2: ahci lb # [ 2.397939] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.562759] scsi host3: ahci lb # [ 2.532330] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.535292] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.564430] scsi host4: ahci lb # [ 2.533150] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.566134] scsi host5: ahci worker1 # [ 2.538171] usb usb4: Product: UHCI Host Controller worker1 # [ 2.538993] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.566700] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.568857] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.538579] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.570058] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.571201] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.572345] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.545349] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.573474] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.546859] hub 4-0:1.0: USB hub found lb # [ 2.544328] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.548171] hub 4-0:1.0: 2 ports detected worker2 # [ 2.558418] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.546323] usb usb3: Product: UHCI Host Controller lb # [ 2.547017] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.553322] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.568300] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.555648] hub 3-0:1.0: USB hub found worker1 # [ 2.559497] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.557352] hub 3-0:1.0: 2 ports detected worker1 # [ 2.560798] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.576324] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.562847] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.577799] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.565489] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.571045] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.569565] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.585201] scsi host0: ahci lb # [ 2.439344] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.587054] scsi host1: ahci worker1 # [ 2.576778] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.573491] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.588991] scsi host2: ahci worker2 # [ 2.590664] scsi host3: ahci worker2 # [ 2.592244] scsi host4: ahci lb # [ 2.446462] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.593897] scsi host5: ahci worker1 # [ 2.583562] scsi host0: ahci lb # [ 2.580433] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.581581] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.595240] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.585817] scsi host1: ahci worker2 # [ 2.596346] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.587855] scsi host2: ahci worker2 # [ 2.597763] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.598985] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.589749] scsi host3: ahci worker2 # [ 2.600153] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.587102] usb usb4: Product: UHCI Host Controller worker1 # [ 2.591326] scsi host4: ahci worker2 # [ 2.601337] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.588047] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.592983] scsi host5: ahci lb # [ 2.590343] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.594121] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.591766] hub 4-0:1.0: USB hub found worker1 # [ 2.596161] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.594406] hub 4-0:1.0: 2 ports detected worker1 # [ 2.597384] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.598749] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.600171] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.601525] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.606678] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.618838] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.620318] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.623513] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.633697] scsi host0: ahci lb # [ 2.635572] scsi host1: ahci lb # [ 2.638954] scsi host2: ahci lb # [ 2.640914] scsi host3: ahci lb # [ 2.642633] scsi host4: ahci lb # [ 2.644423] scsi host5: ahci lb # [ 2.645019] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.674837] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.647105] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.677761] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.648237] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.649433] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.681180] usb 1-1: Product: QEMU USB Tablet lb # [ 2.650570] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.651759] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.682969] usb 1-1: Manufacturer: QEMU client # [ 2.684582] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.690535] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.693741] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.714195] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.697126] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.699179] usb 1-1: Manufacturer: QEMU worker2 # [ 2.701332] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.701209] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.704389] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.708062] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.710134] usb 1-1: Manufacturer: QEMU worker1 # [ 2.711960] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.729166] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.742546] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.751330] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.650787] systemd[1]: Mounting /sysroot... lb # [ 2.754132] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.757517] usb 1-1: Product: QEMU USB Tablet lb # [ 2.759267] usb 1-1: Manufacturer: QEMU lb # [ 2.760939] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.659354] systemd[1]: Mounting /sysroot... lb # [ 2.791514] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.675923] systemd[1]: Mounting /sysroot... lb # [ 2.724099] systemd[1]: Mounting /sysroot... client # [ 2.887874] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.890202] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.892929] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.895175] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.897647] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.900020] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.902333] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.904556] ata3.00: applying bridge limits client # [ 2.906416] ata3.00: configured for UDMA/100 client # [ 2.908879] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.910003] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.917602] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.919731] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.922206] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.913826] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.924297] ata3.00: applying bridge limits worker1 # [ 2.914810] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.915817] ata3.00: applying bridge limits worker1 # [ 2.916544] ata3.00: configured for UDMA/100 worker2 # [ 2.926235] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.917313] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.918199] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.919027] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.928552] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.919932] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.920821] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.930834] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.922043] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.933043] ata3.00: configured for UDMA/100 worker2 # [ 2.935636] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.986327] usbcore: registered new interface driver usbhid client # [ 2.993867] usbhid: USB HID core driver lb # [ 2.965455] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.967717] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.970343] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.972569] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 3.005886] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.974807] ata3.00: applying bridge limits worker1 # [ 2.980520] usbcore: registered new interface driver usbhid worker1 # [ 2.981304] usbhid: USB HID core driver lb # [ 2.976767] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.979042] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.981400] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.983595] ata3.00: configured for UDMA/100 client # [ 3.016002] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.986079] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 3.019060] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 3.023348] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 3.012519] usbcore: registered new interface driver usbhid worker2 # [ 3.013263] usbhid: USB HID core driver worker1 # [ 3.009526] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 3.011290] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 3.039819] EXT4-fs (vda): mounted filesystem 95830c48-09f8-4980-a821-1a3c2658b02c r/w with ordered data mode. Quota mode: none. worker1 # [ 3.016619] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.911107] systemd[1]: Mounted /sysroot. client # [ 2.914894] systemd[1]: Reached target Initrd Root File System. client # [ 2.916054] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.036537] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 3.028189] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 3.031294] EXT4-fs (vda): mounted filesystem 7129ed64-7510-46d7-bff0-0b537e13403b r/w with ordered data mode. Quota mode: none. worker2 # [ 3.041650] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.043449] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.903829] systemd[1]: Mounted /sysroot. worker1 # [ 2.906062] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.051683] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.933327] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.909091] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.937477] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.938948] systemd[1]: Reloading... worker2 # [ 3.064611] EXT4-fs (vda): mounted filesystem 2679bd0b-f316-4cc7-b526-db7c0c2f47d4 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.921941] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.927066] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.928515] systemd[1]: Reloading... worker2 # [ 2.937750] systemd[1]: Mounted /sysroot. worker2 # [ 2.939059] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.943068] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.064420] usbcore: registered new interface driver usbhid lb # [ 3.065174] usbhid: USB HID core driver worker2 # [ 2.957075] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.960183] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.962745] systemd[1]: Reloading... lb # [ 3.091798] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.094695] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 3.099498] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 3.110487] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.113778] EXT4-fs (vda): mounted filesystem 86e65e3a-d71a-476b-99c1-afe1eaa27d79 r/w with ordered data mode. Quota mode: none. lb # [ 2.987243] systemd[1]: Mounted /sysroot. lb # [ 2.989918] systemd[1]: Reached target Initrd Root File System. client # [ 3.018454] systemd[1]: Reloading finished in 78 ms. lb # [ 2.995561] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.028055] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... lb # [ 3.000749] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.004798] systemd[1]: Mounting /sysroot/run... client # [ 3.032248] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 3.010402] systemd[1]: Reloading finished in 83 ms. client # [ 3.035824] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.037244] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.038252] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.011145] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.018144] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.022230] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 3.025169] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.026500] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.028131] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.028148] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.045611] systemd[1]: Reloading finished in 83 ms. lb # [ 3.039071] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.054642] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.058931] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker2 # [ 3.062617] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.064177] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.066186] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.065781] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.073725] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.074624] systemd[1]: Mounted /sysroot/run. lb # [ 3.075482] systemd-sysroot-fstab-check[145]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.080269] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.081324] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.090359] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.092352] systemd[1]: Reload requested from client PID 145 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.093867] systemd[1]: Reloading... lb # [ 3.163840] systemd[1]: Reloading finished in 69 ms. lb # [ 3.173391] systemd-sysroot-fstab-check[145]: Requesting initrd-fs.target/start/replace... lb # [ 3.175630] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.177062] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.179415] systemd-sysroot-fstab-check[145]: Requesting swap.target/start/replace... lb # [ 3.181875] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.183282] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.185218] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.188049] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.199868] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.200983] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.651940] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.654824] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.660135] systemd[1]: Mounting /sysroot/run... client # [ 3.665693] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.668137] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.661128] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.664078] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.667621] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.673310] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.680181] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.697078] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.700042] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.702332] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.677187] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.704100] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.705086] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.708940] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.683170] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.691312] systemd[1]: Mounting /sysroot/run... client # [ 3.719064] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.721111] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.722866] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.699303] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.711391] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.715096] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.717258] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.718131] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.719057] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.712634] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.723153] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.744851] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.746043] systemd[1]: Reached target Initrd File Systems. client # [ 3.747709] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.734511] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.750509] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.735937] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.724219] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.738332] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.769204] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.760081] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.776515] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.761229] systemd[1]: Reached target Initrd File Systems. client # [ 3.778189] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.762812] systemd[1]: Starting Find NixOS closure... client # [ 3.779377] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.756532] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.765387] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.758662] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.759623] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.761135] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.761847] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.765463] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.792818] systemd[1]: Stopped target Initrd Default Target. client # [ 3.795256] systemd[1]: Stopped target Basic System. client # [ 3.795953] systemd[1]: Stopped target Initrd Root Device. client # [ 3.796747] systemd[1]: Stopped target Path Units. client # [ 3.797472] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.798503] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.799534] systemd[1]: Stopped target Slice Units. worker1 # [ 3.774764] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.800251] systemd[1]: Stopped target Socket Units. worker2 # [ 3.784406] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.800929] systemd[1]: Stopped target System Initialization. worker1 # [ 3.776394] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.801744] systemd[1]: Stopped target Swaps. client # [ 3.802496] systemd[1]: Stopped target Timer Units. lb # [ 3.774633] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.804058] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.776973] systemd[1]: Reached target Initrd File Systems. client # [ 3.804872] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.778046] systemd[1]: Starting Find NixOS closure... client # [ 3.805713] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.806740] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.791671] systemd[1]: Finished Find NixOS closure. client # [ 3.808025] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.780562] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.792916] systemd[1]: Reached target Initrd Default Target. client # [ 3.809163] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.810441] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.794920] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.812241] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.813371] systemd[1]: Stopped Load Kernel Modules. client # [ 3.814397] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.815640] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.817131] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.818227] systemd[1]: Stopped Create System Files and Directories. client # [ 3.820098] systemd[1]: Stopped target Local File Systems. client # [ 3.820881] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.821907] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.823144] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.808622] systemd[1]: Stopped target Initrd Default Target. client # [ 3.825633] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.809958] systemd[1]: Stopped target Basic System. lb # [ 3.798830] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.826656] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.810892] systemd[1]: Stopped target Initrd Root Device. client # [ 3.827641] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.813162] systemd[1]: Stopped target Path Units. worker2 # [ 3.813826] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.801943] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 3.814818] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.816037] systemd[1]: Stopped target Slice Units. worker2 # [ 3.816726] systemd[1]: Stopped target Socket Units. worker2 # [ 3.817447] systemd[1]: Stopped target System Initialization. worker2 # [ 3.818231] systemd[1]: Stopped target Swaps. worker2 # [ 3.818823] systemd[1]: Stopped target Timer Units. worker2 # [ 3.819542] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.809236] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.820887] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.837124] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.821729] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.810502] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.822723] systemd[1]: Stopped Find NixOS closure. client # [ 3.839796] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.823950] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.812441] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.824918] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.826255] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.827422] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.844893] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.829305] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.830856] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.847945] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.831920] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.833101] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.850311] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.834648] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.835532] systemd[1]: Stopped target Local File Systems. client # [ 3.852177] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.852978] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.837491] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.854095] systemd[1]: Closed udev Control Socket. lb # [ 3.826335] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.838430] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.827342] systemd[1]: Stopped target Basic System. worker2 # [ 3.839385] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.855497] systemd[1]: Starting Cleanup udev Database... lb # [ 3.828255] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.829299] systemd[1]: Stopped target Path Units. client # [ 3.856739] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.857811] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.842587] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.858735] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.831109] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.843584] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.832143] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.860130] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.844527] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.833295] systemd[1]: Stopped target Slice Units. client # [ 3.861110] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.834042] systemd[1]: Stopped target Socket Units. lb # [ 3.834756] systemd[1]: Stopped target System Initialization. lb # [ 3.835588] systemd[1]: Stopped target Swaps. client # [ 3.863114] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.836280] systemd[1]: Stopped target Timer Units. lb # [ 3.837280] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.838385] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.850938] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.839982] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.841050] systemd[1]: Stopped Find NixOS closure. lb # [ 3.842107] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.844046] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.856118] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.845167] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.856967] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.846136] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.848075] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.860071] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.848817] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.876769] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.850042] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.878484] systemd[1]: Finished Cleanup udev Database. lb # [ 3.851705] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.880140] systemd[1]: Reached target Switch Root. lb # [ 3.852768] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.865180] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.881656] systemd[1]: Starting NixOS Activation... lb # [ 3.854066] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.866482] systemd[1]: Closed udev Control Socket. lb # [ 3.854857] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.868135] systemd[1]: Starting Cleanup udev Database... lb # [ 3.857122] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.868898] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.858089] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.870972] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.871894] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.873108] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.861542] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.874027] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.862631] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.874940] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.863935] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.875808] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.878138] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.871980] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.875130] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.878068] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.879142] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.892760] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.895080] systemd[1]: Finished Cleanup udev Database. lb # [ 3.883695] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.895822] systemd[1]: Reached target Switch Root. lb # [ 3.885281] systemd[1]: Closed udev Control Socket. worker2 # [ 3.897588] systemd[1]: Starting NixOS Activation... lb # [ 3.887082] systemd[1]: Starting Cleanup udev Database... lb # [ 3.888143] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.890114] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.890969] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.892082] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.893102] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.894067] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.895111] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.897430] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.911494] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.913168] systemd[1]: Finished Cleanup udev Database. lb # [ 3.914326] systemd[1]: Reached target Switch Root. lb # [ 3.915956] systemd[1]: Starting NixOS Activation... client # [ 3.943756] initrd-nixos-activation-start[191]: booting system configuration /nix/store/sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test client # [ 3.970737] initrd-nixos-activation-start[191]: running activation script... worker2 # [ 3.969525] initrd-nixos-activation-start[191]: booting system configuration /nix/store/lvqq63fax2ya6fsm3d7s7hfg0rmfbnl4-nixos-system-worker2-test lb # [ 3.974406] initrd-nixos-activation-start[192]: booting system configuration /nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test worker2 # [ 3.993876] initrd-nixos-activation-start[191]: running activation script... lb # [ 4.001038] initrd-nixos-activation-start[192]: running activation script... client # [ 4.161680] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 4.181649] initrd-nixos-activation-start[214]: setting up /etc... lb # [ 4.189904] initrd-nixos-activation-start[215]: setting up /etc... client # [ 4.257808] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.261451] systemd[1]: Finished NixOS Activation. client # [ 4.262483] systemd[1]: Starting Switch Root... client # [ 4.276161] systemd[1]: Switching root. worker2 # [ 4.278077] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.280078] systemd[1]: Finished NixOS Activation. worker2 # [ 4.282178] systemd[1]: Starting Switch Root... lb # [ 4.278895] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.280565] systemd[1]: Finished NixOS Activation. lb # [ 4.282534] systemd[1]: Starting Switch Root... worker2 # [ 4.296485] systemd[1]: Switching root. lb # [ 4.296296] systemd[1]: Switching root. client # [ 4.543191] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.553618] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.563175] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.607011] NET: Registered PF_VSOCK protocol family worker2 # [ 4.635820] NET: Registered PF_VSOCK protocol family lb # [ 4.633479] NET: Registered PF_VSOCK protocol family worker1 # [ 4.678349] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.707115] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.708466] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.710157] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.712759] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.732076] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.733568] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.740097] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.740856] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.742776] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.756321] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.757514] systemd[1]: Stopped target Basic System. worker1 # [ 4.759114] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.759919] systemd[1]: Stopped target Path Units. worker1 # [ 4.760646] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.761623] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.762714] systemd[1]: Stopped target Slice Units. worker1 # [ 4.763641] systemd[1]: Stopped target Socket Units. worker1 # [ 4.764635] systemd[1]: Stopped target System Initialization. worker1 # [ 4.765795] systemd[1]: Stopped target Swaps. worker1 # [ 4.766612] systemd[1]: Stopped target Timer Units. worker1 # [ 4.767537] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.769068] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.769876] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.770926] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.772064] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.773111] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.775060] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.775811] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.776822] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.777547] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.779623] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.780694] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.781730] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.783101] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.784279] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.786440] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.787393] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.788727] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.790479] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.791627] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.801439] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.803111] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.805741] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 4.964381] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 4.807087] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.968238] systemd[1]: Detected virtualization kvm. client # [ 4.968939] systemd[1]: Detected architecture x86-64. client # [ 4.969686] systemd[1]: Detected first boot. client # [ 4.971974] systemd[1]: Initializing machine ID from random generator. worker1 # [ 4.811822] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.813336] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.815139] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.816232] systemd[1]: Closed udev Control Socket. worker1 # [ 4.818062] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.818839] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.819937] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.821130] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.823112] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.824098] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.825061] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.839854] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.842071] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.842809] systemd[1]: Reached target Switch Root. worker1 # [ 4.844273] systemd[1]: Starting NixOS Activation... worker2 # [ 4.994126] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.003982] systemd[1]: Detected virtualization kvm. worker2 # [ 5.005857] systemd[1]: Detected architecture x86-64. worker2 # [ 5.007864] systemd[1]: Detected first boot. lb # [ 4.987840] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 4.997377] systemd[1]: Detected virtualization kvm. worker2 # [ 5.011934] systemd[1]: Initializing machine ID from random generator. lb # [ 4.999115] systemd[1]: Detected architecture x86-64. lb # [ 5.001057] systemd[1]: Detected first boot. lb # [ 5.004609] systemd[1]: Initializing machine ID from random generator. worker1 # [ 4.912939] initrd-nixos-activation-start[192]: booting system configuration /nix/store/dn8gqamk2zyr2nvpgiwfbpgwzjyrjlpw-nixos-system-worker1-test worker1 # [ 4.939231] initrd-nixos-activation-start[192]: running activation script... client # [ 5.179781] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.254982] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.245754] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.283248] systemd[1]: Applying preset policy. worker1 # [ 5.134354] initrd-nixos-activation-start[215]: setting up /etc... worker2 # [ 5.366050] systemd[1]: Applying preset policy. lb # [ 5.357826] systemd[1]: Applying preset policy. worker1 # [ 5.234658] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.236271] systemd[1]: Finished NixOS Activation. worker1 # [ 5.238283] systemd[1]: Starting Switch Root... worker1 # [ 5.249739] systemd[1]: Switching root. client # [ 5.458267] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.502327] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.510793] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.535177] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.584230] NET: Registered PF_VSOCK protocol family client # [ 5.642138] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 5.643531] systemd[1]: Stopped initrd-switch-root.service. client # [ 5.646089] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 5.648156] systemd[1]: Created slice Slice /system/getty. client # [ 5.649476] systemd[1]: Created slice User and Session Slice. client # [ 5.650414] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.651635] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 5.652742] systemd[1]: Expecting device /dev/hvc0... client # [ 5.653425] systemd[1]: Expecting device /dev/ttyS0... client # [ 5.654223] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.655076] systemd[1]: Stopped target initrd-fs.target. client # [ 5.655825] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.656584] systemd[1]: Stopped target initrd-switch-root.target. client # [ 5.657459] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.658390] systemd[1]: Reached target Path Units. client # [ 5.659132] systemd[1]: Reached target Remote File Systems. client # [ 5.659896] systemd[1]: Reached target Slice Units. client # [ 5.660597] systemd[1]: Reached target Swaps. client # [ 5.662453] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 5.664959] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.666638] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.668476] systemd[1]: Listening on Factory Reset Management. client # [ 5.681182] systemd[1]: Listening on Hostname Service Socket. client # [ 5.684278] systemd[1]: Starting Journal Log Access Socket... client # [ 5.685465] systemd[1]: Listening on Journal Audit Socket. client # [ 5.687930] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.689340] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 5.690498] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.691807] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 5.695693] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.696783] systemd[1]: Listening on udev Control Socket. client # [ 5.697617] systemd[1]: Listening on udev Varlink Socket. client # [ 5.699865] systemd[1]: Mounting Huge Pages File System... client # [ 5.702235] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.708804] systemd[1]: Mounting Kernel Debug File System... client # [ 5.715547] systemd[1]: Mounting Kernel Trace File System... client # [ 5.726312] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.696422] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.697750] systemd[1]: Stopped initrd-switch-root.service. lb # [ 5.699820] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 5.701909] systemd[1]: Created slice Slice /system/getty. lb # [ 5.703215] systemd[1]: Created slice User and Session Slice. lb # [ 5.704181] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.736559] systemd[1]: Starting Load Kernel Module configfs... lb # [ 5.705405] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.706505] systemd[1]: Expecting device /dev/hvc0... lb # [ 5.707184] systemd[1]: Expecting device /dev/ttyS0... lb # [ 5.707976] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.708838] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.709587] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.710394] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.724173] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.711232] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.725576] systemd[1]: Stopped initrd-switch-root.service. lb # [ 5.712175] systemd[1]: Reached target Path Units. client # [ 5.743279] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 5.712909] systemd[1]: Reached target Remote File Systems. lb # [ 5.713711] systemd[1]: Reached target Slice Units. lb # [ 5.714405] systemd[1]: Reached target Swaps. worker2 # [ 5.727825] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.729912] systemd[1]: Created slice Slice /system/getty. lb # [ 5.716217] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.731282] systemd[1]: Created slice User and Session Slice. lb # [ 5.718712] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.732215] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.733445] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.720442] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.734584] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.735262] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.736054] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.753275] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.736903] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.737689] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.738475] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.739289] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.740183] systemd[1]: Reached target Path Units. worker2 # [ 5.740919] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.741697] systemd[1]: Reached target Slice Units. worker2 # [ 5.742424] systemd[1]: Reached target Swaps. worker2 # [ 5.744205] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.746668] systemd[1]: Listening on Process Core Dump Socket. lb # [ 5.722303] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.748404] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 5.734959] systemd[1]: Listening on Hostname Service Socket. client # [ 5.766730] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 5.737849] systemd[1]: Starting Journal Log Access Socket... lb # [ 5.739945] systemd[1]: Listening on Journal Audit Socket. lb # [ 5.742298] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 5.743421] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.744497] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.745795] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 5.778381] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.750230] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.762576] systemd[1]: Listening on Hostname Service Socket. lb # [ 5.749666] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.750679] systemd[1]: Listening on udev Control Socket. lb # [ 5.751566] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.765725] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.766955] systemd[1]: Listening on Journal Audit Socket. lb # [ 5.753750] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.769572] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.785801] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 5.756045] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.770941] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.772076] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.773339] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 5.763698] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.777336] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.778338] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.779207] systemd[1]: Listening on udev Varlink Socket. client # [ 5.797097] systemd[1]: Starting Journal Service... worker2 # [ 5.781420] systemd[1]: Mounting Huge Pages File System... client # [ 5.801277] systemd[1]: Starting Load Kernel Modules... lb # [ 5.770812] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.784787] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.791462] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.780424] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.811944] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.799415] systemd[1]: Mounting Kernel Trace File System... client # [ 5.818935] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.789212] systemd[1]: Starting Load Kernel Module configfs... client # [ 5.822950] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.805908] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.793663] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.817958] systemd[1]: Starting Load Kernel Module configfs... client # [ 5.836829] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.820252] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 5.808794] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.824491] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.845673] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.818679] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.851154] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.834499] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 5.829209] systemd[1]: Mounting FUSE Control File System... client # [ 5.861656] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.849260] systemd[1]: Mounting FUSE Control File System... client # [ 5.868979] systemd[1]: Mounted Kernel Debug File System. client # [ 5.869944] loop: module loaded lb # [ 5.837664] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 5.872151] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.854800] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 5.877786] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.850119] systemd[1]: Starting Journal Service... client # [ 5.882340] systemd-journald[284]: Collecting audit messages is enabled. worker2 # [ 5.865937] systemd[1]: Starting Journal Service... client # [ 5.883602] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.857366] systemd[1]: Starting Load Kernel Modules... client # [ 5.890383] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.873512] systemd[1]: Starting Load Kernel Modules... client # [ 5.893150] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.880039] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.866332] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 5.897776] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.885312] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 5.902795] EXT4-fs (vda): re-mounted 95830c48-09f8-4980-a821-1a3c2658b02c. worker2 # [ 5.887484] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.909256] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.894199] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.880348] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 5.776344] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.779402] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.884366] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.780672] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 5.899122] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.901604] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.903132] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.921093] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.906099] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.893750] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.908210] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.910204] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.913464] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.931307] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.902220] systemd-journald[285]: Collecting audit messages is enabled. client # [ 5.935215] systemd[1]: Started Journal Service. worker2 # [ 5.918624] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.910484] systemd[1]: Listening on Journal Log Access Socket. client # [ 5.812080] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.919353] systemd[1]: Mounted Huge Pages File System. client # [ 5.816920] systemd-oomd[286]: No swap; memory pressure usage will be degraded lb # [ 5.929544] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.944250] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.946249] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.829281] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 5.935246] loop: module loaded worker2 # [ 5.950749] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.805960] systemd[1]: Queued start job for default target Multi-User System. lb # [ 5.807582] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.940929] systemd[1]: Started Journal Service. lb # [ 5.811236] systemd-modules-load[286]: Inserted module 'loop' worker1 # [ 5.940481] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.841422] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 5.950305] systemd[1]: Detected virtualization kvm. lb # [ 5.815816] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.816731] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 5.952084] systemd[1]: Detected architecture x86-64. lb # [ 5.817750] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 5.953920] systemd[1]: Detected first boot. lb # [ 5.821287] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 5.849172] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.850211] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 5.957758] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.970748] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.826169] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.826978] systemd[1]: Mounted FUSE Control File System. lb # [ 5.827844] systemd[1]: Finished Load Kernel Modules. client # [ 5.855714] systemd[1]: Starting Load/Save OS Random Seed... client # [ 5.856597] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.973368] EXT4-fs (vda): re-mounted 86e65e3a-d71a-476b-99c1-afe1eaa27d79. lb # [ 5.851175] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.997415] EXT4-fs (vda): re-mounted 2679bd0b-f316-4cc7-b526-db7c0c2f47d4. worker2 # [ 6.001404] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 5.856064] systemd[1]: Starting Firewall... lb # [ 5.859064] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.009214] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.865275] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 6.012834] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 5.894949] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.013974] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.872094] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.020590] loop: module loaded worker2 # [ 6.021995] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.024440] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.028202] systemd[1]: Finished Load Kernel Modules. lb # [ 5.883151] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.049673] systemd-journald[284]: Received client request to flush runtime journal. lb # [ 5.886254] systemd-oomd[287]: No swap; memory pressure usage will be degraded worker2 # [ 6.033008] systemd[1]: Starting Firewall... worker2 # [ 6.037202] systemd[1]: Starting Apply Kernel Variables... lb # [ 5.900092] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.903062] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.915168] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.916025] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.920670] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.935291] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.071818] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.073736] systemd[1]: Started Journal Service. worker2 # [ 5.940695] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.943476] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 5.950504] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 5.957294] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 5.994422] systemd[1]: Finished Apply Kernel Variables. client # [ 5.995877] systemd[1]: Finished Load/Save OS Random Seed. client # [ 5.998327] systemd[1]: Reached target First Boot Complete. client # [ 6.001413] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.121487] systemd-journald[285]: Received client request to flush runtime journal. client # [ 6.026703] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.011278] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 6.012217] systemd[1]: Reached target First Boot Complete. client # [ 6.032644] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.028621] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.036173] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.048353] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.184535] systemd-journald[284]: Received client request to flush runtime journal. client # [ 6.074702] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.089314] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.196233] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.091229] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.093039] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 6.077853] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.080233] systemd[1]: Finished Apply Kernel Variables. lb # [ 6.082205] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.083050] systemd[1]: Reached target First Boot Complete. lb # [ 6.087075] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.123359] systemd-udevd[316]: Using default interface naming scheme 'v261'. client # [ 6.155073] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.137722] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.144591] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.159523] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.160585] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.163214] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.169380] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.310095] systemd[1]: Applying preset policy. lb # [ 6.197369] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.210980] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.240142] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.213134] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.214990] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.249211] systemd-udevd[316]: Using default interface naming scheme 'v261'. lb # [ 6.260376] systemd-udevd[329]: Using default interface naming scheme 'v261'. client # [ 6.289819] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.307373] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.329345] (udev-worker)[322]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.334555] (udev-worker)[319]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.336796] (udev-worker)[319]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.309295] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.322169] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.474896] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.378198] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.411095] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.412787] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.414503] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.416417] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.418127] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.419297] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.424887] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.601266] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 6.615902] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 6.468684] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.510805] systemd[1]: Mounting /run/wrappers... lb # [ 6.511747] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.649039] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.650468] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.652456] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.654546] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.655861] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.656815] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.658071] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.659172] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.659879] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.660655] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.661505] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.662249] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.555267] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.663033] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.556174] systemd[1]: Reached target Local File Systems. worker1 # [ 6.663909] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.664829] systemd[1]: Reached target Path Units. worker1 # [ 6.665565] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.666330] systemd[1]: Reached target Slice Units. client # [ 6.558557] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 6.667115] systemd[1]: Reached target Swaps. worker1 # [ 6.668905] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.563063] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.671406] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 6.673172] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.567698] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.540235] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.568565] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.562228] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.675046] systemd[1]: Listening on Factory Reset Management. worker1 # [ 6.687359] systemd[1]: Listening on Hostname Service Socket. client # [ 6.579973] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.690353] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.691509] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.556801] (udev-worker)[361]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.693881] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.558696] (udev-worker)[360]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.695518] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.561135] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.696636] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.697912] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.701895] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.702951] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.703835] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.568450] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.706069] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.710403] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.587752] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.715926] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 6.594134] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.722195] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.731444] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.741119] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.606779] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.741948] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.607726] systemd[1]: Reached target Local File Systems. lb # [ 6.612555] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.616302] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.752085] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.644871] systemd[1]: Starting Create System Files and Directories... lb # [ 6.620183] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.621133] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.634578] ACPI: button: Power Button [PWRF] worker2 # [ 6.635780] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.636570] systemd[1]: Reached target Local File Systems. worker1 # [ 6.760546] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.637650] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 6.640389] systemd[1]: Starting register-nix-paths.service... lb # [ 6.629258] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.642761] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.770282] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.645886] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.648337] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.773588] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.651135] systemd[1]: Starting Create System Files and Directories... worker2 # [ 6.659589] (udev-worker)[354]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.786107] systemd[1]: Starting Journal Service... lb # [ 6.653147] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.791562] systemd[1]: Starting Load Kernel Modules... worker2 # [ 6.668343] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.797119] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.691824] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.695988] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 6.680623] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.805637] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 6.807735] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.813488] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 6.818682] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.821038] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.821912] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.824716] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.827786] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.829408] systemd[1]: Mounted FUSE Control File System. client # [ 6.727140] systemd[1]: Finished Create System Files and Directories. worker1 # [ 6.836710] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.839630] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.734145] systemd[1]: Starting Rebuild Journal Catalog... client # [ 6.660049] mousedev: PS/2 mouse device common for all mice client # [ 6.697455] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 6.717317] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 6.740118] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.730324] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.871860] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.748242] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.737635] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 6.875060] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 6.752853] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 6.878898] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 6.897739] EXT4-fs (vda): re-mounted 7129ed64-7510-46d7-bff0-0b537e13403b. worker1 # [ 6.903414] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.907528] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.717377] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T13:45:21 UTC (1790084721) client # [ 6.717460] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 6.910365] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.802932] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.912091] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.917343] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.919110] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.927649] systemd-journald[285]: Collecting audit messages is enabled. client # [ 6.823617] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.829258] systemd[1]: Starting Update is Completed... worker2 # [ 6.816189] systemd[1]: Finished Create System Files and Directories. worker1 # [ 6.941467] loop: module loaded lb # [ 6.805856] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.821230] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.823161] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.813331] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.949195] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.952673] systemd[1]: Starting Firewall... lb # [ 6.817801] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.957481] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.828639] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.717991] systemd-journald[284]: Time jumped backwards, rotating. lb # [ 6.834175] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.735016] parport_pc 00:02: reported by Plug and Play ACPI client # [ 6.735106] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 6.836454] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.838403] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.841158] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.844953] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.846251] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.874185] systemd[1]: Finished Update is Completed. worker1 # [ 6.853543] systemd[1]: Queued start job for default target Multi-User System.[ 6.987560] systemd[1]: Started Journal Service. worker1 # worker1 # [ 6.857498] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.786545] Console: switching to colour dummy device 80x25 worker1 # [ 6.868191] systemd-modules-load[286]: Inserted module 'loop' client # [ 6.804621] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 6.871284] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.876494] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.823681] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 6.885080] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.886192] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.893182] systemd[1]: Reached target First Boot Complete. worker2 # [ 6.902513] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.059562] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.059566] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.067405] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.068107] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.085898] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.087160] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 6.926963] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.931741] systemd-oomd[287]: No swap; memory pressure usage will be degraded client # [ 7.093141] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.095536] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 6.940209] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.081482] systemd-journald[285]: Received client request to flush runtime journal. worker2 # [ 6.961112] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.964123] systemd[1]: Starting Update is Completed... lb # [ 6.961546] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.967778] systemd[1]: Starting Update is Completed... worker1 # [ 7.055807] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.057094] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.057955] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.057394] systemd[1]: Finished Update is Completed. worker1 # [ 7.063100] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.064133] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.107805] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.092588] systemd[1]: Finished Update is Completed. worker2 # [ 7.109523] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.112970] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.114498] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.116991] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.120125] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.122721] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.125072] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.248672] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 client # [ 7.281634] Console: switching to colour frame buffer device 160x50 worker1 # [ 7.131476] systemd-udevd[318]: Using default interface naming scheme 'v261'. lb # [ 7.261987] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.166253] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.169830] systemd[1]: Stopped Virtual Console Setup. client # [ 7.177394] systemd[1]: Starting Virtual Console Setup... lb # [ 7.288986] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 client # [ 7.323756] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 7.359444] ppdev: user-space parallel port driver worker1 # [ 7.206270] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.236310] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.238866] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 7.235127] systemd[1]: Finished Firewall. client # [ 7.411814] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 7.396047] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.405905] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.276356] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.439022] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.305173] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.307208] systemd[1]: Stopped Virtual Console Setup. client # [ 7.312575] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.430953] ACPI: button: Power Button [PWRF] lb # [ 7.287691] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 7.290442] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 7.318228] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.320917] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 7.363604] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.543342] kvm_amd: TSC scaling supported client # [ 7.543911] kvm_amd: Nested Virtualization enabled client # [ 7.544353] kvm_amd: Nested Paging enabled client # [ 7.545165] kvm_amd: LBR virtualization supported client # [ 7.545607] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.546487] kvm_amd: Virtual GIF supported client # [ 7.547190] kvm_amd: Virtual NMI enabled lb # [ 7.341513] ACPI: button: Power Button [PWRF] lb # [ 7.359371] mousedev: PS/2 mouse device common for all mice lb # [ 7.495491] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.505155] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.584384] EDAC MC: Ver: 3.0.0 lb # [ 7.509860] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.512173] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.512243] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T13:45:22 UTC (1790084722) lb # [ 7.439113] systemd[1]: Finished register-nix-paths.service. lb # [ 7.440189] systemd[1]: Reached target System Initialization. lb # [ 7.442495] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.444609] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.445632] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.447687] systemd[1]: Reached target Timer Units. lb # [ 7.448647] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.452233] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.453781] systemd[1]: Listening on niks3 server socket. lb # [ 7.454655] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.455401] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.456606] systemd[1]: Reached target Socket Units. lb # [ 7.457390] systemd[1]: Reached target Basic System. lb # [ 7.460124] systemd[1]: Started backdoor.service. worker1 # [ 7.466389] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.465342] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.523910] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.533765] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.571518] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.476111] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.571592] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T13:45:22 UTC (1790084722) worker2 # [ 7.571676] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.489363] systemd[1]: Starting Post-Boot Actions... lb # [ 7.495888] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.504110] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.512675] systemd-journald[285]: Time jumped backwards, rotating. lb # [ 7.512867] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.506088] systemd[1]: Starting resolvconf update... worker1 # [ 7.519373] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.523826] (udev-worker)[354]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.522778] systemd[1]: Started rustfs.service. worker1 # [ 7.527561] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.541449] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 7.572692] systemd-journald[284]: Time jumped backwards, rotating. worker2 # [ 7.581426] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.605640] parport_pc 00:02: reported by Plug and Play ACPI lb # connecting to host... lb # [ 7.561078] systemd[1]: Finished Firewall. lb # [ 7.531520] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.538352] Console: switching to colour dummy device 80x25 lb # [ 7.699653] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.699655] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.597945] systemd[1]: Finished register-nix-paths.service. worker1 # [ 7.575219] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.575953] systemd[1]: Reached target Local File Systems. worker1 # [ 7.578720] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.605738] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.614238] Console: switching to colour dummy device 80x25 worker1 # [ 7.581404] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.583914] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.584955] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.619823] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.582143] nsncd[521]: Sep 22 13:45:22.701 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.729698] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.729701] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.589351] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 7.616309] systemd-vconsole-setup[420]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 7.590138] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.592869] systemd[1]: Starting Create System Files and Directories... client # [ 7.619746] systemd[1]: Finished Virtual Console Setup. client # [ 7.621563] systemd[1]: Reached target System Initialization. client # [ 7.622976] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.624409] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 7.625308] systemd[1]: Reached target Timer Units. client # [ 7.627068] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.628065] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.628867] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.747619] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 7.748268] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.630150] systemd[1]: Reached target Socket Units. client # [ 7.630857] systemd[1]: Reached target Basic System. client # [ 7.632800] systemd[1]: Started backdoor.service. lb # [ 7.605766] systemd[1]: Finished Post-Boot Actions. client # [ 7.636128] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 7.642120] systemd[1]: Starting nftables firewall... worker2 # [ 7.760712] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.761391] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 7.627854] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.628890] systemd[1]: Reached target System Initialization. client # [ 7.647368] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.631942] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.636408] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.757998] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.758728] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.655186] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.639277] systemd[1]: Reached target Timer Units. worker2 # [ 7.641409] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.642675] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.645801] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 7.767768] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.768489] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.665300] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.649380] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.638888] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.652100] systemd[1]: Reached target Socket Units. worker2 # [ 7.654086] systemd[1]: Reached target Basic System. lb # [ 7.643193] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.661693] systemd[1]: Started backdoor.service. worker2 # [ 7.662539] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.651152] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 7.664763] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.682695] systemd[1]: Starting resolvconf update... worker2 # [ 7.667212] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.674719] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.675665] systemd[1]: Starting resolvconf update... worker2 # [ 7.676420] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 7.669467] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.673737] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.676079] systemd[1]: Starting User Login Management... client # connecting to host... lb # [ 7.686077] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 7.718617] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.740185] systemd[1]: Finished Post-Boot Actions. client # [ 7.741136] nsncd[428]: Sep 22 13:45:22.658 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.743343] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.726338] systemd[1]: Finished Create System Files and Directories. client: Guest shell says: b'Spawning backdoor root shell...\n' worker1 # [ 7.730368] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.732933] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.750299] systemd[1]: Finished Post-Boot Actions. client # [ 7.767320] systemd[1]: Reached target Host and Network Name Lookups. client: connected to guest root shell client: (connecting took 8.45 seconds) client # [ 7.768198] systemd[1]: Reached target User and Group Name Lookups. client: (finished: waiting for the VM to finish booting, in 8.45 seconds) client # [ 7.778631] systemd[1]: Starting User Login Management... client # [ 7.790723] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # connecting to host... worker2 # [ 7.785208] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.787457] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.791266] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.794548] nsncd[514]: Sep 22 13:45:22.848 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.796987] systemd[1]: Starting User Login Management... worker1 # [ 7.809995] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.824671] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 7.946102] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 7.952571] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.839287] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... client # [ 7.859881] dbus-broker-launch[439]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.846627] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.847897] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.849454] dbus-broker-launch[551]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.862125] systemd[1]: Started D-Bus System Message Bus. client # [ 7.880314] dbus-broker-launch[439]: NSS returned no entry for 'systemd-timesync' lb # [ 7.854178] dbus-broker-launch[551]: NSS returned no entry for 'systemd-timesync' client # [ 7.882302] dbus-broker-launch[439]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.855188] dbus-broker-launch[551]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 7.864866] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.867248] systemd[1]: Starting Update is Completed... worker1 # [ 7.874550] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.876112] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.877941] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.881162] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.884695] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.886166] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.911518] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 7.888157] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.897624] dbus-broker-launch[518]: Ready client # [ 7.917543] systemd-logind[458]: New seat seat0. lb # [ 7.890831] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 7.891811] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 7.894585] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 7.895629] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.925265] systemd-logind[458]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 7.898771] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 7.926469] systemd-logind[458]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 7.928887] systemd-logind[458]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 7.903125] systemd[1]: nscd.service: Deactivated successfully. client # [ 7.936167] systemd[1]: Started User Login Management. client # [ 7.944251] systemd[1]: Starting linger-users.service... worker2 # [ 7.944454] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 7.946484] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 7.948987] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 7.951495] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.967907] dbus-broker-launch[439]: Ready worker1 # [ 7.943773] systemd[1]: Finished Update is Completed. worker2 # [ 7.954861] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 7.998876] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.000247] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.002722] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.005217] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.006832] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.008498] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.010212] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.023703] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.027884] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.031264] systemd[1]: Finished linger-users.service. client # [ 8.063838] systemd[1]: Finished resolvconf update. client # [ 8.071370] systemd[1]: Starting DHCP Client... client # [ 8.072098] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.073582] nsncd[523]: Sep 22 13:45:22.991 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.077417] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.078528] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.166117] Console: switching to colour frame buffer device 160x50 lb # [ 8.193591] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 7.908081] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.063682] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.064705] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 8.068212] systemd[1]: Finished Firewall. lb # [ 8.068597] dbus-broker-launch[551]: Ready lb # [ 8.070825] nsncd[608]: Sep 22 13:45:23.131 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.073813] systemd[1]: Starting Virtual Console Setup... lb # [ 8.076126] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.076958] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.079177] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.080041] systemd[1]: Finished resolvconf update. lb # [ 8.080725] systemd[1]: Reached target Preparation for Network. lb # [ 8.082735] systemd[1]: Starting DHCP Client... lb # [ 8.083484] systemd[1]: Starting Address configuration of eth1... lb # [ 8.085119] systemd[1]: Starting Extra networking commands.... lb # [ 8.086153] systemd-logind[555]: New seat seat0. lb # [ 8.086871] systemd[1]: Started User Login Management. worker2 # [ 8.040055] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.040302] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.106776] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.118874] systemd[1]: Starting linger-users.service... lb # [ 8.127875] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.132963] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.137639] systemd[1]: Stopped Virtual Console Setup. client # [ 8.168479] dhcpcd[553]: dhcpcd-10.3.2 starting client # [ 8.173508] dhcpcd[560]: dev: loaded udev worker1 # [ 8.287519] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 8.317788] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.169431] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.177756] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.232891] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.326062] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.956851] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 8.196783] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.219210] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.199774] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.209194] nsncd[586]: Sep 22 13:45:23.091 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.337945] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 8.214219] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.218518] network-addresses-eth1-start[614]: adding address 192.168.1.4/24... done worker1 # [ 8.211235] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.213144] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.223384] network-addresses-eth1-start[614]: adding address 2001:db8:1::4/64... done worker2 # [ 8.224856] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.227369] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.231163] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.234216] systemd[1]: Finished resolvconf update. worker2 # [ 8.234884] systemd[1]: Reached target Preparation for Network. worker2 # [ 8.238464] systemd[1]: Starting DHCP Client... worker2 # [ 8.239294] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.240121] systemd[1]: Starting Extra networking commands.... client # [ 8.392610] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 8.240910] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.243348] systemd-logind[538]: New seat seat0. worker2 # [ 8.247653] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.248673] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.250610] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.251857] systemd[1]: Started User Login Management. client # [ 8.405041] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.405991] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 8.407773] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.408618] cfg80211: failed to load regulatory.db worker2 # [ 8.256351] systemd-logind[538]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 8.257600] systemd[1]: Starting linger-users.service... worker2 # [ 8.259435] systemd-logind[538]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.250101] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.256292] systemd[1]: Finished linger-users.service. client # [ 8.450055] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.315497] dhcpcd[560]: eth0: waiting for carrier client # [ 8.316329] dhcpcd[560]: eth0: carrier acquired client # [ 8.323902] dhcpcd[560]: DUID 00:01:00:01:32:45:42:f3:52:54:00:12:34:56 client # [ 8.324816] dhcpcd[560]: eth0: IAID 00:12:34:56 worker2 # [ 8.309467] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.325728] dhcpcd[560]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 8.310508] systemd[1]: Finished linger-users.service. lb # [ 8.299316] network-addresses-eth1-start[638]: adding address 192.168.1.2/24... done client # [ 8.328488] systemd[1]: Finished nftables firewall. client # [ 8.330230] systemd[1]: Reached target Preparation for Network. client # [ 8.332904] systemd[1]: Starting Address configuration of eth1... client # [ 8.336338] systemd[1]: Starting Extra networking commands.... worker1 # [ 8.349306] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 8.344201] dhcpcd[622]: dhcpcd-10.3.2 starting lb # [ 8.336683] network-addresses-eth1-start[638]: adding address 2001:db8:1::2/64... done worker2 # [ 8.350454] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.352565] systemd[1]: Reached target Network. worker2 # [ 8.355478] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.358930] dhcpcd[684]: dev: loaded udev client # [ 8.511376] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 8.481022] ppdev: user-space parallel port driver client # [ 8.385546] network-addresses-eth1-start[585]: adding address 192.168.1.1/24... done worker2 # [ 8.510483] ppdev: user-space parallel port driver client # [ 8.396924] network-addresses-eth1-start[585]: adding address 2001:db8:1::1/64... done worker1 # [ 8.349843] ACPI: button: Power Button [PWRF] worker1 # [ 8.355195] mousedev: PS/2 mouse device common for all mice lb # [ 8.373517] systemd[1]: Finished Address configuration of eth1. client # [ 8.408415] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.402156] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.360143] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.360210] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T13:45:22 UTC (1790084722) worker2 # [ 8.406355] systemd-logind[538]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 8.407516] systemd[1]: Started Getty on tty1. worker2 # [ 8.409137] systemd[1]: Reached target Login Prompts. lb # [ 8.531400] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.429946] systemd[1]: Finished Extra networking commands.. client # [ 8.432299] systemd[1]: Reached target Network. client # [ 8.434240] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.556629] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.557058] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.360283] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.361233] systemd-journald[285]: Time jumped backwards, rotating. worker1 # [ 8.375869] parport_pc 00:02: reported by Plug and Play ACPI client # [ 8.449615] systemd[1]: Finished Permit User Sessions. client # [ 8.453116] systemd[1]: Started Getty on tty1. client # [ 8.453805] systemd[1]: Reached target Login Prompts. worker1 # [ 8.375949] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.392759] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 8.450721] Console: switching to colour dummy device 80x25 worker1 # [ 8.469233] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 8.597141] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.459861] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.461380] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.463142] systemd[1]: Starting Virtual Console Setup... lb # [ 8.601778] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.557399] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.557515] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 8.617275] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.509576] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.500239] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.512202] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.503136] systemd[1]: Reached target Network. worker1 # [ 8.514666] systemd[1]: Finished register-nix-paths.service. lb # [ 8.513301] systemd[1]: Starting PostgreSQL Server... worker2 # [ 8.526169] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.517571] systemd[1]: Reached target System Initialization. worker1 # [ 8.617518] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 8.652281] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 8.652283] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.520760] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 8.664645] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.521767] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.519431] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.522808] systemd[1]: Reached target Timer Units. lb # [ 8.520727] dhcpcd[666]: dhcpcd-10.3.2 starting worker1 # [ 8.523539] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.526100] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 8.528273] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 8.529870] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.532124] systemd[1]: Reached target Socket Units. worker1 # [ 8.534155] systemd[1]: Reached target Basic System. lb # [ 8.533445] dhcpcd[724]: dev: loaded udev worker1 # [ 8.536520] systemd[1]: Started backdoor.service. worker1 # [ 8.539139] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.540126] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.542283] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.547134] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.556189] systemd[1]: Starting resolvconf update... worker1 # [ 8.563362] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 8.707014] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 8.584324] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.708618] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.709052] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.725463] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.605129] systemd[1]: Finished Permit User Sessions. lb # [ 8.612556] systemd[1]: Started Getty on tty1. lb # [ 8.613720] systemd[1]: Reached target Login Prompts. worker1 # [ 8.633672] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.785400] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.786122] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.646292] systemd[1]: Finished Post-Boot Actions. worker2 # [ 8.790554] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.791384] cfg80211: failed to load regulatory.db worker2 # [ 8.809744] kvm_amd: TSC scaling supported worker2 # [ 8.810157] kvm_amd: Nested Virtualization enabled worker2 # [ 8.811040] kvm_amd: Nested Paging enabled worker2 # [ 8.812752] kvm_amd: LBR virtualization supported worker2 # [ 8.813200] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.814509] kvm_amd: Virtual GIF supported worker2 # [ 8.814899] kvm_amd: Virtual NMI enabled worker1 # [ 8.677035] nsncd[516]: Sep 22 13:45:22.948 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.682311] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.683182] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.817018] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # connecting to host... worker1 # [ 8.684020] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.692972] systemd[1]: Starting User Login Management... lb # [ 8.712125] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.858545] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.725359] dhcpcd[684]: eth0: waiting for carrier worker2 # [ 8.726522] dhcpcd[684]: libudev: received NULL device worker2 # [ 8.727559] dhcpcd[684]: libudev: received NULL device worker1 # [ 8.719084] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.728884] dhcpcd[684]: eth0: carrier acquired worker2 # [ 8.871696] EDAC MC: Ver: 3.0.0 worker2 # [ 8.741499] dhcpcd[684]: DUID 00:01:00:01:32:45:42:f3:52:54:00:12:34:56 worker2 # [ 8.742667] dhcpcd[684]: eth0: IAID 00:12:34:56 worker2 # [ 8.744232] dhcpcd[684]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.741797] dbus-broker-launch[520]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.753714] dbus-broker-launch[520]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.754759] dbus-broker-launch[520]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.888117] kvm_amd: TSC scaling supported lb # [ 8.891045] kvm_amd: Nested Virtualization enabled lb # [ 8.894274] kvm_amd: Nested Paging enabled lb # [ 8.894702] kvm_amd: LBR virtualization supported lb # [ 8.895145] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 8.897490] kvm_amd: Virtual GIF supported lb # [ 8.897914] kvm_amd: Virtual NMI enabled worker1 # [ 8.771061] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.785980] systemd-vconsole-setup[694]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.788986] systemd[1]: Finished Virtual Console Setup. worker1 # [ 8.810518] dbus-broker-launch[520]: Ready lb # [ 8.947608] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.987976] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 8.988664] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 8.995821] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 8.996683] cfg80211: failed to load regulatory.db lb # [ 9.004599] EDAC MC: Ver: 3.0.0 client # [ 8.954579] dhcpcd[560]: eth0: soliciting a DHCP lease lb # [ 8.929296] postgresql-pre-start[735]: The files belonging to this database system will be owned by user "postgres". lb # [ 8.930735] postgresql-pre-start[735]: This user must also own the server process. lb # [ 8.934037] postgresql-pre-start[735]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 8.935489] postgresql-pre-start[735]: The default database encoding has accordingly been set to "UTF8". client # [ 9.099757] NET: Registered PF_PACKET protocol family lb # [ 8.937104] postgresql-pre-start[735]: The default text search configuration will be set to "english". lb # [ 8.938256] postgresql-pre-start[735]: Data page checksums are enabled. lb # [ 8.939358] postgresql-pre-start[735]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok client # [ 8.968534] dhcpcd[560]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 8.970156] dhcpcd[560]: eth0: probing address 10.0.2.15/24 lb # [ 8.942805] postgresql-pre-start[735]: creating subdirectories ... ok lb # [ 8.943736] postgresql-pre-start[735]: selecting dynamic shared memory implementation ... posix lb # [ 9.082105] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.951433] dhcpcd[724]: eth0: waiting for carrier lb # [ 8.952584] dhcpcd[724]: libudev: received NULL device lb # [ 8.954413] dhcpcd[724]: libudev: received NULL device lb # [ 8.955282] dhcpcd[724]: eth0: carrier acquired lb # [ 8.965987] dhcpcd[724]: DUID 00:01:00:01:32:45:42:f4:52:54:00:12:34:56 lb # [ 8.966961] dhcpcd[724]: eth0: IAID 00:12:34:56 lb # [ 8.967638] dhcpcd[724]: eth0: adding address fe80::5054:ff:fe12:3456 client: (finished: waiting for unit network-addresses-eth1.service, in 9.68 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.01 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 9.046880] postgresql-pre-start[735]: selecting default "max_connections" ... 100 lb # [ 9.058698] dhcpcd[724]: eth0: soliciting a DHCP lease worker1 # [ 9.164542] ppdev: user-space parallel port driver lb # [ 9.210217] NET: Registered PF_PACKET protocol family lb # [ 9.083990] dhcpcd[724]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 9.085067] dhcpcd[724]: eth0: probing address 10.0.2.15/24 lb: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker1 # [ 9.200760] Console: switching to colour frame buffer device 160x50 worker1 # [ 9.238893] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.868754] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 9.115167] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 9.120253] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 9.121763] network-addresses-eth1-start[616]: adding address 192.168.1.3/24... done worker1 # [ 9.126264] network-addresses-eth1-start[616]: adding address 2001:db8:1::3/64... done worker1 # [ 9.127533] nsncd[591]: Sep 22 13:45:23.201 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.134578] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 9.138421] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 9.145073] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 9.146069] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.149341] systemd-logind[541]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 9.150736] systemd-logind[541]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 9.153156] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.154041] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.154845] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 9.159391] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.160242] systemd[1]: Finished resolvconf update. worker1 # [ 9.160922] systemd[1]: Reached target Preparation for Network. worker1 # [ 9.161749] systemd[1]: Starting DHCP Client... worker1 # [ 9.162429] systemd[1]: Starting Address configuration of eth1... lb # [ 9.159236] systemd-vconsole-setup[716]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.163373] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.166085] systemd[1]: Starting Extra networking commands.... worker1 # [ 9.166939] systemd[1]: Finished Address configuration of eth1. worker1 # [ 9.167781] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.170610] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.168063] postgresql-pre-start[735]: selecting default "shared_buffers" ... 128MB worker1 # [ 9.173340] systemd-logind[541]: New seat seat0. worker1 # [ 9.176660] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.180471] systemd[1]: Started User Login Management. worker1 # [ 9.181210] systemd-logind[541]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.185753] systemd[1]: Starting linger-users.service... worker1 # [ 9.342437] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.228701] dhcpcd[624]: dhcpcd-10.3.2 starting worker1 # [ 9.238167] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 9.239567] systemd[1]: Finished linger-users.service. worker1 # [ 9.242699] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.245153] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.247313] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.251632] systemd[1]: Reached target Network. worker1 # [ 9.254665] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.256687] dhcpcd[690]: dev: loaded udev worker1 # [ 9.259138] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.415622] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.416067] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.427792] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.15 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1 # [ 9.348248] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.350895] systemd[1]: Started Getty on tty1. worker1 # [ 9.353630] systemd[1]: Reached target Login Prompts. worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.11 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.552821] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.432102] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service worker1 # [ 9.634049] kvm_amd: TSC scaling supported worker1 # [ 9.634599] kvm_amd: Nested Virtualization enabled worker1 # [ 9.635223] kvm_amd: Nested Paging enabled worker1 # [ 9.635644] kvm_amd: LBR virtualization supported worker1 # [ 9.636096] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.636579] kvm_amd: Virtual GIF supported worker1 # [ 9.636957] kvm_amd: Virtual NMI enabled worker1 # [ 9.641231] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.641901] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.643875] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 9.644752] cfg80211: failed to load regulatory.db worker1 # [ 9.687261] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 9.555525] dhcpcd[690]: eth0: waiting for carrier worker1 # [ 9.556433] dhcpcd[690]: eth0: carrier acquired worker1 # [ 9.694285] EDAC MC: Ver: 3.0.0 worker1 # [ 9.569683] dhcpcd[690]: DUID 00:01:00:01:32:45:42:f3:52:54:00:12:34:56 worker1 # [ 9.570819] dhcpcd[690]: eth0: IAID 00:12:34:56 worker1 # [ 9.571574] dhcpcd[690]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.616855] systemd-vconsole-setup[696]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.619724] systemd[1]: Finished Virtual Console Setup. lb # [ 9.705068] postgresql-pre-start[735]: selecting default time zone ... UTC lb # [ 9.707569] postgresql-pre-start[735]: creating configuration files ... ok lb # [ 9.866120] postgresql-pre-start[735]: running bootstrap script ... ok worker2 # [ 10.025233] dhcpcd[684]: eth0: soliciting an IPv6 router worker2 # [ 10.027375] dhcpcd[684]: eth0: Router Advertisement from fe80::2 worker2 # [ 10.029437] dhcpcd[684]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 10.031661] dhcpcd[684]: eth0: adding route to fec0::/64 worker2 # [ 10.033497] dhcpcd[684]: eth0: adding default route via fe80::2 worker2 # [ 10.121994] dhcpcd[684]: eth0: soliciting a DHCP lease worker2 # [ 10.274542] NET: Registered PF_PACKET protocol family worker2 # [ 10.146619] dhcpcd[684]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 10.151378] dhcpcd[684]: eth0: probing address 10.0.2.15/24 lb # [ 10.226728] postgresql-pre-start[735]: performing post-bootstrap initialization ... ok worker1 # [ 10.359977] dhcpcd[690]: eth0: soliciting a DHCP lease lb # [ 10.363127] postgresql-pre-start[735]: syncing data to disk ... ok lb # [ 10.365089] postgresql-pre-start[735]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.366272] postgresql-pre-start[735]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.368126] postgresql-pre-start[735]: Success. You can now start the database server using: lb # [ 10.369123] postgresql-pre-start[735]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker1 # [ 10.510468] NET: Registered PF_PACKET protocol family worker1 # [ 10.383744] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.388284] dhcpcd[690]: eth0: probing address 10.0.2.15/24 lb # [ 10.439773] postgres[781]: [781] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.442568] postgres[781]: [781] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.443633] postgres[781]: [781] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.446343] postgres[781]: [781] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 10.459291] postgres[790]: [790] LOG: database system was shut down at 2026-09-22 13:45:25 GMT lb # [ 10.463688] postgres[781]: [781] LOG: database system is ready to accept connections lb # [ 10.469844] systemd[1]: Started PostgreSQL Server. lb # [ 10.476159] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 10.636870] postgresql-setup-start[801]: CREATE DATABASE lb # [ 10.664031] postgresql-setup-start[815]: CREATE ROLE lb # [ 10.675248] postgresql-setup-start[817]: ALTER DATABASE lb # [ 10.679491] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.681425] systemd[1]: Reached target PostgreSQL. client # [ 10.814861] dhcpcd[560]: eth0: soliciting an IPv6 router client # [ 10.817986] dhcpcd[560]: eth0: Router Advertisement from fe80::2 client # [ 10.820286] dhcpcd[560]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.822530] dhcpcd[560]: eth0: adding route to fec0::/64 client # [ 10.824525] dhcpcd[560]: eth0: adding default route via fe80::2 lb # [ 10.953410] dhcpcd[724]: eth0: soliciting an IPv6 router lb # [ 10.956321] dhcpcd[724]: eth0: Router Advertisement from fe80::2 lb # [ 10.958612] dhcpcd[724]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 10.960889] dhcpcd[724]: eth0: adding route to fec0::/64 lb # [ 10.962663] dhcpcd[724]: eth0: adding default route via fe80::2 worker1 # [ 11.377965] dhcpcd[690]: eth0: soliciting an IPv6 router worker1 # [ 11.379226] dhcpcd[690]: eth0: Router Advertisement from fe80::2 worker1 # [ 11.380178] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 11.381070] dhcpcd[690]: eth0: adding route to fec0::/64 worker1 # [ 11.381815] dhcpcd[690]: eth0: adding default route via fe80::2 client # [ 14.044756] dhcpcd[560]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 14.048177] dhcpcd[560]: eth0: adding route to 10.0.2.0/24 client # [ 14.050615] dhcpcd[560]: eth0: adding default route via 10.0.2.2 client # [ 14.131868] systemd[1]: Started DHCP Client. client # [ 14.134284] systemd[1]: Reached target Multi-User System. client # [ 14.135505] systemd[1]: Startup finished in 886ms (kernel) + 3.568s (initrd) + 9.680s (userspace) = 14.135s. lb # [ 14.734723] dhcpcd[724]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 14.737576] dhcpcd[724]: eth0: adding route to 10.0.2.0/24 lb # [ 14.739700] dhcpcd[724]: eth0: adding default route via 10.0.2.2 lb # [ 14.850419] systemd[1]: Started DHCP Client. lb # [ 14.855445] systemd[1]: Reached target Network is Online. lb # [ 14.859373] systemd[1]: Started Envoy reverse proxy. lb # [ 14.863902] systemd[1]: Started mock-oidc.service. lb # [ 15.037482] mock-oidc-server[918]: Mock OIDC Server running lb # [ 15.040371] mock-oidc-server[918]: OIDC Address: 192.168.1.2:8080 lb # [ 15.042089] mock-oidc-server[918]: Issue Address: 0.0.0.0:8081 lb # [ 15.042887] mock-oidc-server[918]: Issuer: http://192.168.1.2:8080/oidc lb # [ 15.043761] mock-oidc-server[918]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 15.044767] mock-oidc-server[918]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 15.046236] mock-oidc-server[918]: Issue tokens: http://0.0.0.0:8081/issue?sub=... worker2 # [ 15.104652] dhcpcd[684]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 15.108415] dhcpcd[684]: eth0: adding route to 10.0.2.0/24 worker2 # [ 15.111200] dhcpcd[684]: eth0: adding default route via 10.0.2.2 worker2 # [ 15.184988] systemd[1]: Started DHCP Client. worker2 # [ 15.187085] systemd[1]: Reached target Multi-User System. worker2 # [ 15.187820] systemd[1]: Startup finished in 876ms (kernel) + 3.602s (initrd) + 10.707s (userspace) = 15.186s. lb # [ 15.177725] envoy[917]: [2026-09-22 13:45:30.297][917][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 15.180448] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 15.181866] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 15.183471] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 15.187272] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 15.189670] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 15.191245] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 15.192818] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 15.194543] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 15.197839] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 15.200288] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 15.202125] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 15.203954] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 15.206054] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 15.208080] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 15.210170] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 15.214906] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 15.216932] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 15.219170] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 15.220877] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 15.222530] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 15.224931] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 15.228062] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 15.230314] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 15.248163] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 15.250274] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 15.252951] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 15.255900] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 15.258253] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 15.260884] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 15.263031] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 15.265936] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 15.269082] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 15.270904] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 15.273378] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 15.282225] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 15.287189] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 15.289299] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 15.292089] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 15.296314] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 15.302297] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 15.307623] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 15.309919] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 15.311520] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 15.313129] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 15.314889] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 15.340371] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 15.342629] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 15.344872] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 15.347245] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 15.348969] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 15.355161] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 15.358146] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 15.362532] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.364923] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 15.367100] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 15.370243] envoy[917]: [2026-09-22 13:45:30.299][917][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 15.374088] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 15.375983] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 15.377644] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 15.379458] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 15.380995] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 15.382643] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 15.386964] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 15.389767] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 15.396880] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 15.400281] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 15.402960] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 15.405245] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 15.407629] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 15.409255] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 15.413262] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 15.415554] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 15.418943] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 15.421087] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 15.424141] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 15.426234] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 15.428359] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 15.430243] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 15.434758] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 15.437263] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 15.439705] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.441598] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 15.443767] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 15.445844] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 15.448238] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 15.451651] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 15.453526] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 15.458404] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 15.459876] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable worker1 # [ 15.467654] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 15.462105] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm worker1 # [ 15.470777] dhcpcd[690]: eth0: adding route to 10.0.2.0/24 lb # [ 15.468709] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator worker1 # [ 15.473484] dhcpcd[690]: eth0: adding default route via 10.0.2.2 lb # [ 15.471284] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 15.473361] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 15.479115] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 15.480765] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 15.482667] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 15.484204] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 15.487433] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 15.498547] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 15.501083] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 15.503469] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 15.505180] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 15.507942] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 15.510201] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 15.511980] envoy[917]: [2026-09-22 13:45:30.300][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 15.513435] envoy[917]: [2026-09-22 13:45:30.361][917][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 15.514732] envoy[917]: [2026-09-22 13:45:30.363][917][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 15.528139] envoy[917]: [2026-09-22 13:45:30.363][917][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 15.529598] envoy[917]: [2026-09-22 13:45:30.363][917][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 15.537285] envoy[917]: [2026-09-22 13:45:30.363][917][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 15.543297] envoy[917]: [2026-09-22 13:45:30.663][917][info][main] [source/server/server.cc:968] runtime: {} lb # [ 15.546053] envoy[917]: [2026-09-22 13:45:30.665][917][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 15.547684] envoy[917]: [2026-09-22 13:45:30.665][917][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 15.549601] envoy[917]: [2026-09-22 13:45:30.669][917][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 worker1 # [ 15.554942] systemd[1]: Started DHCP Client. lb # [ 15.551719] envoy[917]: [2026-09-22 13:45:30.671][917][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration worker1 # [ 15.556577] systemd[1]: Reached target Multi-User System. lb # [ 15.553896] envoy[917]: [2026-09-22 13:45:30.673][917][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) worker1 # [ 15.557780] systemd[1]: Startup finished in 875ms (kernel) + 4.560s (initrd) + 10.121s (userspace) = 15.557s. lb # [ 15.555301] envoy[917]: [2026-09-22 13:45:30.673][917][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 15.577927] envoy[917]: [2026-09-22 13:45:30.697][917][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 15.583279] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 15.582821] envoy[917]: [2026-09-22 13:45:30.702][917][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 15.595212] systemd[1]: Reached target Network is Online. lb # [ 15.584944] envoy[917]: [2026-09-22 13:45:30.704][917][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 15.587932] envoy[917]: [2026-09-22 13:45:30.704][917][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 15.601503] systemd[1]: Starting scheduler-token.service... worker2 # [ 15.668691] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 15.671770] systemd[1]: Finished scheduler-token.service. worker2 # [ 15.673990] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 70ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 15.678761] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 15.674358] nix-grpc-daemon[782]: ts=2026-09-22T13:45:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 15.682545] nix-grpc-daemon[782]: ts=2026-09-22T13:45:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 15.684705] nix-grpc-daemon[782]: ts=2026-09-22T13:45:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 15.693463] nix-grpc-daemon[782]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 15.694951] nix-grpc-daemon[782]: E0000 00:00:1790084729.965850 782 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.700261] nix-grpc-daemon[782]: E0000 00:00:1790084729.972801 782 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.703055] nix-grpc-daemon[782]: ts=2026-09-22T13:45:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 15.705924] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 15.721596] nix-grpc-daemon[782]: E0000 00:00:1790084729.992883 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 15.731263] envoy[917]: [2026-09-22 13:45:30.850][917][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 15.735185] envoy[917]: [2026-09-22 13:45:30.850][917][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 15.738585] nix-grpc-daemon[782]: E0000 00:00:1790084730.011286 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.742235] nix-grpc-daemon[782]: E0000 00:00:1790084730.013368 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 15.739205] envoy[917]: [2026-09-22 13:45:30.850][917][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 15.745729] envoy[917]: [2026-09-22 13:45:30.865][917][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 15.753752] nix-grpc-daemon[782]: E0000 00:00:1790084730.026431 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.765200] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.776409] nix-grpc-daemon[784]: ts=2026-09-22T13:45:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 15.768085] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.787078] nix-grpc-daemon[784]: ts=2026-09-22T13:45:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 15.790031] nix-grpc-daemon[784]: ts=2026-09-22T13:45:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 15.802326] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 15.803848] nix-grpc-daemon[784]: E0000 00:00:1790084730.864562 784 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.809747] nix-grpc-daemon[784]: E0000 00:00:1790084730.872285 784 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.812930] nix-grpc-daemon[784]: ts=2026-09-22T13:45:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 15.816574] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 15.836085] nix-grpc-daemon[784]: E0000 00:00:1790084730.898200 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.851280] nix-grpc-daemon[784]: E0000 00:00:1790084730.913873 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.856059] nix-grpc-daemon[784]: E0000 00:00:1790084730.916277 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.866814] nix-grpc-daemon[784]: E0000 00:00:1790084730.929477 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.880152] nix-grpc-daemon[784]: ts=2026-09-22T13:45:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.881789] nix-grpc-daemon[784]: ts=2026-09-22T13:45:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.968658] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.971782] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.083500] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.087590] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.172516] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.176386] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.288554] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.292434] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.377255] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.381077] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.493619] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.497424] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.581833] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.585643] nix-grpc-daemon[782]: ts=2026-09-22T13:45:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.698768] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.702574] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.787705] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.790833] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.904634] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.908166] nix-grpc-daemon[784]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.988731] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.992468] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.109397] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.113396] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.193139] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.196948] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.314377] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.318319] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.397615] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.401395] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.519398] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.523562] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.602242] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.605953] nix-grpc-daemon[782]: ts=2026-09-22T13:45:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.724725] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.728638] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.807509] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.811111] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.931242] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.934330] nix-grpc-daemon[784]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.008868] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.012613] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.132253] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.136174] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.213543] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.218180] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.337132] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.340962] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.419210] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.423267] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.542150] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.545998] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.624088] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.628103] nix-grpc-daemon[782]: ts=2026-09-22T13:45:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.747690] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.750981] nix-grpc-daemon[784]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.829504] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.833169] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.949140] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.950778] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.033914] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.037723] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.151798] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.153638] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.238586] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.242398] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.354322] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.356051] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.443295] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.447191] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.556781] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.558608] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.648331] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.652274] nix-grpc-daemon[782]: ts=2026-09-22T13:45:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.759405] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.761209] nix-grpc-daemon[784]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.854287] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.857413] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.962398] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.964129] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.054746] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.058581] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.164755] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.166503] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.259449] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.263387] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.367334] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.369048] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.464247] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.467997] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.569817] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.571540] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.668881] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.672767] nix-grpc-daemon[782]: ts=2026-09-22T13:45:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.772268] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.773933] nix-grpc-daemon[784]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.875210] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.878306] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.975191] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.976799] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.076133] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.079908] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.178294] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.182208] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.280486] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.284283] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.383268] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.387146] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.485121] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.488910] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.588374] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.592136] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.689407] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.693177] nix-grpc-daemon[782]: ts=2026-09-22T13:45:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.792709] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.794574] nix-grpc-daemon[784]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.895295] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.898364] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.995709] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.997437] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.096428] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.100210] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.198246] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.200059] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.300986] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.304932] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.401462] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.405312] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.505754] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.509473] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.606463] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.610266] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.709726] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.711982] nix-grpc-daemon[782]: ts=2026-09-22T13:45:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.811271] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.815174] nix-grpc-daemon[784]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.913649] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.917398] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.017507] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 lb # [ 23.007707] rustfs-bucket-start[1000]: mb s3://farm worker2 # [ 23.020767] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 23.020810] systemd[1]: Finished rustfs-bucket.service. lb # [ 23.030394] systemd[1]: Starting niks3 server... worker1 # [ 23.118368] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.122329] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 23.157330] postgres[1013]: [1013] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 23.159122] postgres[1013]: [1013] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 23.181384] niks3-server[1008]: 2026/09/22 13:45:38 OK 20241026095416_initial_model.sql (12.63ms) lb # [ 23.184794] niks3-server[1008]: 2026/09/22 13:45:38 OK 20251210153512_drop_unused_gin_index.sql (2.15ms) lb # [ 23.189681] niks3-server[1008]: 2026/09/22 13:45:38 OK 20251218171726_add_pins.sql (3.37ms) lb # [ 23.194183] niks3-server[1008]: 2026/09/22 13:45:38 OK 20260628120000_add_object_size_and_stats.sql (3.2ms) lb # [ 23.199227] niks3-server[1008]: 2026/09/22 13:45:38 OK 20260905000000_add_claims.sql (5.03ms) lb # [ 23.203330] niks3-server[1008]: 2026/09/22 13:45:38 OK 20260920000000_drop_claims.sql (3.98ms) lb # [ 23.204513] niks3-server[1008]: 2026/09/22 13:45:38 goose: successfully migrated database to version: 20260920000000 lb # [ 23.208394] niks3-server[1008]: 2026/09/22 13:45:38 OK 1_commit_pending_closure.sql (5.14ms) lb # [ 23.211693] niks3-server[1008]: 2026/09/22 13:45:38 OK 2_object_stats_trigger.sql (1.93ms) lb # [ 23.212763] niks3-server[1008]: 2026/09/22 13:45:38 goose: up to current file version: 2 worker2 # [ 23.222212] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 lb # [ 23.215630] niks3-server[1008]: 2026/09/22 13:45:38 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key worker2 # [ 23.226148] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 23.244902] niks3-server[1008]: 2026/09/22 13:45:38 INFO Read proxy enabled — serving cache objects from S3 lb # [ 23.246847] niks3-server[1008]: 2026/09/22 13:45:38 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 23.250748] niks3-server[1008]: 2026/09/22 13:45:38 INFO systemd watchdog enabled interval=15s lb # [ 23.251938] niks3-server[1008]: 2026/09/22 13:45:38 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 23.253093] systemd[1]: Started niks3 server. lb # [ 23.253770] systemd[1]: Reached target Multi-User System. lb # [ 23.257308] systemd[1]: Startup finished in 909ms (kernel) + 3.575s (initrd) + 18.772s (userspace) = 23.256s. worker1 # [ 23.322977] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.326885] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 13.88 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.02 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost worker2 # [ 23.427415] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.431316] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 23.431932] envoy[917]: conn peer=[::1]:60224 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker1 # [ 23.527534] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.531336] nix-grpc-daemon[782]: ts=2026-09-22T13:45:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.550403] systemd[1]: Starting scheduler-token.service... worker2 # [ 23.588491] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 23.590073] systemd[1]: Finished scheduler-token.service. worker2 # [ 23.591699] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 39ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 23.631726] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.633742] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 23.732101] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.735925] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.835185] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.839797] nix-grpc-daemon[784]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.936870] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.938581] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.041159] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.042896] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.139740] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.143735] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.243624] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.245354] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.344632] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.348569] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.446171] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.447863] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.549501] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.553281] nix-grpc-daemon[782]: ts=2026-09-22T13:45:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.648618] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.650318] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 24.753535] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.755862] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.851056] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.852807] nix-grpc-daemon[784]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.957574] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.961258] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.054054] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.055767] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.162085] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.166191] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.256574] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.258385] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.366642] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.370484] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.459257] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.460983] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.570988] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.573967] nix-grpc-daemon[782]: ts=2026-09-22T13:45:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.662221] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.665945] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 25.774680] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.778638] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.866649] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.870421] nix-grpc-daemon[784]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.980307] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.983841] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.072633] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.076129] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.184885] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.188937] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.276681] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.278399] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.389796] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.393821] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.479195] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.480940] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.594789] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.598895] nix-grpc-daemon[782]: ts=2026-09-22T13:45:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.682324] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.686260] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 26.799492] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.803317] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.887239] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.890959] nix-grpc-daemon[784]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.004030] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.005763] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.093667] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.096775] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.207119] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.210959] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.294173] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.296031] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.411945] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.415808] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.496735] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.498537] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.616699] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.620641] nix-grpc-daemon[782]: ts=2026-09-22T13:45:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.699304] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.700964] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 27.821311] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.825288] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 27.902106] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.906145] nix-grpc-daemon[784]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.027373] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.030472] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.108427] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.111544] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.228465] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.232423] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.309709] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.313594] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.433216] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.437119] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.514711] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.518573] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.637981] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.641892] nix-grpc-daemon[782]: ts=2026-09-22T13:45:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.719653] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.723477] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 28.842674] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.846586] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 28.924515] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.928308] nix-grpc-daemon[784]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.048460] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.051844] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.130552] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.134111] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.252728] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.256678] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.334841] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.336593] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.457502] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.461395] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.537813] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.541710] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.662211] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.665982] nix-grpc-daemon[782]: ts=2026-09-22T13:45:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.742215] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.743893] nix-grpc-daemon[784]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.866851] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.870587] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 29.944546] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.946272] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.071904] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.075738] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.147364] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.149188] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.276629] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.280625] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.349930] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.351809] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.481575] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.485558] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.552631] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.554455] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.686439] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.690648] nix-grpc-daemon[782]: ts=2026-09-22T13:45:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.755230] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.757042] nix-grpc-daemon[784]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.890840] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.893416] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 30.957769] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.959571] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 31.094441] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.096446] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.160932] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.162678] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.297042] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.298773] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.363485] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.365196] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.499345] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.501034] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.565909] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.567704] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.701931] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.705816] nix-grpc-daemon[782]: ts=2026-09-22T13:45:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.768899] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.772967] nix-grpc-daemon[784]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.906807] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.911342] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.973520] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.975378] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 32.112639] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.115653] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.177683] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.180880] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.313718] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.317572] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.382118] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.385783] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.518328] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.522127] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.586839] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.590703] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.722837] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.726654] nix-grpc-daemon[782]: ts=2026-09-22T13:45:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.791820] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.795716] nix-grpc-daemon[784]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.927519] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.931401] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.996818] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.000740] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 33.133205] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.136753] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.203434] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.206550] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 33.259436] niks3-server[1008]: 2026/09/22 13:45:48 INFO lead: acquired remote=192.168.1.4:34094 worker2 # [ 33.274460] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_take_over worker1 # [ 33.337525] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.341358] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.404569] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.408375] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.542130] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.546092] nix-grpc-daemon[782]: ts=2026-09-22T13:45:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.608951] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.612789] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.746832] nix-grpc-daemon[782]: ts=2026-09-22T13:45:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.750536] nix-grpc-daemon[782]: ts=2026-09-22T13:45:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.813925] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.817935] nix-grpc-daemon[784]: ts=2026-09-22T13:45:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.951328] nix-grpc-daemon[782]: ts=2026-09-22T13:45:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.966668] nix-grpc-daemon[784]: ts=2026-09-22T13:45:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36474 worker2 # [ 33.971127] nix-grpc-daemon[784]: ts=2026-09-22T13:45:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 34.019072] nix-grpc-daemon[784]: ts=2026-09-22T13:45:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.030525] nix-grpc-daemon[784]: ts=2026-09-22T13:45:49Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 34.033447] nix-grpc-daemon[784]: ts=2026-09-22T13:45:49Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36474 worker2 # [ 34.037705] nix-grpc-daemon[784]: ts=2026-09-22T13:45:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.83 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 34.666338] nix-grpc-daemon[782]: ts=2026-09-22T13:45:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 34.674679] systemd[1]: Started Nix Daemon. worker1 # [ 34.791231] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 34.805190] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 1/5) worker1 # [ 34.815589] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 109 ms (attempt 2/5) worker1 # [ 34.929221] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 393 ms (attempt 3/5) worker1 # [ 35.329623] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 369 ms (attempt 4/5) worker1 # [ 35.702583] nix-grpc-daemon[782]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 35.706388] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 35.725417] nix-grpc-daemon[782]: ts=2026-09-22T13:45:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 35.736191] nix-grpc-daemon[782]: ts=2026-09-22T13:45:50Z level=debug event=path_info_miss path=sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test error="error: path '/nix/store/sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 35.764931] nix-grpc-daemon[784]: ts=2026-09-22T13:45:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 35.775778] systemd[1]: Started Nix Daemon. worker2 # [ 35.871834] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 35.894123] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5) worker2 # [ 35.979653] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 125 ms (attempt 2/5) worker2 # [ 36.107137] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 3/5) worker2 # [ 36.414320] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 4/5) worker2 # [ 36.522355] nix-grpc-daemon[784]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 36.525746] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 36.539182] nix-grpc-daemon[784]: ts=2026-09-22T13:45:51Z level=debug event=path_info_miss path=sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test error="error: path '/nix/store/sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.03 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 36.719621] nix-grpc-daemon[782]: ts=2026-09-22T13:45:50Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 36.723544] nix-grpc-daemon[782]: ts=2026-09-22T13:45:50Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:42750 worker2 # [ 36.745655] nix-grpc-daemon[784]: ts=2026-09-22T13:45:51Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36480 worker2 # [ 36.755107] nix-grpc-daemon[784]: ts=2026-09-22T13:45:51Z level=debug event=path_info_miss path=sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test error="error: path '/nix/store/sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 36.764210] nix-grpc-daemon[784]: ts=2026-09-22T13:45:51Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36480 worker2 # [ 36.773499] nix-grpc-daemon[784]: ts=2026-09-22T13:45:51Z level=debug event=path_info_miss path=sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test error="error: path '/nix/store/sj30989cgkidyy8h42lc8n59b9vy41qh-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker1 # [ 38.932940] nix-grpc-daemon[782]: ts=2026-09-22T13:45:53Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 39.067731] nix-grpc-daemon[782]: ts=2026-09-22T13:45:53Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.61 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 39.216221] nix-grpc-daemon[784]: ts=2026-09-22T13:45:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 39.221825] nix-grpc-daemon[782]: ts=2026-09-22T13:45:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 39.254623] nix-grpc-daemon[784]: ts=2026-09-22T13:45:54Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 39.258530] nix-grpc-daemon[784]: ts=2026-09-22T13:45:54Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.300340] nix-grpc-daemon[782]: ts=2026-09-22T13:45:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 39.307506] nix-grpc-daemon[782]: ts=2026-09-22T13:45:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 client # copying 1 paths to 'lb:50051'... worker1 # [ 39.313078] nix-grpc-daemon[782]: ts=2026-09-22T13:45:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 39.324637] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 39.340535] nix-grpc-daemon[782]: ts=2026-09-22T13:45:53Z level=info event=niks3_push_started pid=862 worker1 # [ 39.482207] nix-grpc-daemon[862]: time=2026-09-22T13:45:53.754Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 39.571632] nix-daemon[848]: accepted connection from pid 875, user nix-grpc-daemon (trusted) worker1 # [ 39.584167] nix-daemon[848]: reaped child process 878, status = succeeded worker1 # [ 39.665162] nix-daemon[848]: accepted connection from pid 880, user nix-grpc-daemon (trusted) worker1 # [ 39.678136] nix-daemon[848]: reaped child process 883, status = succeeded lb # [ 39.681568] niks3-server[1008]: 2026/09/22 13:45:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.698165] nix-grpc-daemon[862]: time=2026-09-22T13:45:53.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 39.701358] nix-grpc-daemon[862]: time=2026-09-22T13:45:53.972Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 39.727953] niks3-server[1008]: 2026/09/22 13:45:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 39.757301] niks3-server[1008]: 2026/09/22 13:45:54 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 39.764221] niks3-server[1008]: 2026/09/22 13:45:54 INFO Signed narinfos id=1 count=1 worker1 # [ 39.769696] nix-grpc-daemon[862]: time=2026-09-22T13:45:54.041Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.774771] niks3-server[1008]: 2026/09/22 13:45:54 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 39.776797] niks3-server[1008]: 2026/09/22 13:45:54 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 39.790993] niks3-server[1008]: 2026/09/22 13:45:54 INFO Completed upload id=1 worker1 # [ 39.794192] nix-grpc-daemon[862]: time=2026-09-22T13:45:54.066Z level=INFO msg="Upload complete. (307ms)" lb # [ 39.795446] niks3-server[1008]: 2026/09/22 13:45:54 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker1 # [ 39.799581] nix-grpc-daemon[782]: ts=2026-09-22T13:45:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 39.806171] nix-grpc-daemon[782]: ts=2026-09-22T13:45:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 39.819111] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 39.826781] nix-daemon[848]: reaped child process 860, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker1 # [ 39.835417] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 41.472632] nix-daemon[848]: reaped child process 887, status = succeeded worker1 # [ 41.563456] nix-daemon[848]: accepted connection from pid 903, user nix-grpc-daemon (trusted) lb # [ 41.585277] niks3-server[1008]: 2026/09/22 13:45:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.590658] nix-daemon[848]: reaped child process 906, status = succeeded worker1 # [ 41.594685] nix-grpc-daemon[862]: time=2026-09-22T13:45:55.866Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 41.597126] nix-grpc-daemon[862]: time=2026-09-22T13:45:55.866Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 41.610975] niks3-server[1008]: 2026/09/22 13:45:56 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 41.613172] niks3-server[1008]: 2026/09/22 13:45:56 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 41.615824] niks3-server[1008]: 2026/09/22 13:45:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 41.619634] niks3-server[1008]: 2026/09/22 13:45:56 INFO Signed narinfos id=2 count=1 worker1 # [ 41.622751] nix-grpc-daemon[862]: time=2026-09-22T13:45:55.894Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.622542] niks3-server[1008]: 2026/09/22 13:45:56 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 41.628327] niks3-server[1008]: 2026/09/22 13:45:56 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 41.631029] niks3-server[1008]: 2026/09/22 13:45:56 INFO Completed upload id=2 worker1 # [ 41.635117] nix-grpc-daemon[862]: time=2026-09-22T13:45:55.907Z level=INFO msg="Upload complete. (188ms)" lb # [ 41.635640] niks3-server[1008]: 2026/09/22 13:45:56 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker1 # [ 41.637649] nix-grpc-daemon[782]: ts=2026-09-22T13:45:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 41.644397] nix-daemon[848]: reaped child process 885, status = succeeded worker2 # [ 41.658660] nix-grpc-daemon[784]: ts=2026-09-22T13:45:56Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 41.662607] nix-grpc-daemon[784]: ts=2026-09-22T13:45:56Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 41.692986] nix-grpc-daemon[782]: ts=2026-09-22T13:45:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 41.701887] nix-grpc-daemon[782]: ts=2026-09-22T13:45:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 41.711790] nix-grpc-daemon[862]: time=2026-09-22T13:45:55.984Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 41.717548] nix-grpc-daemon[782]: ts=2026-09-22T13:45:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 41.726656] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 41.818274] nix-daemon[848]: accepted connection from pid 911, user nix-grpc-daemon (trusted) worker1 # [ 41.832917] nix-daemon[848]: reaped child process 914, status = succeeded worker1 # [ 41.911133] nix-daemon[848]: accepted connection from pid 916, user nix-grpc-daemon (trusted) worker1 # [ 41.923294] nix-daemon[848]: reaped child process 919, status = succeeded lb # [ 41.926627] niks3-server[1008]: 2026/09/22 13:45:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.935093] nix-grpc-daemon[862]: time=2026-09-22T13:45:56.207Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 41.936420] nix-grpc-daemon[862]: time=2026-09-22T13:45:56.207Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 41.942125] niks3-server[1008]: 2026/09/22 13:45:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 41.944281] niks3-server[1008]: 2026/09/22 13:45:57 INFO Signed narinfos id=3 count=1 worker1 # [ 41.948548] nix-grpc-daemon[862]: time=2026-09-22T13:45:56.221Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.945764] niks3-server[1008]: 2026/09/22 13:45:57 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 41.952065] niks3-server[1008]: 2026/09/22 13:45:57 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 41.955191] niks3-server[1008]: 2026/09/22 13:45:57 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 41.959733] niks3-server[1008]: 2026/09/22 13:45:57 INFO Completed upload id=3 worker1 # [ 41.964170] nix-grpc-daemon[862]: time=2026-09-22T13:45:56.236Z level=INFO msg="Upload complete. (226ms)" lb # [ 41.962398] niks3-server[1008]: 2026/09/22 13:45:57 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 41.966332] nix-grpc-daemon[782]: ts=2026-09-22T13:45:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 41.969130] nix-grpc-daemon[782]: ts=2026-09-22T13:45:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 41.975670] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 41.977874] nix-daemon[848]: reaped child process 909, status = succeeded client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... worker1 # [ 41.982782] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 42.810535] nix-daemon[848]: reaped child process 923, status = succeeded worker1 # [ 42.886202] nix-daemon[848]: accepted connection from pid 939, user nix-grpc-daemon (trusted) worker1 # [ 42.898484] nix-daemon[848]: reaped child process 942, status = succeeded lb # [ 42.902499] niks3-server[1008]: 2026/09/22 13:45:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.909720] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.182Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 42.911197] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.183Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 42.922281] niks3-server[1008]: 2026/09/22 13:45:58 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 42.925060] niks3-server[1008]: 2026/09/22 13:45:58 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 42.928599] niks3-server[1008]: 2026/09/22 13:45:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 42.930793] niks3-server[1008]: 2026/09/22 13:45:58 INFO Signed narinfos id=4 count=1 worker1 # [ 42.933983] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.206Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.934720] niks3-server[1008]: 2026/09/22 13:45:58 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 42.938924] niks3-server[1008]: 2026/09/22 13:45:58 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 42.944259] niks3-server[1008]: 2026/09/22 13:45:58 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo lb # [ 42.947253] niks3-server[1008]: 2026/09/22 13:45:58 INFO Completed upload id=4 worker1 # [ 42.950106] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.222Z level=INFO msg="Upload complete. (158ms)" worker1 # [ 42.952579] nix-grpc-daemon[782]: ts=2026-09-22T13:45:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 42.966554] nix-grpc-daemon[784]: ts=2026-09-22T13:45:58Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker1 # [ 42.959590] nix-daemon[848]: reaped child process 921, status = succeeded worker2 # [ 42.968514] nix-grpc-daemon[784]: ts=2026-09-22T13:45:58Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 43.000572] nix-grpc-daemon[782]: ts=2026-09-22T13:45:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 43.009970] nix-grpc-daemon[782]: ts=2026-09-22T13:45:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 43.019998] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.292Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 43.026951] nix-grpc-daemon[782]: ts=2026-09-22T13:45:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 43.034600] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 43.124694] nix-daemon[848]: accepted connection from pid 946, user nix-grpc-daemon (trusted) worker1 # [ 43.137274] nix-daemon[848]: reaped child process 949, status = succeeded worker1 # [ 43.220465] nix-daemon[848]: accepted connection from pid 951, user nix-grpc-daemon (trusted) worker1 # [ 43.235920] nix-daemon[848]: reaped child process 954, status = succeeded lb # [ 43.239079] niks3-server[1008]: 2026/09/22 13:45:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.249796] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.522Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.251678] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.523Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 43.269830] niks3-server[1008]: 2026/09/22 13:45:58 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 43.282853] niks3-server[1008]: 2026/09/22 13:45:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 43.293596] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.566Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.291162] niks3-server[1008]: 2026/09/22 13:45:58 INFO Signed narinfos id=5 count=1 lb # [ 43.294400] niks3-server[1008]: 2026/09/22 13:45:58 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 43.308335] niks3-server[1008]: 2026/09/22 13:45:58 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 43.314863] niks3-server[1008]: 2026/09/22 13:45:58 INFO Completed upload id=5 worker1 # [ 43.317909] nix-grpc-daemon[862]: time=2026-09-22T13:45:57.590Z level=INFO msg="Upload complete. (272ms)" lb # [ 43.319723] niks3-server[1008]: 2026/09/22 13:45:58 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 43.321930] nix-grpc-daemon[782]: ts=2026-09-22T13:45:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 43.326876] nix-grpc-daemon[782]: ts=2026-09-22T13:45:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 43.335254] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 43.343973] nix-daemon[848]: reaped child process 944, status = succeeded client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 43.349087] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 43.963184] nix-daemon[848]: reaped child process 958, status = succeeded worker1 # [ 44.034735] nix-daemon[848]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker1 # [ 44.046977] nix-daemon[848]: reaped child process 977, status = succeeded lb # [ 44.052559] niks3-server[1008]: 2026/09/22 13:45:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.064277] nix-grpc-daemon[862]: time=2026-09-22T13:45:58.336Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 44.066051] nix-grpc-daemon[862]: time=2026-09-22T13:45:58.338Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 44.090973] niks3-server[1008]: 2026/09/22 13:45:59 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 44.104522] niks3-server[1008]: 2026/09/22 13:45:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 44.114775] nix-grpc-daemon[862]: time=2026-09-22T13:45:58.387Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.112116] niks3-server[1008]: 2026/09/22 13:45:59 INFO Signed narinfos id=6 count=1 lb # [ 44.116431] niks3-server[1008]: 2026/09/22 13:45:59 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 44.121489] niks3-server[1008]: 2026/09/22 13:45:59 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 44.130839] niks3-server[1008]: 2026/09/22 13:45:59 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 44.134845] niks3-server[1008]: 2026/09/22 13:45:59 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo lb # [ 44.138403] niks3-server[1008]: 2026/09/22 13:45:59 INFO Completed upload id=6 worker1 # [ 44.141320] nix-grpc-daemon[862]: time=2026-09-22T13:45:58.414Z level=INFO msg="Upload complete. (186ms)" worker1 # [ 44.143886] nix-grpc-daemon[782]: ts=2026-09-22T13:45:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 44.156794] nix-daemon[848]: reaped child process 956, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.08 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 5.39 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.12 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 44.931423] nix-grpc-daemon[784]: ts=2026-09-22T13:45:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 44.937429] nix-grpc-daemon[784]: ts=2026-09-22T13:45:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 44.959429] nix-grpc-daemon[784]: ts=2026-09-22T13:46:00Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.20 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.78 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 45.507730] nix-grpc-daemon[784]: ts=2026-09-22T13:46:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 45.516074] nix-grpc-daemon[784]: ts=2026-09-22T13:46:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 45.528228] nix-grpc-daemon[784]: ts=2026-09-22T13:46:00Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 45.532591] nix-grpc-daemon[784]: ts=2026-09-22T13:46:00Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 45.527177] nix-grpc-daemon[782]: ts=2026-09-22T13:45:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 45.540958] nix-grpc-daemon[782]: ts=2026-09-22T13:45:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 45.554211] nix-grpc-daemon[862]: time=2026-09-22T13:45:59.826Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 45.563073] nix-grpc-daemon[782]: ts=2026-09-22T13:45:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 45.578653] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) lb # [ 45.583202] envoy[917]: conn peer=[2001:db8:1::1]:37346 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=1894 lb # [ 45.588360] envoy[917]: conn peer=[2001:db8:1::1]:37356 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=60 lb # [ 45.593554] envoy[917]: conn peer=[2001:db8:1::1]:37370 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=10 lb # [ 45.597280] envoy[917]: conn peer=[2001:db8:1::1]:37376 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 lb # [ 45.602252] envoy[917]: conn peer=[2001:db8:1::1]:37382 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9395 tx=4327 ms=4958 lb # [ 45.606377] envoy[917]: conn peer=[2001:db8:1::1]:36586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=43 worker1 # [ 45.685307] nix-daemon[848]: accepted connection from pid 994, user nix-grpc-daemon (trusted) worker1 # [ 45.698942] nix-daemon[848]: reaped child process 997, status = succeeded worker1 # [ 45.778944] nix-daemon[848]: accepted connection from pid 999, user nix-grpc-daemon (trusted) worker1 # [ 45.792321] nix-daemon[848]: reaped child process 1002, status = succeeded lb # [ 45.796790] niks3-server[1008]: 2026/09/22 13:46:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.804113] nix-grpc-daemon[862]: time=2026-09-22T13:46:00.076Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.805645] nix-grpc-daemon[862]: time=2026-09-22T13:46:00.078Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 45.813086] niks3-server[1008]: 2026/09/22 13:46:00 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 45.818837] niks3-server[1008]: 2026/09/22 13:46:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 45.821793] niks3-server[1008]: 2026/09/22 13:46:00 INFO Signed narinfos id=7 count=1 worker1 # [ 45.824673] nix-grpc-daemon[862]: time=2026-09-22T13:46:00.097Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.827142] niks3-server[1008]: 2026/09/22 13:46:00 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 45.833131] niks3-server[1008]: 2026/09/22 13:46:00 INFO Completed upload id=7 worker1 # [ 45.835927] nix-grpc-daemon[862]: time=2026-09-22T13:46:00.108Z level=INFO msg="Upload complete. (244ms)" lb # [ 45.834817] niks3-server[1008]: 2026/09/22 13:46:00 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls worker1 # [ 45.838117] nix-grpc-daemon[782]: ts=2026-09-22T13:46:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 45.837543] niks3-server[1008]: 2026/09/22 13:46:00 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 45.842901] nix-grpc-daemon[782]: ts=2026-09-22T13:46:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 45.848488] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 45.850712] nix-daemon[848]: reaped child process 992, status = succeeded worker1 # [ 45.855806] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 47.298572] nix-daemon[848]: reaped child process 1006, status = succeeded worker1 # [ 47.366045] nix-daemon[848]: accepted connection from pid 1022, user nix-grpc-daemon (trusted) worker1 # [ 47.378816] nix-daemon[848]: reaped child process 1025, status = succeeded lb # [ 47.381788] niks3-server[1008]: 2026/09/22 13:46:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 47.393627] nix-grpc-daemon[862]: time=2026-09-22T13:46:01.666Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 47.395100] nix-grpc-daemon[862]: time=2026-09-22T13:46:01.667Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 47.421689] niks3-server[1008]: 2026/09/22 13:46:02 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 47.433127] niks3-server[1008]: 2026/09/22 13:46:02 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 47.438531] niks3-server[1008]: 2026/09/22 13:46:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 47.449441] nix-grpc-daemon[862]: time=2026-09-22T13:46:01.721Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.447119] niks3-server[1008]: 2026/09/22 13:46:02 INFO Signed narinfos id=8 count=1 lb # [ 47.455292] niks3-server[1008]: 2026/09/22 13:46:02 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 47.463854] niks3-server[1008]: 2026/09/22 13:46:02 INFO Completed upload id=8 worker1 # [ 47.466577] nix-grpc-daemon[862]: time=2026-09-22T13:46:01.739Z level=INFO msg="Upload complete. (202ms)" lb # [ 47.467834] niks3-server[1008]: 2026/09/22 13:46:02 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 47.470391] niks3-server[1008]: 2026/09/22 13:46:02 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 47.472760] nix-grpc-daemon[782]: ts=2026-09-22T13:46:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 47.489766] nix-daemon[848]: reaped child process 1004, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.15 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.12 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.49 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 47.871429] nix-grpc-daemon[784]: ts=2026-09-22T13:46:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 worker1 # [ 47.866408] nix-grpc-daemon[782]: ts=2026-09-22T13:46:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 47.897252] nix-grpc-daemon[784]: ts=2026-09-22T13:46:02Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 47.903653] nix-grpc-daemon[784]: ts=2026-09-22T13:46:02Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 47.908720] nix-grpc-daemon[784]: ts=2026-09-22T13:46:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 47.920573] nix-grpc-daemon[784]: ts=2026-09-22T13:46:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker2 # [ 47.932173] nix-grpc-daemon[784]: ts=2026-09-22T13:46:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 47.944313] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 47.964895] nix-grpc-daemon[784]: ts=2026-09-22T13:46:03Z level=info event=niks3_push_started pid=922 worker2 # [ 48.091220] nix-grpc-daemon[922]: time=2026-09-22T13:46:03.152Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 48.181157] nix-daemon[870]: accepted connection from pid 935, user nix-grpc-daemon (trusted) worker2 # [ 48.196070] nix-daemon[870]: reaped child process 938, status = succeeded worker2 # [ 48.279375] nix-daemon[870]: accepted connection from pid 940, user nix-grpc-daemon (trusted) worker2 # [ 48.293269] nix-daemon[870]: reaped child process 943, status = succeeded lb # [ 48.287425] niks3-server[1008]: 2026/09/22 13:46:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.306992] nix-grpc-daemon[922]: time=2026-09-22T13:46:03.369Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 48.309023] nix-grpc-daemon[922]: time=2026-09-22T13:46:03.371Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 48.320631] niks3-server[1008]: 2026/09/22 13:46:03 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 48.328131] niks3-server[1008]: 2026/09/22 13:46:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 48.333251] niks3-server[1008]: 2026/09/22 13:46:03 INFO Signed narinfos id=9 count=1 worker2 # [ 48.348177] nix-grpc-daemon[922]: time=2026-09-22T13:46:03.410Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.347763] niks3-server[1008]: 2026/09/22 13:46:03 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 48.352600] niks3-server[1008]: 2026/09/22 13:46:03 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 48.359723] niks3-server[1008]: 2026/09/22 13:46:03 INFO Completed upload id=9 worker2 # [ 48.373659] nix-grpc-daemon[922]: time=2026-09-22T13:46:03.436Z level=INFO msg="Upload complete. (279ms)" lb # [ 48.364697] niks3-server[1008]: 2026/09/22 13:46:03 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker2 # [ 48.376135] nix-grpc-daemon[784]: ts=2026-09-22T13:46:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 48.383745] nix-grpc-daemon[784]: ts=2026-09-22T13:46:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 48.394891] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 48.397219] nix-daemon[870]: reaped child process 920, status = succeeded worker2 # [ 48.402493] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker2 # [ 49.218359] nix-daemon[870]: reaped child process 947, status = succeeded worker2 # [ 49.292872] nix-daemon[870]: accepted connection from pid 963, user nix-grpc-daemon (trusted) worker2 # [ 49.307236] nix-daemon[870]: reaped child process 966, status = succeeded lb # [ 49.301842] niks3-server[1008]: 2026/09/22 13:46:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.322046] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.384Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 49.323554] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.386Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 49.336162] niks3-server[1008]: 2026/09/22 13:46:04 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 49.349374] niks3-server[1008]: 2026/09/22 13:46:04 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 49.363663] niks3-server[1008]: 2026/09/22 13:46:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 49.367950] niks3-server[1008]: 2026/09/22 13:46:04 INFO Signed narinfos id=10 count=1 worker2 # [ 49.382706] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.444Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.377083] niks3-server[1008]: 2026/09/22 13:46:04 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 49.384650] niks3-server[1008]: 2026/09/22 13:46:04 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 49.388506] niks3-server[1008]: 2026/09/22 13:46:04 INFO Completed upload id=10 worker2 # [ 49.401578] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.464Z level=INFO msg="Upload complete. (192ms)" lb # [ 49.391036] niks3-server[1008]: 2026/09/22 13:46:04 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 49.404567] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 49.411148] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker2 # [ 49.413159] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 49.418747] nix-daemon[870]: reaped child process 945, status = succeeded worker2 # [ 49.454932] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 49.463505] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 49.471548] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.534Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 49.477066] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker2 # [ 49.481988] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 49.571264] nix-daemon[870]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker2 # [ 49.586462] nix-daemon[870]: reaped child process 975, status = succeeded worker2 # [ 49.668914] nix-daemon[870]: accepted connection from pid 977, user nix-grpc-daemon (trusted) worker2 # [ 49.683233] nix-daemon[870]: reaped child process 980, status = succeeded lb # [ 49.677089] niks3-server[1008]: 2026/09/22 13:46:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.696394] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.759Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 49.698386] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.760Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 49.706150] niks3-server[1008]: 2026/09/22 13:46:04 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 49.717321] niks3-server[1008]: 2026/09/22 13:46:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 49.724824] niks3-server[1008]: 2026/09/22 13:46:04 INFO Signed narinfos id=11 count=1 worker2 # [ 49.739593] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.802Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.732114] niks3-server[1008]: 2026/09/22 13:46:04 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 49.743704] niks3-server[1008]: 2026/09/22 13:46:04 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 49.750706] niks3-server[1008]: 2026/09/22 13:46:04 INFO Completed upload id=11 worker2 # [ 49.762720] nix-grpc-daemon[922]: time=2026-09-22T13:46:04.825Z level=INFO msg="Upload complete. (273ms)" lb # [ 49.753621] niks3-server[1008]: 2026/09/22 13:46:04 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 49.766904] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 49.771765] nix-grpc-daemon[784]: ts=2026-09-22T13:46:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 49.782062] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 49.787925] nix-daemon[870]: reaped child process 970, status = succeeded worker2 # [ 49.792123] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker2 # [ 50.609931] nix-daemon[870]: reaped child process 984, status = succeeded worker2 # [ 50.683804] nix-daemon[870]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker2 # [ 50.696412] nix-daemon[870]: reaped child process 1003, status = succeeded lb # [ 50.690048] niks3-server[1008]: 2026/09/22 13:46:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.708123] nix-grpc-daemon[922]: time=2026-09-22T13:46:05.770Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 50.709609] nix-grpc-daemon[922]: time=2026-09-22T13:46:05.772Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 50.713166] niks3-server[1008]: 2026/09/22 13:46:05 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 50.716431] niks3-server[1008]: 2026/09/22 13:46:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 50.720072] niks3-server[1008]: 2026/09/22 13:46:05 INFO Signed narinfos id=12 count=1 worker2 # [ 50.731914] nix-grpc-daemon[922]: time=2026-09-22T13:46:05.794Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.721144] niks3-server[1008]: 2026/09/22 13:46:05 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 50.723264] niks3-server[1008]: 2026/09/22 13:46:05 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 50.728972] niks3-server[1008]: 2026/09/22 13:46:05 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 50.732055] niks3-server[1008]: 2026/09/22 13:46:05 INFO Completed upload id=12 worker2 # [ 50.743817] nix-grpc-daemon[922]: time=2026-09-22T13:46:05.806Z level=INFO msg="Upload complete. (145ms)" lb # [ 50.735245] niks3-server[1008]: 2026/09/22 13:46:05 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 50.747357] nix-grpc-daemon[784]: ts=2026-09-22T13:46:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 50.753629] nix-grpc-daemon[784]: ts=2026-09-22T13:46:05Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker2 # [ 50.755590] nix-grpc-daemon[784]: ts=2026-09-22T13:46:05Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 50.760724] nix-daemon[870]: reaped child process 982, status = succeeded worker2 # [ 50.796972] nix-grpc-daemon[784]: ts=2026-09-22T13:46:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 50.808785] nix-grpc-daemon[784]: ts=2026-09-22T13:46:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 50.819547] nix-grpc-daemon[922]: time=2026-09-22T13:46:05.882Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker2 # [ 50.827343] nix-grpc-daemon[784]: ts=2026-09-22T13:46:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 50.836312] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 50.927469] nix-daemon[870]: accepted connection from pid 1009, user nix-grpc-daemon (trusted) worker2 # [ 50.942396] nix-daemon[870]: reaped child process 1012, status = succeeded worker2 # [ 51.025277] nix-daemon[870]: accepted connection from pid 1014, user nix-grpc-daemon (trusted) worker2 # [ 51.039035] nix-daemon[870]: reaped child process 1017, status = succeeded lb # [ 51.034356] niks3-server[1008]: 2026/09/22 13:46:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.055875] nix-grpc-daemon[922]: time=2026-09-22T13:46:06.118Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 51.057340] nix-grpc-daemon[922]: time=2026-09-22T13:46:06.118Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 51.064644] niks3-server[1008]: 2026/09/22 13:46:06 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 51.074212] niks3-server[1008]: 2026/09/22 13:46:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 51.079354] niks3-server[1008]: 2026/09/22 13:46:06 INFO Signed narinfos id=13 count=1 worker2 # [ 51.094096] nix-grpc-daemon[922]: time=2026-09-22T13:46:06.156Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.087567] niks3-server[1008]: 2026/09/22 13:46:06 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 51.096813] niks3-server[1008]: 2026/09/22 13:46:06 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 51.101342] niks3-server[1008]: 2026/09/22 13:46:06 INFO Completed upload id=13 worker2 # [ 51.113143] nix-grpc-daemon[922]: time=2026-09-22T13:46:06.175Z level=INFO msg="Upload complete. (268ms)" worker2 # [ 51.115263] nix-grpc-daemon[784]: ts=2026-09-22T13:46:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 51.104572] niks3-server[1008]: 2026/09/22 13:46:06 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 51.118509] nix-grpc-daemon[784]: ts=2026-09-22T13:46:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 51.127409] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 51.128734] nix-daemon[870]: reaped child process 1007, status = succeeded worker2 # [ 51.134070] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker2 # [ 52.179407] nix-daemon[870]: reaped child process 1021, status = succeeded worker2 # [ 52.248296] nix-daemon[870]: accepted connection from pid 1037, user nix-grpc-daemon (trusted) worker2 # [ 52.261664] nix-daemon[870]: reaped child process 1040, status = succeeded lb # [ 52.260605] niks3-server[1008]: 2026/09/22 13:46:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.279745] nix-grpc-daemon[922]: time=2026-09-22T13:46:07.342Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 52.281268] nix-grpc-daemon[922]: time=2026-09-22T13:46:07.343Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 52.293549] niks3-server[1008]: 2026/09/22 13:46:07 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 52.305555] niks3-server[1008]: 2026/09/22 13:46:07 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 52.317102] niks3-server[1008]: 2026/09/22 13:46:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 52.323544] niks3-server[1008]: 2026/09/22 13:46:07 INFO Signed narinfos id=14 count=1 worker2 # [ 52.335140] nix-grpc-daemon[922]: time=2026-09-22T13:46:07.397Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.326326] niks3-server[1008]: 2026/09/22 13:46:07 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 52.333365] niks3-server[1008]: 2026/09/22 13:46:07 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 52.337238] niks3-server[1008]: 2026/09/22 13:46:07 INFO Completed upload id=14 worker2 # [ 52.349136] nix-grpc-daemon[922]: time=2026-09-22T13:46:07.411Z level=INFO msg="Upload complete. (207ms)" lb # [ 52.339341] niks3-server[1008]: 2026/09/22 13:46:07 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker2 # [ 52.355721] nix-grpc-daemon[784]: ts=2026-09-22T13:46:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker2 # [ 52.370985] nix-daemon[870]: reaped child process 1019, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 4.65 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.12 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 52.617871] nix-grpc-daemon[782]: ts=2026-09-22T13:46:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:53662 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 52.645588] nix-grpc-daemon[782]: ts=2026-09-22T13:46:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:53662 worker1 # [ 52.652087] nix-grpc-daemon[782]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 52.665835] nix-grpc-daemon[782]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 52.678531] nix-grpc-daemon[782]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.21 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 52.840652] nix-grpc-daemon[784]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:58748 worker2 # [ 52.847624] nix-grpc-daemon[784]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:58748 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.18 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/903" client # removing stale temporary roots file "/nix/var/nix/temproots/859" client # removing stale temporary roots file "/nix/var/nix/temproots/867" client # removing stale temporary roots file "/nix/var/nix/temproots/888" client # removing stale temporary roots file "/nix/var/nix/temproots/880" client # removing stale temporary roots file "/nix/var/nix/temproots/847" client # removing stale temporary roots file "/nix/var/nix/temproots/826" client # removing stale temporary roots file "/nix/var/nix/temproots/810" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 53.137597] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 53.144350] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 53.149913] nix-grpc-daemon[922]: time=2026-09-22T13:46:08.211Z level=INFO msg="All 1 paths already cached" worker1 # [ 53.143499] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 53.159420] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36480 client # copying 3 paths... worker2 # [ 53.168700] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36480 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 53.173061] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 53.187071] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 worker1 # [ 53.178845] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 53.195069] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 53.198778] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 53.203258] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.37 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 5.52 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 53.308674] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 210881a480c84b20bd511df25eff66c3 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup worker2 # [ 53.423936] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 client # [ 53.445578] nix[956]: don't know how to build these paths: client # [ 53.446488] nix[956]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 53.435195] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 53.439777] nix-grpc-daemon[784]: ts=2026-09-22T13:46:08Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 53.432955] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 53.442671] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 client # [ 53.476079] nix[956]: copying 1 paths to 'lb:50051'... client # [ 53.476815] nix[956]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 53.451537] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 53.462088] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 53.566531] nix-daemon[848]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 53.581897] nix-daemon[848]: reaped child process 1035, status = succeeded worker1 # [ 53.661208] nix-daemon[848]: accepted connection from pid 1037, user nix-grpc-daemon (trusted) worker1 # [ 53.675622] nix-daemon[848]: reaped child process 1040, status = succeeded lb # [ 53.679338] niks3-server[1008]: 2026/09/22 13:46:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.688241] nix-grpc-daemon[862]: time=2026-09-22T13:46:07.960Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 53.690047] nix-grpc-daemon[862]: time=2026-09-22T13:46:07.962Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 53.696463] niks3-server[1008]: 2026/09/22 13:46:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 53.699418] niks3-server[1008]: 2026/09/22 13:46:08 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 53.702281] niks3-server[1008]: 2026/09/22 13:46:08 INFO Signed narinfos id=15 count=1 worker1 # [ 53.706412] nix-grpc-daemon[862]: time=2026-09-22T13:46:07.979Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.704341] niks3-server[1008]: 2026/09/22 13:46:08 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 53.709097] niks3-server[1008]: 2026/09/22 13:46:08 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 53.712980] niks3-server[1008]: 2026/09/22 13:46:08 INFO Completed upload id=15 worker1 # [ 53.715837] nix-grpc-daemon[862]: time=2026-09-22T13:46:07.988Z level=INFO msg="Upload complete. (242ms)" worker1 # [ 53.717981] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 53.715860] niks3-server[1008]: 2026/09/22 13:46:08 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 53.721065] nix-grpc-daemon[782]: ts=2026-09-22T13:46:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 53.726131] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 53.732823] nix-daemon[848]: reaped child process 1030, status = succeeded client # [ 53.760097] nix[956]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker1 # [ 53.735722] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # [ 54.347856] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 5383cf0578d1460698d3a8ab251fa84e client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.04 seconds) worker2 # [ 54.469764] nix-grpc-daemon[784]: ts=2026-09-22T13:46:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 client # [ 54.491797] nix[972]: don't know how to build these paths: client # [ 54.492791] nix[972]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 54.482413] nix-grpc-daemon[784]: ts=2026-09-22T13:46:09Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 54.478200] nix-grpc-daemon[782]: ts=2026-09-22T13:46:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 client # [ 54.505821] nix[972]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 lb # [ 55.582890] envoy[917]: conn peer=[2001:db8:1::1]:36590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1894 ms=1989 lb # [ 55.586745] envoy[917]: conn peer=[2001:db8:1::1]:36600 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=4378 ms=4505 lb # [ 55.590576] envoy[917]: conn peer=[2001:db8:1::1]:41188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2889 ms=120 lb # [ 55.594963] envoy[917]: conn peer=[2001:db8:1::1]:41216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=64 lb # [ 55.598569] envoy[917]: conn peer=[2001:db8:1::1]:41212 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=69 lb # [ 55.602169] envoy[917]: conn peer=[2001:db8:1::1]:41204 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=75 client: (finished: must succeed: sleep 2, in 2.03 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 57.781666] nix-daemon[848]: reaped child process 1044, status = succeeded worker1 # [ 57.852739] nix-daemon[848]: accepted connection from pid 1074, user nix-grpc-daemon (trusted) lb # [ 57.863663] niks3-server[1008]: 2026/09/22 13:46:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.866970] nix-daemon[848]: reaped child process 1077, status = succeeded worker1 # [ 57.871857] nix-grpc-daemon[862]: time=2026-09-22T13:46:12.144Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 57.876145] nix-grpc-daemon[862]: time=2026-09-22T13:46:12.146Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 57.887332] niks3-server[1008]: 2026/09/22 13:46:13 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 57.892182] niks3-server[1008]: 2026/09/22 13:46:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 57.895084] niks3-server[1008]: 2026/09/22 13:46:13 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 57.898049] niks3-server[1008]: 2026/09/22 13:46:13 INFO Signed narinfos id=16 count=1 worker1 # [ 57.902347] nix-grpc-daemon[862]: time=2026-09-22T13:46:12.174Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.901250] niks3-server[1008]: 2026/09/22 13:46:13 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 57.908195] niks3-server[1008]: 2026/09/22 13:46:13 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 57.914503] niks3-server[1008]: 2026/09/22 13:46:13 INFO Completed upload id=16 worker1 # [ 57.917347] nix-grpc-daemon[862]: time=2026-09-22T13:46:12.190Z level=INFO msg="Upload complete. (171ms)" lb # [ 57.916628] niks3-server[1008]: 2026/09/22 13:46:13 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker1 # [ 57.920194] nix-grpc-daemon[782]: ts=2026-09-22T13:46:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 57.923091] nix-grpc-daemon[782]: ts=2026-09-22T13:46:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 57.929761] nix-daemon[848]: reaped child process 1042, status = succeeded client # [ 57.997982] systemd[1]: dedup1.service: Deactivated successfully. client # [ 58.002139] systemd[1]: dedup1.service: Consumed 116ms CPU time over 4.692s wall clock time, 39.5M memory peak, 7.1K incoming IP traffic, 8.2K outgoing IP traffic. client # [ 58.010564] systemd[1]: dedup2.service: Deactivated successfully. client # [ 58.012720] systemd[1]: dedup2.service: Consumed 129ms CPU time over 3.662s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.60 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 58.991069] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 59.001749] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 59.006628] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 59.013355] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 59.020887] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 59.031918] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 59.043393] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 59.139865] nix-daemon[870]: accepted connection from pid 1072, user nix-grpc-daemon (trusted) worker2 # [ 59.155044] nix-daemon[870]: reaped child process 1075, status = succeeded worker2 # [ 59.235216] nix-daemon[870]: accepted connection from pid 1077, user nix-grpc-daemon (trusted) worker2 # [ 59.249084] nix-daemon[870]: reaped child process 1080, status = succeeded lb # [ 59.244612] niks3-server[1008]: 2026/09/22 13:46:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 59.264756] nix-grpc-daemon[922]: time=2026-09-22T13:46:14.327Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 59.266342] nix-grpc-daemon[922]: time=2026-09-22T13:46:14.328Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 59.278518] niks3-server[1008]: 2026/09/22 13:46:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 59.288764] niks3-server[1008]: 2026/09/22 13:46:14 INFO Signed narinfos id=17 count=1 worker2 # [ 59.303874] nix-grpc-daemon[922]: time=2026-09-22T13:46:14.366Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.295303] niks3-server[1008]: 2026/09/22 13:46:14 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 59.302138] niks3-server[1008]: 2026/09/22 13:46:14 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 59.311790] niks3-server[1008]: 2026/09/22 13:46:14 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 59.320387] niks3-server[1008]: 2026/09/22 13:46:14 INFO Completed upload id=17 worker2 # [ 59.332320] nix-grpc-daemon[922]: time=2026-09-22T13:46:14.394Z level=INFO msg="Upload complete. (278ms)" lb # [ 59.326352] niks3-server[1008]: 2026/09/22 13:46:14 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 59.336133] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 59.341132] nix-grpc-daemon[784]: ts=2026-09-22T13:46:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 59.352120] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 59.357461] nix-daemon[870]: reaped child process 1070, status = succeeded worker2 # [ 59.362161] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 65.177104] nix-grpc-daemon[784]: ts=2026-09-22T13:46:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=5 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker2 # [ 65.202727] nix-daemon[870]: reaped child process 1082, status = succeeded worker2 # [ 65.205241] nix-daemon[870]: reaped child process 1084, status = succeeded worker2 # [ 65.351608] nix-grpc-daemon[784]: ts=2026-09-22T13:46:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 65.362177] nix-grpc-daemon[784]: ts=2026-09-22T13:46:20Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker1 # [ 65.356459] nix-grpc-daemon[782]: ts=2026-09-22T13:46:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 65.366492] nix-grpc-daemon[784]: ts=2026-09-22T13:46:20Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 65.364593] nix-grpc-daemon[782]: ts=2026-09-22T13:46:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 65.371410] nix-grpc-daemon[782]: ts=2026-09-22T13:46:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 65.377256] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 65.463097] nix-daemon[848]: accepted connection from pid 1090, user nix-grpc-daemon (trusted) worker1 # [ 65.476806] nix-daemon[848]: reaped child process 1093, status = succeeded worker1 # [ 65.555618] nix-daemon[848]: accepted connection from pid 1095, user nix-grpc-daemon (trusted) worker1 # [ 65.569258] nix-daemon[848]: reaped child process 1098, status = succeeded lb # [ 65.571321] niks3-server[1008]: 2026/09/22 13:46:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.582482] nix-grpc-daemon[862]: time=2026-09-22T13:46:19.854Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 65.583867] nix-grpc-daemon[862]: time=2026-09-22T13:46:19.854Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 65.583821] envoy[917]: conn peer=[2001:db8:1::1]:41240 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1197 ms=3485 lb # [ 65.588503] envoy[917]: conn peer=[2001:db8:1::1]:41226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2981 tx=1519 ms=4523 lb # [ 65.593184] envoy[917]: conn peer=[2001:db8:1::1]:41248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=960 ms=6236 lb # [ 65.610405] niks3-server[1008]: 2026/09/22 13:46:20 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 65.628111] niks3-server[1008]: 2026/09/22 13:46:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 65.631374] niks3-server[1008]: 2026/09/22 13:46:20 INFO Signed narinfos id=18 count=1 worker1 # [ 65.634610] nix-grpc-daemon[862]: time=2026-09-22T13:46:19.907Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.637592] niks3-server[1008]: 2026/09/22 13:46:20 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 65.642048] niks3-server[1008]: 2026/09/22 13:46:20 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 65.646547] niks3-server[1008]: 2026/09/22 13:46:20 INFO Completed upload id=18 worker1 # [ 65.649343] nix-grpc-daemon[862]: time=2026-09-22T13:46:19.922Z level=INFO msg="Upload complete. (267ms)" lb # [ 65.648701] niks3-server[1008]: 2026/09/22 13:46:20 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 65.651948] nix-grpc-daemon[782]: ts=2026-09-22T13:46:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 65.655636] nix-grpc-daemon[782]: ts=2026-09-22T13:46:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 65.661295] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 65.668051] nix-daemon[848]: reaped child process 1088, status = succeeded worker1 # [ 65.671084] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 71.283684] nix-grpc-daemon[782]: ts=2026-09-22T13:46:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker1 # [ 71.309618] nix-daemon[848]: reaped child process 1100, status = succeeded worker1 # [ 71.313335] nix-daemon[848]: reaped child process 1102, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 12.56 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 71.491637] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 0c2d928566c04d79873d03d3b5e77f51 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 71.635793] nix[1046]: don't know how to build these paths: client # [ 71.636763] nix[1046]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 71.608994] nix-grpc-daemon[782]: ts=2026-09-22T13:46:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 71.627931] nix-grpc-daemon[784]: ts=2026-09-22T13:46:26Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 71.633784] nix-grpc-daemon[784]: ts=2026-09-22T13:46:26Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 71.640474] nix-grpc-daemon[784]: ts=2026-09-22T13:46:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 71.651244] nix-grpc-daemon[784]: ts=2026-09-22T13:46:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 client # [ 71.676086] nix[1046]: copying 1 paths to 'lb:50051'... worker2 # [ 71.660385] nix-grpc-daemon[784]: ts=2026-09-22T13:46:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 client # [ 71.676871] nix[1046]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 71.666724] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 71.751602] nix-daemon[870]: accepted connection from pid 1111, user nix-grpc-daemon (trusted) worker2 # [ 71.766946] nix-daemon[870]: reaped child process 1114, status = succeeded worker2 # [ 71.852207] nix-daemon[870]: accepted connection from pid 1116, user nix-grpc-daemon (trusted) worker2 # [ 71.866320] nix-daemon[870]: reaped child process 1119, status = succeeded lb # [ 71.862884] niks3-server[1008]: 2026/09/22 13:46:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.882974] nix-grpc-daemon[922]: time=2026-09-22T13:46:26.945Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 71.884445] nix-grpc-daemon[922]: time=2026-09-22T13:46:26.945Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 71.894176] niks3-server[1008]: 2026/09/22 13:46:27 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 71.908483] niks3-server[1008]: 2026/09/22 13:46:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 71.914833] niks3-server[1008]: 2026/09/22 13:46:27 INFO Signed narinfos id=19 count=1 worker2 # [ 71.930334] nix-grpc-daemon[922]: time=2026-09-22T13:46:26.992Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.929491] niks3-server[1008]: 2026/09/22 13:46:27 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 71.936967] niks3-server[1008]: 2026/09/22 13:46:27 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 71.944391] niks3-server[1008]: 2026/09/22 13:46:27 INFO Completed upload id=19 lb # [ 71.946296] niks3-server[1008]: 2026/09/22 13:46:27 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 71.957758] nix-grpc-daemon[922]: time=2026-09-22T13:46:27.020Z level=INFO msg="Upload complete. (286ms)" worker2 # [ 71.962374] nix-grpc-daemon[784]: ts=2026-09-22T13:46:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 71.967279] nix-grpc-daemon[784]: ts=2026-09-22T13:46:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 71.977529] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 71.988124] nix-daemon[870]: reaped child process 1109, status = succeeded worker2 # [ 71.991102] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # [ 72.007145] nix[1046]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 72.556928] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 5eac953f781740bbace1b934ece57829 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) worker2 # [ 72.684518] nix-grpc-daemon[784]: ts=2026-09-22T13:46:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36480 client # [ 72.708064] nix[1062]: this derivation will be built: worker2 # [ 72.692632] nix-grpc-daemon[784]: ts=2026-09-22T13:46:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36480 client # [ 72.711815] nix[1062]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 72.700433] nix-grpc-daemon[784]: ts=2026-09-22T13:46:27Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 72.702611] nix-grpc-daemon[784]: ts=2026-09-22T13:46:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 client # [ 72.720884] nix[1062]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 lb # [ 75.584833] envoy[917]: conn peer=[2001:db8:1::1]:34022 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=933 ms=5994 client # [ 75.807237] systemd[1]: share1.service: Sent signal SIGINT to main process 1046 (nix) on client request. client # [ 75.809926] nix[1046]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.04 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 75.814056] nix[1046]: error: interrupted by the user client # [ 75.838567] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 75.840215] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 75.842059] systemd[1]: share1.service: Consumed 114ms CPU time over 4.349s wall clock time, 41.5M memory peak, 6.2K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.06 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 77.235395] nix-daemon[870]: reaped child process 1123, status = succeeded worker2 # [ 77.315334] nix-daemon[870]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker2 # [ 77.329515] nix-daemon[870]: reaped child process 1162, status = succeeded lb # [ 77.325408] niks3-server[1008]: 2026/09/22 13:46:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 77.347652] nix-grpc-daemon[922]: time=2026-09-22T13:46:32.410Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 77.349209] nix-grpc-daemon[922]: time=2026-09-22T13:46:32.411Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 77.365448] niks3-server[1008]: 2026/09/22 13:46:32 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 77.380147] niks3-server[1008]: 2026/09/22 13:46:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 77.384648] niks3-server[1008]: 2026/09/22 13:46:32 INFO Signed narinfos id=20 count=1 worker2 # [ 77.399249] nix-grpc-daemon[922]: time=2026-09-22T13:46:32.461Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.391596] niks3-server[1008]: 2026/09/22 13:46:32 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 77.397437] niks3-server[1008]: 2026/09/22 13:46:32 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 77.403252] niks3-server[1008]: 2026/09/22 13:46:32 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 77.405789] niks3-server[1008]: 2026/09/22 13:46:32 INFO Completed upload id=20 lb # [ 77.408780] niks3-server[1008]: 2026/09/22 13:46:32 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 77.418910] nix-grpc-daemon[922]: time=2026-09-22T13:46:32.481Z level=INFO msg="Upload complete. (214ms)" worker2 # [ 77.427320] nix-grpc-daemon[784]: ts=2026-09-22T13:46:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 77.433267] nix-grpc-daemon[784]: ts=2026-09-22T13:46:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 77.445525] nix-daemon[870]: reaped child process 1121, status = succeeded client # [ 77.513313] systemd[1]: share2.service: Deactivated successfully. client # [ 77.516980] systemd[1]: share2.service: Consumed 123ms CPU time over 4.959s wall clock time, 35.4M memory peak, 6.6K incoming IP traffic, 6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.72 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 78.260458] systemd[1]: Started Nix Daemon. client # [ 78.350275] nix-daemon[1114]: accepted connection from pid 1111, user root (trusted) worker2 # [ 78.452583] nix-grpc-daemon[784]: ts=2026-09-22T13:46:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36480 worker1 # [ 78.448102] nix-grpc-daemon[782]: ts=2026-09-22T13:46:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 78.464879] nix-grpc-daemon[784]: ts=2026-09-22T13:46:33Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 78.467025] nix-grpc-daemon[784]: ts=2026-09-22T13:46:33Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 78.462928] nix-grpc-daemon[782]: ts=2026-09-22T13:46:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 78.474887] nix-grpc-daemon[782]: ts=2026-09-22T13:46:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 78.486130] nix-grpc-daemon[782]: ts=2026-09-22T13:46:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 78.496899] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 78.592475] nix-daemon[848]: accepted connection from pid 1141, user nix-grpc-daemon (trusted) worker1 # [ 78.605102] nix-daemon[848]: reaped child process 1144, status = succeeded worker1 # [ 78.679085] nix-daemon[848]: accepted connection from pid 1146, user nix-grpc-daemon (trusted) worker1 # [ 78.692807] nix-daemon[848]: reaped child process 1149, status = succeeded lb # [ 78.690580] niks3-server[1008]: 2026/09/22 13:46:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.702183] nix-grpc-daemon[862]: time=2026-09-22T13:46:32.974Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 78.703990] nix-grpc-daemon[862]: time=2026-09-22T13:46:32.976Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 78.715981] niks3-server[1008]: 2026/09/22 13:46:33 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 78.732734] niks3-server[1008]: 2026/09/22 13:46:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 78.742170] nix-grpc-daemon[862]: time=2026-09-22T13:46:33.014Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.739193] niks3-server[1008]: 2026/09/22 13:46:33 INFO Signed narinfos id=21 count=1 lb # [ 78.745993] niks3-server[1008]: 2026/09/22 13:46:33 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 78.755784] niks3-server[1008]: 2026/09/22 13:46:33 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 78.761052] niks3-server[1008]: 2026/09/22 13:46:33 INFO Completed upload id=21 worker1 # [ 78.763434] nix-grpc-daemon[862]: time=2026-09-22T13:46:33.036Z level=INFO msg="Upload complete. (255ms)" worker1 # [ 78.766509] nix-grpc-daemon[782]: ts=2026-09-22T13:46:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 78.771537] nix-grpc-daemon[782]: ts=2026-09-22T13:46:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 78.780471] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 78.786261] nix-daemon[848]: reaped child process 1139, status = succeeded worker1 # [ 78.790374] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 79.828382] nix-daemon[848]: reaped child process 1153, status = succeeded worker1 # [ 79.900946] nix-daemon[848]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker1 # [ 79.911802] nix-daemon[848]: reaped child process 1172, status = succeeded lb # [ 79.918322] niks3-server[1008]: 2026/09/22 13:46:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.929379] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.201Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 79.930877] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.203Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 79.954073] niks3-server[1008]: 2026/09/22 13:46:35 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 79.968847] niks3-server[1008]: 2026/09/22 13:46:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 79.983250] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.255Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.980533] niks3-server[1008]: 2026/09/22 13:46:35 INFO Signed narinfos id=22 count=1 lb # [ 79.984490] niks3-server[1008]: 2026/09/22 13:46:35 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 79.988890] niks3-server[1008]: 2026/09/22 13:46:35 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 79.999079] niks3-server[1008]: 2026/09/22 13:46:35 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 80.003329] niks3-server[1008]: 2026/09/22 13:46:35 INFO Completed upload id=22 worker1 # [ 80.006437] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.279Z level=INFO msg="Upload complete. (209ms)" lb # [ 80.006072] niks3-server[1008]: 2026/09/22 13:46:35 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 80.012741] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker2 # [ 80.027814] nix-grpc-daemon[784]: ts=2026-09-22T13:46:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36480 worker1 # [ 80.026881] nix-daemon[848]: reaped child process 1151, status = succeeded worker2 # [ 80.037490] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 80.066720] nix-grpc-daemon[784]: ts=2026-09-22T13:46:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 80.071946] nix-grpc-daemon[784]: ts=2026-09-22T13:46:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 80.272103] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 80.277821] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 80.283142] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.554Z level=INFO msg="All 1 paths already cached" worker2 # [ 80.302407] nix-grpc-daemon[784]: ts=2026-09-22T13:46:35Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 80.307329] nix-grpc-daemon[784]: ts=2026-09-22T13:46:35Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 80.300878] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 80.312807] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 80.325067] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.597Z level=INFO msg="All 1 paths already cached" worker1 # [ 80.332167] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 80.339888] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 80.442212] nix-daemon[848]: accepted connection from pid 1176, user nix-grpc-daemon (trusted) worker1 # [ 80.455043] nix-daemon[848]: reaped child process 1179, status = succeeded worker1 # [ 80.534111] nix-daemon[848]: accepted connection from pid 1181, user nix-grpc-daemon (trusted) worker1 # [ 80.546218] nix-daemon[848]: reaped child process 1184, status = succeeded lb # [ 80.549846] niks3-server[1008]: 2026/09/22 13:46:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 80.557389] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.829Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 80.558771] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.829Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 80.562671] niks3-server[1008]: 2026/09/22 13:46:35 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 80.567939] niks3-server[1008]: 2026/09/22 13:46:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 80.570411] niks3-server[1008]: 2026/09/22 13:46:35 INFO Signed narinfos id=23 count=1 worker1 # [ 80.573302] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.845Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.574602] niks3-server[1008]: 2026/09/22 13:46:35 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 80.579255] niks3-server[1008]: 2026/09/22 13:46:35 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 80.583590] niks3-server[1008]: 2026/09/22 13:46:35 INFO Completed upload id=23 worker1 # [ 80.586496] nix-grpc-daemon[862]: time=2026-09-22T13:46:34.859Z level=INFO msg="Upload complete. (233ms)" worker1 # [ 80.588485] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 80.586666] niks3-server[1008]: 2026/09/22 13:46:35 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 80.592161] nix-grpc-daemon[782]: ts=2026-09-22T13:46:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 80.598432] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 80.600638] nix-daemon[848]: reaped child process 1174, status = succeeded worker1 # [ 80.605629] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 81.840965] nix-daemon[848]: reaped child process 1188, status = succeeded worker1 # [ 81.925408] nix-daemon[848]: accepted connection from pid 1204, user nix-grpc-daemon (trusted) worker1 # [ 81.937500] nix-daemon[848]: reaped child process 1207, status = succeeded lb # [ 81.942425] niks3-server[1008]: 2026/09/22 13:46:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 81.950190] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.222Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 81.951669] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.224Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 81.967238] niks3-server[1008]: 2026/09/22 13:46:37 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 81.971900] niks3-server[1008]: 2026/09/22 13:46:37 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 81.975272] niks3-server[1008]: 2026/09/22 13:46:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 81.977670] niks3-server[1008]: 2026/09/22 13:46:37 INFO Signed narinfos id=24 count=1 worker1 # [ 81.980599] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.253Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.980940] niks3-server[1008]: 2026/09/22 13:46:37 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 81.985823] niks3-server[1008]: 2026/09/22 13:46:37 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 81.989239] niks3-server[1008]: 2026/09/22 13:46:37 INFO Completed upload id=24 worker1 # [ 81.992216] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.264Z level=INFO msg="Upload complete. (179ms)" lb # [ 81.992341] niks3-server[1008]: 2026/09/22 13:46:37 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 81.995604] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker1 # [ 82.001124] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 82.006088] nix-daemon[848]: reaped child process 1186, status = succeeded worker1 # [ 82.011268] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 82.013683] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 82.232876] nix-grpc-daemon[784]: ts=2026-09-22T13:46:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36480 worker1 # [ 82.226748] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 82.235427] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.508Z level=INFO msg="All 2 paths already cached" worker2 # [ 82.258936] nix-grpc-daemon[784]: ts=2026-09-22T13:46:37Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 82.263939] nix-grpc-daemon[784]: ts=2026-09-22T13:46:37Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 82.257390] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 82.269724] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 82.282404] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.555Z level=INFO msg="All 2 paths already cached" worker1 # [ 82.289863] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 82.299347] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 82.391372] nix-daemon[848]: accepted connection from pid 1211, user nix-grpc-daemon (trusted) worker1 # [ 82.406073] nix-daemon[848]: reaped child process 1214, status = succeeded worker1 # [ 82.476939] nix-daemon[848]: accepted connection from pid 1216, user nix-grpc-daemon (trusted) worker1 # [ 82.489576] nix-daemon[848]: reaped child process 1219, status = succeeded lb # [ 82.491883] niks3-server[1008]: 2026/09/22 13:46:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.502940] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.775Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 82.504311] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.775Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 82.518389] niks3-server[1008]: 2026/09/22 13:46:37 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 82.529506] niks3-server[1008]: 2026/09/22 13:46:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 82.535163] niks3-server[1008]: 2026/09/22 13:46:37 INFO Signed narinfos id=25 count=1 worker1 # [ 82.541055] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.813Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.546547] niks3-server[1008]: 2026/09/22 13:46:37 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 82.555891] niks3-server[1008]: 2026/09/22 13:46:37 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete worker1 # [ 82.563414] nix-grpc-daemon[862]: time=2026-09-22T13:46:36.836Z level=INFO msg="Upload complete. (251ms)" lb # [ 82.560721] niks3-server[1008]: 2026/09/22 13:46:37 INFO Completed upload id=25 worker1 # [ 82.565577] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 82.570356] nix-grpc-daemon[782]: ts=2026-09-22T13:46:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 lb # [ 82.570593] niks3-server[1008]: 2026/09/22 13:46:37 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 82.580405] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 82.585621] nix-daemon[848]: reaped child process 1209, status = succeeded worker1 # [ 82.590714] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 83.427725] nix-daemon[848]: reaped child process 1223, status = succeeded worker1 # [ 83.505297] nix-daemon[848]: accepted connection from pid 1239, user nix-grpc-daemon (trusted) worker1 # [ 83.518546] nix-daemon[848]: reaped child process 1242, status = succeeded lb # [ 83.522379] niks3-server[1008]: 2026/09/22 13:46:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 83.532781] nix-grpc-daemon[862]: time=2026-09-22T13:46:37.805Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 83.535163] nix-grpc-daemon[862]: time=2026-09-22T13:46:37.807Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 83.557177] niks3-server[1008]: 2026/09/22 13:46:38 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 83.570247] niks3-server[1008]: 2026/09/22 13:46:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 83.575531] niks3-server[1008]: 2026/09/22 13:46:38 INFO Signed narinfos id=26 count=1 worker1 # [ 83.584219] nix-grpc-daemon[862]: time=2026-09-22T13:46:37.856Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.581089] niks3-server[1008]: 2026/09/22 13:46:38 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 83.587483] niks3-server[1008]: 2026/09/22 13:46:38 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 83.596887] niks3-server[1008]: 2026/09/22 13:46:38 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 83.601084] niks3-server[1008]: 2026/09/22 13:46:38 INFO Completed upload id=26 lb # [ 83.602327] niks3-server[1008]: 2026/09/22 13:46:38 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 83.604139] nix-grpc-daemon[862]: time=2026-09-22T13:46:37.876Z level=INFO msg="Upload complete. (207ms)" worker1 # [ 83.611179] nix-grpc-daemon[782]: ts=2026-09-22T13:46:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker1 # [ 83.625401] nix-daemon[848]: reaped child process 1221, status = succeeded worker1 # [ 83.655557] nix-grpc-daemon[782]: ts=2026-09-22T13:46:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 83.683877] nix-grpc-daemon[784]: ts=2026-09-22T13:46:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 83.700622] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 83.712930] nix-grpc-daemon[784]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 83.725579] nix-grpc-daemon[784]: ts=2026-09-22T13:46:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_out=232 client # [ 83.845739] nix-daemon[1114]: reaped child process 1116, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.69 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.75 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.12 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.01 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 84.503928] nix-daemon[1114]: accepted connection from pid 1197, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 84.603289] nix-grpc-daemon[784]: ts=2026-09-22T13:46:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36480 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 84.597606] nix-grpc-daemon[782]: ts=2026-09-22T13:46:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 84.706029] nix-daemon[848]: accepted connection from pid 1249, user nix-grpc-daemon (trusted) worker1 # [ 84.717047] nix-daemon[848]: reaped child process 1252, status = succeeded lb # [ 84.722944] niks3-server[1008]: 2026/09/22 13:46:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.734791] nix-grpc-daemon[862]: time=2026-09-22T13:46:39.007Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 84.736566] nix-grpc-daemon[862]: time=2026-09-22T13:46:39.008Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 84.750362] niks3-server[1008]: 2026/09/22 13:46:39 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 84.761772] niks3-server[1008]: 2026/09/22 13:46:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 84.773300] nix-grpc-daemon[862]: time=2026-09-22T13:46:39.045Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.770390] niks3-server[1008]: 2026/09/22 13:46:39 INFO Signed narinfos id=27 count=1 lb # [ 84.776787] niks3-server[1008]: 2026/09/22 13:46:39 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 84.786962] niks3-server[1008]: 2026/09/22 13:46:39 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 84.794288] niks3-server[1008]: 2026/09/22 13:46:39 INFO Completed upload id=27 worker1 # [ 84.797266] nix-grpc-daemon[862]: time=2026-09-22T13:46:39.069Z level=INFO msg="Upload complete. (195ms)" lb # [ 84.798926] niks3-server[1008]: 2026/09/22 13:46:39 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 84.826338] nix-grpc-daemon[784]: ts=2026-09-22T13:46:39Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 84.831588] nix-grpc-daemon[784]: ts=2026-09-22T13:46:39Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 84.836705] nix-grpc-daemon[784]: ts=2026-09-22T13:46:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 84.848799] nix-grpc-daemon[784]: ts=2026-09-22T13:46:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 84.865300] nix-grpc-daemon[784]: ts=2026-09-22T13:46:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 84.879252] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 84.988981] nix-daemon[870]: accepted connection from pid 1180, user nix-grpc-daemon (trusted) worker2 # [ 85.004301] nix-daemon[870]: reaped child process 1183, status = succeeded worker2 # [ 85.090256] nix-daemon[870]: accepted connection from pid 1185, user nix-grpc-daemon (trusted) worker2 # [ 85.104320] nix-daemon[870]: reaped child process 1188, status = succeeded lb # [ 85.099728] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 85.108327] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.129332] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.191Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 85.130679] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.191Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker2 # [ 85.132416] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.191Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 85.142717] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 85.158685] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 85.165562] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 85.169315] niks3-server[1008]: 2026/09/22 13:46:40 INFO Signed narinfos id=28 count=1 lb # [ 85.174095] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 85.175619] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 85.177876] niks3-server[1008]: 2026/09/22 13:46:40 INFO Signed narinfos id=29 count=2 worker2 # [ 85.190405] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.252Z level=INFO msg="Uploading 3 narinfos" lb # [ 85.183892] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 85.194115] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 85.197229] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 85.200137] niks3-server[1008]: 2026/09/22 13:46:40 INFO Completed upload id=28 lb # [ 85.201669] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 85.203981] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 85.207837] niks3-server[1008]: 2026/09/22 13:46:40 INFO Completed upload id=29 lb # [ 85.209198] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo worker2 # [ 85.219854] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.282Z level=INFO msg="Upload complete. (325ms)" worker2 # [ 85.225466] nix-grpc-daemon[784]: ts=2026-09-22T13:46:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 85.231878] nix-grpc-daemon[784]: ts=2026-09-22T13:46:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 85.245115] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 85.253509] nix-daemon[870]: reaped child process 1178, status = succeeded worker2 # [ 85.262368] nix-grpc-daemon[784]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 85.269206] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 85.585281] envoy[917]: conn peer=[2001:db8:1::1]:34030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2969 tx=790 ms=4194 lb # [ 85.588888] envoy[917]: conn peer=[2001:db8:1::1]:34042 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1589 tx=1595 ms=4791 lb # [ 85.592436] envoy[917]: conn peer=[2001:db8:1::1]:48672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3407 tx=1923 ms=1673 lb # [ 85.596180] envoy[917]: conn peer=[2001:db8:1::1]:48676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=63 lb # [ 85.600203] envoy[917]: conn peer=[2001:db8:1::1]:48686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=2139 ms=1793 lb # [ 85.604412] envoy[917]: conn peer=[2001:db8:1::1]:48700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=51 lb # [ 85.607937] envoy[917]: conn peer=[2001:db8:1::1]:48708 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4311 tx=2371 ms=1544 lb # [ 85.611446] envoy[917]: conn peer=[2001:db8:1::1]:57368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=96 worker2 # [ 85.682297] nix-daemon[870]: reaped child process 1193, status = succeeded worker2 # [ 85.760691] nix-daemon[870]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker2 # [ 85.773885] nix-daemon[870]: reaped child process 1212, status = succeeded lb # [ 85.771672] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.790842] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.853Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 85.801418] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 85.807124] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 85.812456] niks3-server[1008]: 2026/09/22 13:46:40 INFO Signed narinfos id=30 count=1 worker2 # [ 85.827393] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.890Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.828272] niks3-server[1008]: 2026/09/22 13:46:40 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 85.833291] niks3-server[1008]: 2026/09/22 13:46:40 INFO Completed upload id=30 worker2 # [ 85.845211] nix-grpc-daemon[922]: time=2026-09-22T13:46:40.907Z level=INFO msg="Upload complete. (170ms)" lb # [ 85.840807] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 85.850113] nix-grpc-daemon[784]: ts=2026-09-22T13:46:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 lb # [ 85.843639] niks3-server[1008]: 2026/09/22 13:46:40 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls client # copying 1 paths... worker2 # [ 85.860352] nix-daemon[870]: reaped child process 1190, status = succeeded worker1 # [ 85.851300] nix-grpc-daemon[782]: ts=2026-09-22T13:46:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 85.859833] nix-grpc-daemon[782]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 85.884243] nix-grpc-daemon[782]: ts=2026-09-22T13:46:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 85.889172] nix-grpc-daemon[782]: ts=2026-09-22T13:46:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_out=120 client # [ 86.025355] nix-daemon[1114]: reaped child process 1200, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 1.64 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 86.127906] nix-daemon[1114]: accepted connection from pid 1219, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 86.219653] nix-grpc-daemon[782]: ts=2026-09-22T13:46:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42750 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 86.231943] nix-grpc-daemon[784]: ts=2026-09-22T13:46:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 86.240199] nix-grpc-daemon[922]: time=2026-09-22T13:46:41.302Z level=INFO msg="All 1 paths already cached" worker2 # [ 86.251883] nix-grpc-daemon[784]: ts=2026-09-22T13:46:41Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 86.256801] nix-grpc-daemon[784]: ts=2026-09-22T13:46:41Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 86.249705] nix-grpc-daemon[782]: ts=2026-09-22T13:46:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 86.259377] nix-grpc-daemon[782]: ts=2026-09-22T13:46:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 86.270449] nix-grpc-daemon[782]: ts=2026-09-22T13:46:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 86.281130] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 86.296539] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5) worker1 # [ 86.358763] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5) worker1 # [ 86.408708] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 3/5) worker1 # [ 86.563817] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 262 ms (attempt 4/5) worker1 # [ 86.828174] nix-grpc-daemon[782]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 86.831089] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 86.836615] nix-grpc-daemon[782]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 86.939579] nix-daemon[848]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 86.955900] nix-daemon[848]: reaped child process 1265, status = succeeded worker1 # [ 87.030581] nix-daemon[848]: accepted connection from pid 1267, user nix-grpc-daemon (trusted) worker1 # [ 87.045455] nix-daemon[848]: reaped child process 1270, status = succeeded lb # [ 87.049244] niks3-server[1008]: 2026/09/22 13:46:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 87.059884] nix-grpc-daemon[862]: time=2026-09-22T13:46:41.332Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 87.061304] nix-grpc-daemon[862]: time=2026-09-22T13:46:41.334Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 87.082719] niks3-server[1008]: 2026/09/22 13:46:42 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 87.091895] niks3-server[1008]: 2026/09/22 13:46:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 87.096330] niks3-server[1008]: 2026/09/22 13:46:42 INFO Signed narinfos id=31 count=1 worker1 # [ 87.102112] nix-grpc-daemon[862]: time=2026-09-22T13:46:41.374Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.102231] niks3-server[1008]: 2026/09/22 13:46:42 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 87.115392] niks3-server[1008]: 2026/09/22 13:46:42 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 87.123769] niks3-server[1008]: 2026/09/22 13:46:42 INFO Completed upload id=31 worker1 # [ 87.126133] nix-grpc-daemon[862]: time=2026-09-22T13:46:41.398Z level=INFO msg="Upload complete. (273ms)" lb # [ 87.125668] niks3-server[1008]: 2026/09/22 13:46:42 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 87.130984] nix-grpc-daemon[782]: ts=2026-09-22T13:46:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 paths=1 nar_bytes_in=560 worker1 # [ 87.136491] nix-grpc-daemon[782]: ts=2026-09-22T13:46:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 87.144204] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker1 # [ 87.152329] nix-daemon[848]: reaped child process 1255, status = succeeded worker1 # [ 87.156319] nix-daemon[848]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 87.597239] nix-daemon[848]: reaped child process 1274, status = succeeded worker1 # [ 87.666896] nix-daemon[848]: accepted connection from pid 1290, user nix-grpc-daemon (trusted) worker1 # [ 87.678192] nix-daemon[848]: reaped child process 1293, status = succeeded lb # [ 87.681367] niks3-server[1008]: 2026/09/22 13:46:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 87.691728] nix-grpc-daemon[862]: time=2026-09-22T13:46:41.964Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 87.711996] niks3-server[1008]: 2026/09/22 13:46:42 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 87.717830] niks3-server[1008]: 2026/09/22 13:46:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 87.725222] niks3-server[1008]: 2026/09/22 13:46:42 INFO Signed narinfos id=32 count=1 worker1 # [ 87.730864] nix-grpc-daemon[862]: time=2026-09-22T13:46:42.003Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.732096] niks3-server[1008]: 2026/09/22 13:46:42 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 87.745476] niks3-server[1008]: 2026/09/22 13:46:42 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 87.749619] niks3-server[1008]: 2026/09/22 13:46:42 INFO Completed upload id=32 worker1 # [ 87.752480] nix-grpc-daemon[862]: time=2026-09-22T13:46:42.025Z level=INFO msg="Upload complete. (190ms)" lb # [ 87.751186] niks3-server[1008]: 2026/09/22 13:46:42 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker1 # [ 87.754709] nix-grpc-daemon[782]: ts=2026-09-22T13:46:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42750 duration_s=0 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 client # copying 1 paths... worker1 # [ 87.761935] nix-daemon[848]: reaped child process 1272, status = succeeded worker2 # [ 87.771917] nix-grpc-daemon[784]: ts=2026-09-22T13:46:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 87.780381] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 87.804674] nix-grpc-daemon[784]: ts=2026-09-22T13:46:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 87.809633] nix-grpc-daemon[784]: ts=2026-09-22T13:46:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_out=120 client # [ 87.933835] nix-daemon[1114]: reaped child process 1222, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 1.91 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 88.035102] nix-daemon[1114]: accepted connection from pid 1241, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 88.122981] nix-grpc-daemon[782]: ts=2026-09-22T13:46:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42750 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 88.128695] nix-grpc-daemon[782]: ts=2026-09-22T13:46:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 88.133629] nix-grpc-daemon[862]: time=2026-09-22T13:46:42.405Z level=INFO msg="All 1 paths already cached" worker2 # [ 88.157370] nix-grpc-daemon[784]: ts=2026-09-22T13:46:43Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 88.163918] nix-grpc-daemon[784]: ts=2026-09-22T13:46:43Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 88.169274] nix-grpc-daemon[784]: ts=2026-09-22T13:46:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 88.180614] nix-grpc-daemon[784]: ts=2026-09-22T13:46:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36480 client # copying 1 paths to 'lb:50051'... worker2 # [ 88.196836] nix-grpc-daemon[922]: time=2026-09-22T13:46:43.257Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 88.201300] nix-grpc-daemon[784]: ts=2026-09-22T13:46:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 88.213348] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 88.314792] nix-daemon[870]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 88.330102] nix-daemon[870]: reaped child process 1224, status = succeeded worker2 # [ 88.408314] nix-daemon[870]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker2 # [ 88.421596] nix-daemon[870]: reaped child process 1229, status = succeeded lb # [ 88.417746] niks3-server[1008]: 2026/09/22 13:46:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.437832] nix-grpc-daemon[922]: time=2026-09-22T13:46:43.500Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 88.439273] nix-grpc-daemon[922]: time=2026-09-22T13:46:43.501Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 88.445342] niks3-server[1008]: 2026/09/22 13:46:43 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 88.457641] niks3-server[1008]: 2026/09/22 13:46:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 88.462272] niks3-server[1008]: 2026/09/22 13:46:43 INFO Signed narinfos id=33 count=1 worker2 # [ 88.477179] nix-grpc-daemon[922]: time=2026-09-22T13:46:43.539Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.472476] niks3-server[1008]: 2026/09/22 13:46:43 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 88.484355] niks3-server[1008]: 2026/09/22 13:46:43 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 88.490628] niks3-server[1008]: 2026/09/22 13:46:43 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo lb # [ 88.494902] niks3-server[1008]: 2026/09/22 13:46:43 INFO Completed upload id=33 worker2 # [ 88.506740] nix-grpc-daemon[922]: time=2026-09-22T13:46:43.569Z level=INFO msg="Upload complete. (281ms)" worker2 # [ 88.510825] nix-grpc-daemon[784]: ts=2026-09-22T13:46:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_in=560 worker2 # [ 88.515301] nix-grpc-daemon[784]: ts=2026-09-22T13:46:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 88.523266] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker2 # [ 88.529328] nix-daemon[870]: reaped child process 1219, status = succeeded worker2 # [ 88.533515] nix-daemon[870]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 89.749444] nix-daemon[870]: reaped child process 1233, status = succeeded worker2 # [ 89.829925] nix-daemon[870]: accepted connection from pid 1249, user nix-grpc-daemon (trusted) worker2 # [ 89.844852] nix-daemon[870]: reaped child process 1252, status = succeeded lb # [ 89.842797] niks3-server[1008]: 2026/09/22 13:46:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.861823] nix-grpc-daemon[922]: time=2026-09-22T13:46:44.924Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 89.871228] niks3-server[1008]: 2026/09/22 13:46:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker2 # [ 89.891870] nix-grpc-daemon[922]: time=2026-09-22T13:46:44.954Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.880528] niks3-server[1008]: 2026/09/22 13:46:44 INFO Signed narinfos id=34 count=1 lb # [ 89.886882] niks3-server[1008]: 2026/09/22 13:46:45 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 89.892707] niks3-server[1008]: 2026/09/22 13:46:45 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 89.904558] niks3-server[1008]: 2026/09/22 13:46:45 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete worker2 # [ 89.922782] nix-grpc-daemon[922]: time=2026-09-22T13:46:44.985Z level=INFO msg="Upload complete. (181ms)" lb # [ 89.911154] niks3-server[1008]: 2026/09/22 13:46:45 INFO Completed upload id=34 lb # [ 89.913132] niks3-server[1008]: 2026/09/22 13:46:45 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 89.925717] nix-grpc-daemon[784]: ts=2026-09-22T13:46:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 client # copying 1 paths... worker1 # [ 89.924417] nix-grpc-daemon[782]: ts=2026-09-22T13:46:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42750 worker2 # [ 89.934597] nix-daemon[870]: reaped child process 1231, status = succeeded worker1 # [ 89.929051] nix-grpc-daemon[782]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 89.958837] nix-grpc-daemon[784]: ts=2026-09-22T13:46:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 worker2 # [ 89.962938] nix-grpc-daemon[784]: ts=2026-09-22T13:46:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36480 duration_s=0 paths=1 nar_bytes_out=120 client # [ 90.088127] nix-daemon[1114]: reaped child process 1244, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.15 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 6.18 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.09 seconds) worker2 # [ 90.795462] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 90.846689] nix-grpc-daemon[784]: ts=2026-09-22T13:46:45Z level=info event=signal_exit lb # [ 91.265503] niks3-server[1008]: 2026/09/22 13:46:46 INFO lead: released remote=192.168.1.4:34094 worker1 # [ 92.273864] nix-grpc-daemon[782]: ts=2026-09-22T13:46:46Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 92.281584] nix-grpc-daemon[784]: ts=2026-09-22T13:46:47Z level=info event=scheduler_restarting worker2 # [ 92.287748] nix-grpc-daemon[784]: ts=2026-09-22T13:46:47Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 92.291607] nix-grpc-daemon[784]: ts=2026-09-22T13:46:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36474 worker2 # [ 92.295259] nix-grpc-daemon[784]: ts=2026-09-22T13:46:47Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 92.296678] nix-grpc-daemon[784]: ts=2026-09-22T13:46:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36474 worker2 # [ 92.297977] nix-grpc-daemon[784]: ts=2026-09-22T13:46:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 92.312458] nix-daemon[870]: reaped child process 872, status = succeeded worker1 # [ 92.473795] nix-grpc-daemon[782]: ts=2026-09-22T13:46:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.477659] nix-grpc-daemon[782]: ts=2026-09-22T13:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.494254] nix-grpc-daemon[784]: ts=2026-09-22T13:46:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 92.679421] nix-grpc-daemon[782]: ts=2026-09-22T13:46:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.682490] nix-grpc-daemon[782]: ts=2026-09-22T13:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.880324] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.883948] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.928824] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 92.931802] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 92.936503] systemd[1]: nix-grpc-daemon.service: Consumed 2.360s CPU time over 1min 17.249s wall clock time, 64.2M memory peak, 93.5K incoming IP traffic, 259.3K outgoing IP traffic. worker2 # [ 92.946750] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 92.950229] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 92.952630] systemd[1]: nix-grpc-daemon.socket: Consumed 348us CPU time over 1min 25.325s wall clock time, 256K memory peak, 108.7K incoming IP traffic, 95.1K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 93.084744] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.088737] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.111869] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42750 worker1 # [ 93.118679] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42750 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 93.212240] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 93.250822] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 93.266333] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_take_over lb # [ 93.264152] niks3-server[1008]: 2026/09/22 13:46:48 INFO lead: acquired remote=192.168.1.3:50456 worker1 # [ 93.290182] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.293800] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.494620] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.498484] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.699272] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.703233] nix-grpc-daemon[782]: ts=2026-09-22T13:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.732900] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=signal_exit worker1 # [ 93.903499] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.905267] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.994556] systemd[1]: Starting scheduler-token.service... worker2 # [ 94.053367] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 94.056456] systemd[1]: Finished scheduler-token.service. worker2 # [ 94.059748] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 63ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 94.066576] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 94.105758] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.107551] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.144923] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 94.146933] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 94.150106] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 94.154346] nix-grpc-daemon[1276]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 94.155654] nix-grpc-daemon[1276]: E0000 00:00:1790084809.216877 1276 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 94.161346] nix-grpc-daemon[1276]: E0000 00:00:1790084809.222145 1276 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 94.165523] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 94.167189] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 94.173066] nix-grpc-daemon[1276]: E0000 00:00:1790084809.235292 1318 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 94.186718] nix-grpc-daemon[1276]: E0000 00:00:1790084809.249351 1318 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 94.190802] nix-grpc-daemon[1276]: E0000 00:00:1790084809.251630 1318 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 94.200749] nix-grpc-daemon[1276]: E0000 00:00:1790084809.263411 1318 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 94.209929] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.211488] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 94.270734] niks3-server[1008]: 2026/09/22 13:46:49 INFO lead: released remote=192.168.1.3:50456 worker1 # [ 94.308412] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.310166] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.412948] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.417211] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.511081] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.515190] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.618428] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.622405] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.715942] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.719979] nix-grpc-daemon[782]: ts=2026-09-22T13:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.823543] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.827499] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.920575] nix-grpc-daemon[782]: ts=2026-09-22T13:46:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.924978] nix-grpc-daemon[782]: ts=2026-09-22T13:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.028771] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.032566] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.125915] nix-grpc-daemon[782]: ts=2026-09-22T13:46:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.130604] nix-grpc-daemon[782]: ts=2026-09-22T13:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.234845] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.237940] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.271670] nix-grpc-daemon[782]: ts=2026-09-22T13:46:49Z level=info event=scheduler_restarting worker1 # [ 95.295641] nix-daemon[848]: reaped child process 850, status = succeeded worker1 # [ 95.343859] nix-grpc-daemon[782]: ts=2026-09-22T13:46:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 95.435840] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.439661] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 95.586639] envoy[917]: conn peer=[2001:db8:1::1]:57380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=56 lb # [ 95.589286] envoy[917]: conn peer=[2001:db8:1::1]:57372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3833 tx=2029 ms=1347 lb # [ 95.593445] envoy[917]: conn peer=[2001:db8:1::1]:57386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=2083 ms=1630 lb # [ 95.597822] envoy[917]: conn peer=[2001:db8:1::1]:57390 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=56 lb # [ 95.602277] envoy[917]: conn peer=[2001:db8:1::1]:57404 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3756 tx=2123 ms=1883 lb # [ 95.607255] envoy[917]: conn peer=[2001:db8:1::1]:57414 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=57 lb # [ 95.611439] envoy[917]: conn peer=[2001:db8:1::4]:34426 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=75947 tx=3750 ms=76609 lb # [ 95.615735] envoy[917]: conn peer=[2001:db8:1::1]:33872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=20 lb # [ 95.619758] envoy[917]: conn peer=[2001:db8:1::3]:38940 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=22950 tx=4449 ms=79573 worker2 # [ 95.640940] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.644989] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.846565] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.850787] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.864224] nix-grpc-daemon[782]: E0000 00:00:1790084810.136809 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker1 # [ 95.866473] nix-grpc-daemon[782]: E0000 00:00:1790084810.139032 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 96.051530] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.053578] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.254803] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.256600] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.457472] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.459413] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.660186] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.661962] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.862783] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.864619] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.888852] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 96.891751] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 96.895603] systemd[1]: nix-grpc-daemon.service: Consumed 3.024s CPU time over 1min 21.304s wall clock time, 68.5M memory peak, 109.6K incoming IP traffic, 205.7K outgoing IP traffic. worker1 # [ 96.907685] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 96.911929] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 96.915308] systemd[1]: nix-grpc-daemon.socket: Consumed 314us CPU time over 1min 28.394s wall clock time, 256K memory peak, 100.1K incoming IP traffic, 86.7K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 97.065420] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.067284] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.099069] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 97.104804] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 97.112214] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 1/5) worker2 # [ 97.214920] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5) worker2 # [ 97.269627] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.273312] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.281592] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 189 ms (attempt 3/5) worker2 # [ 97.474096] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.476352] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.478723] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 541 ms (attempt 4/5) worker2 # [ 97.677349] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.681525] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.882314] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.884147] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.024491] nix-grpc-daemon[1276]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 98.028383] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 98.046518] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 98.056815] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 98.079695] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=niks3_push_started pid=1336 worker2 # [ 98.087595] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.091897] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.190852] nix-grpc-daemon[1336]: time=2026-09-22T13:46:53.252Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 98.274655] nix-daemon[870]: accepted connection from pid 1349, user nix-grpc-daemon (trusted) worker2 # [ 98.289106] nix-daemon[870]: reaped child process 1352, status = succeeded worker2 # [ 98.292361] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.294278] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 98.286901] niks3-server[1008]: 2026/09/22 13:46:53 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 98.292077] niks3-server[1008]: 2026/09/22 13:46:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.308071] nix-grpc-daemon[1336]: time=2026-09-22T13:46:53.369Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 98.309700] nix-grpc-daemon[1336]: time=2026-09-22T13:46:53.369Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 98.313264] nix-grpc-daemon[1336]: time=2026-09-22T13:46:53.370Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 98.319390] niks3-server[1008]: 2026/09/22 13:46:53 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 98.326501] niks3-server[1008]: 2026/09/22 13:46:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 98.329941] niks3-server[1008]: 2026/09/22 13:46:53 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 98.332596] niks3-server[1008]: 2026/09/22 13:46:53 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 98.342672] niks3-server[1008]: 2026/09/22 13:46:53 INFO Signed narinfos id=36 count=2 lb # [ 98.344088] niks3-server[1008]: 2026/09/22 13:46:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 98.346823] niks3-server[1008]: 2026/09/22 13:46:53 INFO Signed narinfos id=35 count=1 worker2 # [ 98.359483] nix-grpc-daemon[1336]: time=2026-09-22T13:46:53.421Z level=INFO msg="Uploading 3 narinfos" lb # [ 98.353820] niks3-server[1008]: 2026/09/22 13:46:53 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 98.363428] niks3-server[1008]: 2026/09/22 13:46:53 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 98.368474] niks3-server[1008]: 2026/09/22 13:46:53 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 98.375824] niks3-server[1008]: 2026/09/22 13:46:53 INFO Completed upload id=36 lb # [ 98.377104] niks3-server[1008]: 2026/09/22 13:46:53 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 98.379509] niks3-server[1008]: 2026/09/22 13:46:53 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 98.383931] niks3-server[1008]: 2026/09/22 13:46:53 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 98.386391] niks3-server[1008]: 2026/09/22 13:46:53 INFO Completed upload id=35 worker2 # [ 98.398548] nix-grpc-daemon[1336]: time=2026-09-22T13:46:53.461Z level=INFO msg="Upload complete. (205ms)" worker2 # [ 98.402818] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 98.414702] nix-daemon[870]: reaped child process 1334, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.47 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker2 # [ 98.495391] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.487652] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 98.499217] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.496171] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 98.587624] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 98.593227] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 98.596194] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 98.603206] nix-grpc-daemon[1317]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 98.604783] nix-grpc-daemon[1317]: E0000 00:00:1790084812.865612 1317 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 98.602615] niks3-server[1008]: 2026/09/22 13:46:53 INFO lead: acquired remote=192.168.1.3:54168 worker1 # [ 98.607866] nix-grpc-daemon[1317]: E0000 00:00:1790084812.870888 1317 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 98.610168] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 98.615161] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:52Z level=info event=scheduler_take_over worker1 # [ 98.616407] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 98.620139] nix-grpc-daemon[1317]: E0000 00:00:1790084812.883530 1356 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 98.629081] nix-grpc-daemon[1317]: E0000 00:00:1790084812.900201 1356 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 98.631283] nix-grpc-daemon[1317]: E0000 00:00:1790084812.900470 1356 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 98.641726] nix-grpc-daemon[1317]: E0000 00:00:1790084812.914429 1356 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 98.652794] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.654388] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 98.700488] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.704502] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.855417] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.859336] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.905307] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.906142] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 98.909248] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38848 worker1 # [ 98.913634] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 99.060102] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.064936] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38848 worker1 # [ 99.068613] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:53Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.07 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.63 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 99.761600] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:54Z level=info event=scheduler_lock_lost status=200 lb # [ 99.757882] niks3-server[1008]: 2026/09/22 13:46:54 INFO Shutdown signal received, draining in-flight requests timeout=10s worker2 # [ 99.770715] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:54Z level=info event=scheduler_lock_lost status=200 lb # [ 99.762278] niks3-server[1008]: 2026/09/22 13:46:54 INFO lead: released remote=192.168.1.3:54168 lb # [ 99.766348] systemd[1]: Stopping niks3 server... lb # [ 99.776793] systemd[1]: niks3.service: Deactivated successfully. lb # [ 99.778349] systemd[1]: Stopped niks3 server. lb # [ 99.779135] systemd[1]: niks3.service: Consumed 679ms CPU time over 1min 16.747s wall clock time, 28.9M memory peak, 98.2K incoming IP traffic, 140.3K outgoing IP traffic. lb # [ 99.786751] systemd[1]: Starting niks3 server... lb # [ 99.836236] niks3-server[1149]: 2026/09/22 13:46:54 goose: no migrations to run. current version: 20260920000000 lb # [ 99.842109] niks3-server[1149]: 2026/09/22 13:46:54 OK 1_commit_pending_closure.sql (4ms) lb # [ 99.845536] niks3-server[1149]: 2026/09/22 13:46:54 OK 2_object_stats_trigger.sql (1.85ms) lb # [ 99.846591] niks3-server[1149]: 2026/09/22 13:46:54 goose: up to current file version: 2 lb # [ 99.847848] niks3-server[1149]: 2026/09/22 13:46:54 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 99.858789] niks3-server[1149]: 2026/09/22 13:46:54 INFO Read proxy enabled — serving cache objects from S3 lb # [ 99.860242] niks3-server[1149]: 2026/09/22 13:46:54 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 99.862165] systemd[1]: Started niks3 server. lb # [ 99.862988] niks3-server[1149]: 2026/09/22 13:46:54 INFO systemd watchdog enabled interval=15s lb # [ 99.866140] niks3-server[1149]: 2026/09/22 13:46:54 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 100.198171] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38860 worker1 # [ 100.209651] nix-daemon[848]: accepted connection from pid 1317, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 100.224180] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38860 worker1 # [ 100.234278] nix-grpc-daemon[1317]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5) worker1 # [ 100.331602] nix-grpc-daemon[1317]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 2/5) worker1 # [ 100.445735] nix-grpc-daemon[1317]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 198 ms (attempt 3/5) worker1 # [ 100.644869] nix-grpc-daemon[1317]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 303 ms (attempt 4/5) lb # [ 100.762177] niks3-server[1149]: 2026/09/22 13:46:55 INFO lead: acquired remote=192.168.1.3:54174 worker1 # [ 100.949380] nix-grpc-daemon[1317]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 100.950959] nix-grpc-daemon[1317]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 100.969519] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:55Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 100.971530] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:55Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 101.024638] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 101.034078] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 101.041705] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 101.048357] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 101.140668] nix-daemon[870]: accepted connection from pid 1361, user nix-grpc-daemon (trusted) worker2 # [ 101.155875] nix-daemon[870]: reaped child process 1364, status = succeeded worker2 # [ 101.236897] nix-daemon[870]: accepted connection from pid 1366, user nix-grpc-daemon (trusted) worker2 # [ 101.252118] nix-daemon[870]: reaped child process 1369, status = succeeded lb # [ 101.245773] niks3-server[1149]: 2026/09/22 13:46:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.269152] nix-grpc-daemon[1336]: time=2026-09-22T13:46:56.331Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 101.271213] nix-grpc-daemon[1336]: time=2026-09-22T13:46:56.333Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 101.288807] niks3-server[1149]: 2026/09/22 13:46:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 101.298937] niks3-server[1149]: 2026/09/22 13:46:56 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 101.322896] niks3-server[1149]: 2026/09/22 13:46:56 INFO Signed narinfos id=37 count=1 worker2 # [ 101.336773] nix-grpc-daemon[1336]: time=2026-09-22T13:46:56.399Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.324984] niks3-server[1149]: 2026/09/22 13:46:56 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 101.330233] niks3-server[1149]: 2026/09/22 13:46:56 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 101.338238] niks3-server[1149]: 2026/09/22 13:46:56 INFO Completed upload id=37 worker2 # [ 101.350395] nix-grpc-daemon[1336]: time=2026-09-22T13:46:56.412Z level=INFO msg="Upload complete. (296ms)" lb # [ 101.342699] niks3-server[1149]: 2026/09/22 13:46:56 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker2 # [ 101.355951] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 101.362407] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 101.376118] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 101.384228] nix-daemon[870]: reaped child process 1359, status = succeeded worker2 # [ 101.391992] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 102.421886] nix-daemon[870]: reaped child process 1373, status = succeeded worker2 # [ 102.503113] nix-daemon[870]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker2 # [ 102.515505] nix-daemon[870]: reaped child process 1392, status = succeeded lb # [ 102.510797] niks3-server[1149]: 2026/09/22 13:46:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.533498] nix-grpc-daemon[1336]: time=2026-09-22T13:46:57.595Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 102.534941] nix-grpc-daemon[1336]: time=2026-09-22T13:46:57.597Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 102.554835] niks3-server[1149]: 2026/09/22 13:46:57 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 102.566077] niks3-server[1149]: 2026/09/22 13:46:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker2 # [ 102.587838] nix-grpc-daemon[1336]: time=2026-09-22T13:46:57.650Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.576112] niks3-server[1149]: 2026/09/22 13:46:57 INFO Signed narinfos id=38 count=1 lb # [ 102.579087] niks3-server[1149]: 2026/09/22 13:46:57 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 102.585927] niks3-server[1149]: 2026/09/22 13:46:57 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 102.594726] niks3-server[1149]: 2026/09/22 13:46:57 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 102.598198] niks3-server[1149]: 2026/09/22 13:46:57 INFO Completed upload id=38 lb # [ 102.600472] niks3-server[1149]: 2026/09/22 13:46:57 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 102.611524] nix-grpc-daemon[1336]: time=2026-09-22T13:46:57.674Z level=INFO msg="Upload complete. (211ms)" worker2 # [ 102.617761] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker1 # [ 102.616752] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:56Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 102.621335] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:56Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 102.633768] nix-daemon[870]: reaped child process 1371, status = succeeded worker2 # [ 102.674304] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 102.686420] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 102.699588] nix-grpc-daemon[1336]: time=2026-09-22T13:46:57.762Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 102.708278] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 102.718176] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 102.814460] nix-daemon[870]: accepted connection from pid 1396, user nix-grpc-daemon (trusted) worker2 # [ 102.828734] nix-daemon[870]: reaped child process 1399, status = succeeded worker2 # [ 102.909805] nix-daemon[870]: accepted connection from pid 1401, user nix-grpc-daemon (trusted) worker2 # [ 102.923319] nix-daemon[870]: reaped child process 1404, status = succeeded lb # [ 102.918381] niks3-server[1149]: 2026/09/22 13:46:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.938682] nix-grpc-daemon[1336]: time=2026-09-22T13:46:58.001Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 102.940078] nix-grpc-daemon[1336]: time=2026-09-22T13:46:58.001Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 102.945829] niks3-server[1149]: 2026/09/22 13:46:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker2 # [ 102.964172] nix-grpc-daemon[1336]: time=2026-09-22T13:46:58.026Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.952700] niks3-server[1149]: 2026/09/22 13:46:58 INFO Signed narinfos id=39 count=1 lb # [ 102.962483] niks3-server[1149]: 2026/09/22 13:46:58 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 102.971856] niks3-server[1149]: 2026/09/22 13:46:58 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 102.982262] niks3-server[1149]: 2026/09/22 13:46:58 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete worker2 # [ 103.001292] nix-grpc-daemon[1336]: time=2026-09-22T13:46:58.063Z level=INFO msg="Upload complete. (271ms)" lb # [ 102.989733] niks3-server[1149]: 2026/09/22 13:46:58 INFO Completed upload id=39 lb # [ 102.993027] niks3-server[1149]: 2026/09/22 13:46:58 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 103.003924] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 103.009172] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 103.018499] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 103.024655] nix-daemon[870]: reaped child process 1394, status = succeeded client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... worker2 # [ 103.030412] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 103.871669] nix-daemon[870]: reaped child process 1408, status = succeeded worker2 # [ 103.946137] nix-daemon[870]: accepted connection from pid 1424, user nix-grpc-daemon (trusted) worker2 # [ 103.959794] nix-daemon[870]: reaped child process 1427, status = succeeded lb # [ 103.956271] niks3-server[1149]: 2026/09/22 13:46:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 103.976513] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.038Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 103.977985] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.040Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 103.987105] niks3-server[1149]: 2026/09/22 13:46:59 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 104.002272] niks3-server[1149]: 2026/09/22 13:46:59 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 104.014361] niks3-server[1149]: 2026/09/22 13:46:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 104.019531] niks3-server[1149]: 2026/09/22 13:46:59 INFO Signed narinfos id=40 count=1 worker2 # [ 104.030983] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.093Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.028144] niks3-server[1149]: 2026/09/22 13:46:59 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 104.036568] niks3-server[1149]: 2026/09/22 13:46:59 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 104.039153] niks3-server[1149]: 2026/09/22 13:46:59 INFO Completed upload id=40 worker2 # [ 104.051265] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.113Z level=INFO msg="Upload complete. (214ms)" lb # [ 104.043619] niks3-server[1149]: 2026/09/22 13:46:59 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 104.057594] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker1 # [ 104.056577] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:58Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 104.060616] nix-grpc-daemon[1317]: ts=2026-09-22T13:46:58Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 104.073622] nix-daemon[870]: reaped child process 1406, status = succeeded worker2 # [ 104.109369] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 104.121337] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 104.134595] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.197Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 104.143583] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 104.153180] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 104.252128] nix-daemon[870]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 104.266382] nix-daemon[870]: reaped child process 1434, status = succeeded worker2 # [ 104.348166] nix-daemon[870]: accepted connection from pid 1436, user nix-grpc-daemon (trusted) worker2 # [ 104.364104] nix-daemon[870]: reaped child process 1439, status = succeeded lb # [ 104.356700] niks3-server[1149]: 2026/09/22 13:46:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 104.374505] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 104.376083] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.438Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 104.377831] niks3-server[1149]: 2026/09/22 13:46:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 104.380230] niks3-server[1149]: 2026/09/22 13:46:59 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 104.382562] niks3-server[1149]: 2026/09/22 13:46:59 INFO Signed narinfos id=41 count=1 worker2 # [ 104.395472] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.458Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.385164] niks3-server[1149]: 2026/09/22 13:46:59 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 104.390751] niks3-server[1149]: 2026/09/22 13:46:59 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 104.396511] niks3-server[1149]: 2026/09/22 13:46:59 INFO Completed upload id=41 worker2 # [ 104.408315] nix-grpc-daemon[1336]: time=2026-09-22T13:46:59.471Z level=INFO msg="Upload complete. (241ms)" lb # [ 104.398417] niks3-server[1149]: 2026/09/22 13:46:59 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 104.410693] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 104.414306] nix-grpc-daemon[1276]: ts=2026-09-22T13:46:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 104.421061] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 104.423296] nix-daemon[870]: reaped child process 1429, status = succeeded worker2 # [ 104.428858] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 105.586978] envoy[917]: conn peer=[2001:db8:1::1]:33882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=1314 client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 105.644889] nix-daemon[870]: reaped child process 1443, status = succeeded worker2 # [ 105.722510] nix-daemon[870]: accepted connection from pid 1459, user nix-grpc-daemon (trusted) worker2 # [ 105.737254] nix-daemon[870]: reaped child process 1462, status = succeeded lb # [ 105.733775] niks3-server[1149]: 2026/09/22 13:47:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 105.755455] nix-grpc-daemon[1336]: time=2026-09-22T13:47:00.817Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 105.756977] nix-grpc-daemon[1336]: time=2026-09-22T13:47:00.819Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 105.776644] niks3-server[1149]: 2026/09/22 13:47:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 105.784073] niks3-server[1149]: 2026/09/22 13:47:00 INFO Signed narinfos id=42 count=1 worker2 # [ 105.798948] nix-grpc-daemon[1336]: time=2026-09-22T13:47:00.861Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.795911] niks3-server[1149]: 2026/09/22 13:47:00 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 105.799917] niks3-server[1149]: 2026/09/22 13:47:00 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 105.809252] niks3-server[1149]: 2026/09/22 13:47:00 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 105.816359] niks3-server[1149]: 2026/09/22 13:47:00 INFO Completed upload id=42 worker2 # [ 105.828095] nix-grpc-daemon[1336]: time=2026-09-22T13:47:00.890Z level=INFO msg="Upload complete. (192ms)" lb # [ 105.818396] niks3-server[1149]: 2026/09/22 13:47:00 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 105.820945] niks3-server[1149]: 2026/09/22 13:47:00 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 105.834797] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 105.848842] nix-daemon[870]: reaped child process 1441, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.81 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.28 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 106.139821] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 106.603995] nix-grpc-daemon[1317]: ts=2026-09-22T13:47:00Z level=info event=signal_exit lb # [ 106.767850] niks3-server[1149]: 2026/09/22 13:47:01 INFO lead: released remote=192.168.1.3:54174 worker2 # [ 107.779684] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:02Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 107.774387] nix-grpc-daemon[1317]: ts=2026-09-22T13:47:02Z level=info event=scheduler_restarting worker1 # [ 107.778378] nix-grpc-daemon[1317]: ts=2026-09-22T13:47:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38848 worker1 # [ 107.781773] nix-grpc-daemon[1317]: ts=2026-09-22T13:47:02Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 107.785222] nix-grpc-daemon[1317]: ts=2026-09-22T13:47:02Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 107.788820] nix-grpc-daemon[1317]: ts=2026-09-22T13:47:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38848 worker1 # [ 107.793257] nix-grpc-daemon[1317]: ts=2026-09-22T13:47:02Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 107.803805] nix-daemon[848]: reaped child process 1377, status = succeeded worker1 # [ 107.909385] nix-grpc-daemon[1317]: E0000 00:00:1790084822.181731 1362 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 107.914291] nix-grpc-daemon[1317]: E0000 00:00:1790084822.182024 1362 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker2 # [ 107.979935] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.981790] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.182457] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.184380] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.384969] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.386847] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.587534] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.589317] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.791570] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.795168] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.996196] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.000222] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.200949] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.202967] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.403745] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.405558] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.606276] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.608269] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.810788] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.813908] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.988078] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 109.991093] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 109.995240] systemd[1]: nix-grpc-daemon.service: Consumed 215ms CPU time over 11.492s wall clock time, 14.1M memory peak, 10.3K incoming IP traffic, 15.1K outgoing IP traffic. worker2 # [ 110.011841] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.006332] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 110.015868] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.010501] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 110.013710] systemd[1]: nix-grpc-daemon.socket: Consumed 527us CPU time over 11.529s wall clock time, 256K memory peak, 23K incoming IP traffic, 17.3K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 110.216558] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.220310] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.420880] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.422663] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.623513] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.625335] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 110.763214] niks3-server[1149]: 2026/09/22 13:47:05 INFO lead: acquired remote=192.168.1.4:40456 worker2 # [ 110.776901] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_take_over worker2 # [ 110.827748] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.830980] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.028969] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.033125] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 111.233868] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.249152] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:06Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 111.252661] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:06Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36884 worker2 # [ 111.256488] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker2 # [ 112.348865] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43640 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 112.356996] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 112.373607] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 112.378764] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 112.416526] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 112.426564] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 112.436783] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 112.448333] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 112.542752] nix-daemon[870]: accepted connection from pid 1483, user nix-grpc-daemon (trusted) worker2 # [ 112.558209] nix-daemon[870]: reaped child process 1486, status = succeeded worker2 # [ 112.630911] nix-daemon[870]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 112.644409] nix-daemon[870]: reaped child process 1491, status = succeeded lb # [ 112.637910] niks3-server[1149]: 2026/09/22 13:47:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 112.654182] nix-grpc-daemon[1336]: time=2026-09-22T13:47:07.716Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 112.655541] nix-grpc-daemon[1336]: time=2026-09-22T13:47:07.716Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 112.649882] niks3-server[1149]: 2026/09/22 13:47:07 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 112.656533] niks3-server[1149]: 2026/09/22 13:47:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 112.659168] niks3-server[1149]: 2026/09/22 13:47:07 INFO Signed narinfos id=43 count=1 worker2 # [ 112.670909] nix-grpc-daemon[1336]: time=2026-09-22T13:47:07.733Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.664305] niks3-server[1149]: 2026/09/22 13:47:07 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 112.668968] niks3-server[1149]: 2026/09/22 13:47:07 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 112.671478] niks3-server[1149]: 2026/09/22 13:47:07 INFO Completed upload id=43 worker2 # [ 112.684444] nix-grpc-daemon[1336]: time=2026-09-22T13:47:07.747Z level=INFO msg="Upload complete. (224ms)" lb # [ 112.674912] niks3-server[1149]: 2026/09/22 13:47:07 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker2 # [ 112.686622] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 112.690924] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 112.697191] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 112.699519] nix-daemon[870]: reaped child process 1481, status = succeeded worker2 # [ 112.704461] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 113.939560] nix-daemon[870]: reaped child process 1495, status = succeeded worker2 # [ 114.026982] nix-daemon[870]: accepted connection from pid 1511, user nix-grpc-daemon (trusted) worker2 # [ 114.039657] nix-daemon[870]: reaped child process 1514, status = succeeded lb # [ 114.034841] niks3-server[1149]: 2026/09/22 13:47:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 114.057163] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.119Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 114.058664] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.121Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 114.080118] niks3-server[1149]: 2026/09/22 13:47:09 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 114.089883] niks3-server[1149]: 2026/09/22 13:47:09 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 114.096339] niks3-server[1149]: 2026/09/22 13:47:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 114.103531] niks3-server[1149]: 2026/09/22 13:47:09 INFO Signed narinfos id=44 count=1 worker2 # [ 114.115809] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.178Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.109150] niks3-server[1149]: 2026/09/22 13:47:09 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 114.120132] niks3-server[1149]: 2026/09/22 13:47:09 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 114.124622] niks3-server[1149]: 2026/09/22 13:47:09 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo lb # [ 114.127673] niks3-server[1149]: 2026/09/22 13:47:09 INFO Completed upload id=44 worker2 # [ 114.139487] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.202Z level=INFO msg="Upload complete. (227ms)" worker2 # [ 114.144367] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker2 # [ 114.150276] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 114.152577] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 114.159846] nix-daemon[870]: reaped child process 1493, status = succeeded worker2 # [ 114.196174] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 114.204563] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 114.214307] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.276Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 114.220434] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 114.225577] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 114.312486] nix-daemon[870]: accepted connection from pid 1520, user nix-grpc-daemon (trusted) worker2 # [ 114.325828] nix-daemon[870]: reaped child process 1523, status = succeeded worker2 # [ 114.408050] nix-daemon[870]: accepted connection from pid 1525, user nix-grpc-daemon (trusted) worker2 # [ 114.422250] nix-daemon[870]: reaped child process 1528, status = succeeded lb # [ 114.416429] niks3-server[1149]: 2026/09/22 13:47:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 114.436543] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.498Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 114.437907] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.499Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 114.440857] niks3-server[1149]: 2026/09/22 13:47:09 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 114.453243] niks3-server[1149]: 2026/09/22 13:47:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 114.457929] niks3-server[1149]: 2026/09/22 13:47:09 INFO Signed narinfos id=45 count=1 worker2 # [ 114.473136] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.535Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.468956] niks3-server[1149]: 2026/09/22 13:47:09 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 114.481317] niks3-server[1149]: 2026/09/22 13:47:09 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 114.488238] niks3-server[1149]: 2026/09/22 13:47:09 INFO Completed upload id=45 worker2 # [ 114.502283] nix-grpc-daemon[1336]: time=2026-09-22T13:47:09.564Z level=INFO msg="Upload complete. (269ms)" lb # [ 114.492033] niks3-server[1149]: 2026/09/22 13:47:09 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 114.504536] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 114.508349] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 114.515414] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 114.517845] nix-daemon[870]: reaped child process 1518, status = succeeded worker2 # [ 114.523155] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 115.586338] envoy[917]: conn peer=[2001:db8:1::1]:33892 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9735 tx=4448 ms=5644 lb # [ 115.590221] envoy[917]: conn peer=[2001:db8:1::3]:53942 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=950 tx=293 ms=9327 client # farm-b> LOG-farm-b-on-standby worker2 # [ 115.739324] nix-daemon[870]: reaped child process 1532, status = succeeded worker2 # [ 115.812595] nix-daemon[870]: accepted connection from pid 1548, user nix-grpc-daemon (trusted) worker2 # [ 115.826329] nix-daemon[870]: reaped child process 1551, status = succeeded lb # [ 115.820626] niks3-server[1149]: 2026/09/22 13:47:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 115.841913] nix-grpc-daemon[1336]: time=2026-09-22T13:47:10.904Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 115.843566] nix-grpc-daemon[1336]: time=2026-09-22T13:47:10.906Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 115.860861] niks3-server[1149]: 2026/09/22 13:47:10 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 115.876426] niks3-server[1149]: 2026/09/22 13:47:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 115.882584] niks3-server[1149]: 2026/09/22 13:47:11 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 115.895788] niks3-server[1149]: 2026/09/22 13:47:11 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls worker2 # [ 115.917557] nix-grpc-daemon[1336]: time=2026-09-22T13:47:10.980Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.905973] niks3-server[1149]: 2026/09/22 13:47:11 INFO Signed narinfos id=46 count=1 lb # [ 115.911894] niks3-server[1149]: 2026/09/22 13:47:11 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 115.916456] niks3-server[1149]: 2026/09/22 13:47:11 INFO Completed upload id=46 worker2 # [ 115.929619] nix-grpc-daemon[1336]: time=2026-09-22T13:47:10.992Z level=INFO msg="Upload complete. (199ms)" worker2 # [ 115.933294] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 lb # [ 115.922760] niks3-server[1149]: 2026/09/22 13:47:11 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 115.939236] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:11Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 115.941240] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:11Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 115.946517] nix-daemon[870]: reaped child process 1530, status = succeeded worker2 # [ 115.982891] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 115.991221] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 116.000835] nix-grpc-daemon[1336]: time=2026-09-22T13:47:11.063Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 116.006623] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 116.011607] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 116.091787] nix-daemon[870]: accepted connection from pid 1557, user nix-grpc-daemon (trusted) worker2 # [ 116.106479] nix-daemon[870]: reaped child process 1560, status = succeeded worker2 # [ 116.179677] nix-daemon[870]: accepted connection from pid 1562, user nix-grpc-daemon (trusted) lb # [ 116.183146] niks3-server[1149]: 2026/09/22 13:47:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 116.195484] nix-daemon[870]: reaped child process 1565, status = succeeded worker2 # [ 116.200381] nix-grpc-daemon[1336]: time=2026-09-22T13:47:11.262Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 116.201733] nix-grpc-daemon[1336]: time=2026-09-22T13:47:11.262Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 116.198994] niks3-server[1149]: 2026/09/22 13:47:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 116.201037] niks3-server[1149]: 2026/09/22 13:47:11 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 116.203486] niks3-server[1149]: 2026/09/22 13:47:11 INFO Signed narinfos id=47 count=1 worker2 # [ 116.215152] nix-grpc-daemon[1336]: time=2026-09-22T13:47:11.277Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.210540] niks3-server[1149]: 2026/09/22 13:47:11 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 116.211945] niks3-server[1149]: 2026/09/22 13:47:11 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 116.217989] niks3-server[1149]: 2026/09/22 13:47:11 INFO Completed upload id=47 worker2 # [ 116.229801] nix-grpc-daemon[1336]: time=2026-09-22T13:47:11.292Z level=INFO msg="Upload complete. (211ms)" lb # [ 116.219658] niks3-server[1149]: 2026/09/22 13:47:11 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 116.231910] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 116.235610] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 116.241939] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 116.244292] nix-daemon[870]: reaped child process 1555, status = succeeded worker2 # [ 116.249284] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 117.719144] nix-daemon[870]: reaped child process 1569, status = succeeded worker2 # [ 117.759393] nix-daemon[870]: accepted connection from pid 1585, user nix-grpc-daemon (trusted) worker2 # [ 117.774562] nix-daemon[870]: reaped child process 1588, status = succeeded lb # [ 117.767369] niks3-server[1149]: 2026/09/22 13:47:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 117.787115] nix-grpc-daemon[1336]: time=2026-09-22T13:47:12.849Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 117.788546] nix-grpc-daemon[1336]: time=2026-09-22T13:47:12.851Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 117.806168] niks3-server[1149]: 2026/09/22 13:47:12 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 117.815515] niks3-server[1149]: 2026/09/22 13:47:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 117.820899] niks3-server[1149]: 2026/09/22 13:47:12 INFO Signed narinfos id=48 count=1 worker2 # [ 117.836179] nix-grpc-daemon[1336]: time=2026-09-22T13:47:12.898Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.830494] niks3-server[1149]: 2026/09/22 13:47:12 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 117.839940] niks3-server[1149]: 2026/09/22 13:47:12 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 117.847667] niks3-server[1149]: 2026/09/22 13:47:12 INFO Completed upload id=48 lb # [ 117.849880] niks3-server[1149]: 2026/09/22 13:47:12 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls worker2 # [ 117.859380] nix-grpc-daemon[1336]: time=2026-09-22T13:47:12.921Z level=INFO msg="Upload complete. (201ms)" lb # [ 117.851972] niks3-server[1149]: 2026/09/22 13:47:12 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 117.865761] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker2 # [ 117.882334] nix-daemon[870]: reaped child process 1567, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.68 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.10 seconds) worker1 # [ 118.023456] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 118.031600] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 118.120807] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 118.122747] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 118.125804] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 118.130054] nix-grpc-daemon[1407]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 118.132170] nix-grpc-daemon[1407]: E0000 00:00:1790084832.402572 1407 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 118.138067] nix-grpc-daemon[1407]: E0000 00:00:1790084832.407938 1407 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 118.141535] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 118.144299] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 118.147134] nix-grpc-daemon[1407]: E0000 00:00:1790084832.418858 1448 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 118.159407] nix-grpc-daemon[1407]: E0000 00:00:1790084832.432128 1448 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 118.163062] nix-grpc-daemon[1407]: E0000 00:00:1790084832.434529 1448 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 118.173722] nix-grpc-daemon[1407]: E0000 00:00:1790084832.446444 1448 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 118.181135] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.191134] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36884 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 118.195416] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.33 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 118.379124] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 5d2349b93801462aad52f80ada422d1b client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) worker2 # [ 118.498238] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43640 client # [ 118.520992] nix[1368]: don't know how to build these paths: client # [ 118.521954] nix[1368]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 118.511617] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 118.516724] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 118.554742] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 118.565460] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43640 client # [ 118.590093] nix[1368]: copying 1 paths to 'lb:50051'... client # [ 118.591058] nix[1368]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 118.574350] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 118.584163] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 118.675175] nix-daemon[870]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker2 # [ 118.689741] nix-daemon[870]: reaped child process 1604, status = succeeded worker2 # [ 118.763413] nix-daemon[870]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 118.778166] nix-daemon[870]: reaped child process 1609, status = succeeded lb # [ 118.770609] niks3-server[1149]: 2026/09/22 13:47:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 118.791326] nix-grpc-daemon[1336]: time=2026-09-22T13:47:13.853Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 118.792646] nix-grpc-daemon[1336]: time=2026-09-22T13:47:13.853Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 118.799085] niks3-server[1149]: 2026/09/22 13:47:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 118.807441] niks3-server[1149]: 2026/09/22 13:47:13 INFO Signed narinfos id=49 count=1 worker2 # [ 118.822728] nix-grpc-daemon[1336]: time=2026-09-22T13:47:13.885Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.812271] niks3-server[1149]: 2026/09/22 13:47:13 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 118.819503] niks3-server[1149]: 2026/09/22 13:47:13 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 118.829690] niks3-server[1149]: 2026/09/22 13:47:13 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 118.836588] niks3-server[1149]: 2026/09/22 13:47:13 INFO Completed upload id=49 worker2 # [ 118.848192] nix-grpc-daemon[1336]: time=2026-09-22T13:47:13.910Z level=INFO msg="Upload complete. (252ms)" lb # [ 118.839573] niks3-server[1149]: 2026/09/22 13:47:13 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 118.850456] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 118.854274] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 worker2 # [ 118.862855] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 118.869324] nix-daemon[870]: reaped child process 1599, status = succeeded client # [ 118.887972] nix[1368]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... worker2 # [ 118.872414] nix-daemon[870]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 120.961269] systemd-journald[285]: Received client request to rotate journal, rotating. worker1 # [ 120.978790] systemd-journald[285]: Vacuuming done, freed 0B of archived journals from /var/log/journal/7c338c9042ae44478d0384c2b31d22ed. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 120.903764] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds) client: must succeed: sleep 5.0 worker2 # [ 121.171079] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:16Z level=info event=draining lb # [ 125.586822] envoy[917]: conn peer=[2001:db8:1::1]:48298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9612 tx=4369 ms=5529 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 126.346795] nix-daemon[870]: reaped child process 1613, status = succeeded worker2 # [ 126.389064] nix-daemon[870]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 126.403095] nix-daemon[870]: reaped child process 1657, status = succeeded lb # [ 126.398423] niks3-server[1149]: 2026/09/22 13:47:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.418689] nix-grpc-daemon[1336]: time=2026-09-22T13:47:21.481Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 126.420206] nix-grpc-daemon[1336]: time=2026-09-22T13:47:21.482Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 126.436444] niks3-server[1149]: 2026/09/22 13:47:21 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 126.449768] niks3-server[1149]: 2026/09/22 13:47:21 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 126.457943] niks3-server[1149]: 2026/09/22 13:47:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 126.463137] niks3-server[1149]: 2026/09/22 13:47:21 INFO Signed narinfos id=50 count=1 worker2 # [ 126.477782] nix-grpc-daemon[1336]: time=2026-09-22T13:47:21.540Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.472565] niks3-server[1149]: 2026/09/22 13:47:21 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 126.479781] niks3-server[1149]: 2026/09/22 13:47:21 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 126.486578] niks3-server[1149]: 2026/09/22 13:47:21 INFO Completed upload id=50 lb # [ 126.488951] niks3-server[1149]: 2026/09/22 13:47:21 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 126.499868] nix-grpc-daemon[1336]: time=2026-09-22T13:47:21.562Z level=INFO msg="Upload complete. (213ms)" worker2 # [ 126.508427] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43640 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 126.522960] nix-daemon[870]: reaped child process 1611, status = succeeded client # [ 126.553936] systemd[1]: rs.service: Deactivated successfully. client # [ 126.557887] systemd[1]: rs.service: Consumed 126ms CPU time over 8.178s wall clock time, 43.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 127.172363] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:22Z level=info event=signal_exit lb # [ 127.768963] niks3-server[1149]: 2026/09/22 13:47:22 INFO lead: released remote=192.168.1.4:40456 lb # [ 128.142956] niks3-server[1149]: 2026/09/22 13:47:23 INFO lead: acquired remote=192.168.1.3:36492 worker1 # [ 128.149929] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:22Z level=info event=scheduler_take_over worker1 # [ 128.772647] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:23Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 128.785651] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:23Z level=info event=scheduler_restarting worker2 # [ 128.790103] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36884 worker2 # [ 128.794383] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:23Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 128.797443] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:23Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 128.800642] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36884 worker2 # [ 128.804214] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:23Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 128.824424] nix-daemon[870]: reaped child process 1328, status = succeeded worker1 # [ 128.973182] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.979978] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:23Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53954 worker1 # [ 128.984484] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 128.998624] nix-grpc-daemon[1276]: ts=2026-09-22T13:47:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 129.234341] nix-grpc-daemon[1276]: E0000 00:00:1790084844.296703 1321 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker2 # [ 129.239286] nix-grpc-daemon[1276]: E0000 00:00:1790084844.296977 1321 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.17 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 130.281765] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 130.284708] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 130.287755] systemd[1]: nix-grpc-daemon.service: Consumed 2.112s CPU time over 36.214s wall clock time, 46.8M memory peak, 85.9K incoming IP traffic, 217.6K outgoing IP traffic. worker2 # [ 130.302899] systemd[1]: Starting scheduler-token.service... worker2 # [ 130.345182] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 130.347187] systemd[1]: Finished scheduler-token.service. worker2 # [ 130.347904] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 44ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 130.352156] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 130.429394] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:25Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 130.431506] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 130.434693] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 130.439093] nix-grpc-daemon[1667]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 130.440410] nix-grpc-daemon[1667]: E0000 00:00:1790084845.501311 1667 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 130.446174] nix-grpc-daemon[1667]: E0000 00:00:1790084845.506693 1667 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.449436] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 130.451366] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 130.455067] nix-grpc-daemon[1667]: E0000 00:00:1790084845.517103 1707 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 130.466491] nix-grpc-daemon[1667]: E0000 00:00:1790084845.529156 1707 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.471355] nix-grpc-daemon[1667]: E0000 00:00:1790084845.531538 1707 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 130.481930] nix-grpc-daemon[1667]: E0000 00:00:1790084845.544554 1707 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.489790] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:25Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 130.489452] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:24Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 130.493491] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53954 worker1 # [ 130.497949] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.23 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 130.605724] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 8c3138a4453a480d91546c8a44e83f0e client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker1 # [ 130.722620] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53964 worker1 # [ 130.732229] nix-daemon[848]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # [ 130.767412] nix[1403]: don't know how to build these paths: client # [ 130.768263] nix[1403]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 130.751224] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:25Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 130.756066] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:25Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 130.799526] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53964 worker1 # [ 130.810296] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5) worker1 # [ 130.830391] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 2/5) worker1 # [ 131.031082] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 394 ms (attempt 3/5) worker1 # [ 131.427182] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 425 ms (attempt 4/5) worker1 # [ 131.854875] nix-grpc-daemon[1407]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 131.858414] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 131.876072] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53964 client # [ 131.910990] nix[1403]: copying 1 paths to 'lb:50051'... worker1 # [ 131.888233] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53964 client # [ 131.915148] nix[1403]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 131.901196] nix-daemon[848]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 131.919807] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:26Z level=info event=niks3_push_started pid=1539 worker1 # [ 132.022632] nix-grpc-daemon[1539]: time=2026-09-22T13:47:26.294Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 132.108136] nix-daemon[848]: accepted connection from pid 1552, user nix-grpc-daemon (trusted) worker1 # [ 132.118640] nix-daemon[848]: reaped child process 1555, status = succeeded worker1 # [ 132.204635] nix-daemon[848]: accepted connection from pid 1557, user nix-grpc-daemon (trusted) worker1 # [ 132.216441] nix-daemon[848]: reaped child process 1560, status = succeeded lb # [ 132.222367] niks3-server[1149]: 2026/09/22 13:47:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.233327] nix-grpc-daemon[1539]: time=2026-09-22T13:47:26.506Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 132.236362] nix-grpc-daemon[1539]: time=2026-09-22T13:47:26.507Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 132.259107] niks3-server[1149]: 2026/09/22 13:47:27 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 132.268268] niks3-server[1149]: 2026/09/22 13:47:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 132.277921] nix-grpc-daemon[1539]: time=2026-09-22T13:47:26.550Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.274881] niks3-server[1149]: 2026/09/22 13:47:27 INFO Signed narinfos id=51 count=1 lb # [ 132.288242] niks3-server[1149]: 2026/09/22 13:47:27 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 132.296807] niks3-server[1149]: 2026/09/22 13:47:27 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete worker1 # [ 132.304916] nix-grpc-daemon[1539]: time=2026-09-22T13:47:26.577Z level=INFO msg="Upload complete. (279ms)" lb # [ 132.303043] niks3-server[1149]: 2026/09/22 13:47:27 INFO Completed upload id=51 lb # [ 132.307673] niks3-server[1149]: 2026/09/22 13:47:27 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 132.308122] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53964 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 132.313464] nix-grpc-daemon[1407]: ts=2026-09-22T13:47:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53964 worker1 # [ 132.321611] nix-daemon[848]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 132.326038] nix-daemon[848]: reaped child process 1537, status = succeeded worker1 # [ 132.330688] nix-daemon[848]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # [ 132.355461] nix[1403]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 134.077531] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1407 (nix-grpc-daemon) on client request. worker1 # [ 134.081440] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 134.087093] niks3-server[1149]: 2026/09/22 13:47:29 INFO lead: released remote=192.168.1.3:36492 worker2 # [ 134.103725] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 134.120580] nix[1403]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 134.099163] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 134.101297] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. client # [ 134.125370] nix[1403]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 134.106324] systemd[1]: nix-grpc-daemon.service: Consumed 413ms CPU time over 16.066s wall clock time, 35.5M memory peak, 14.5K incoming IP traffic, 26.1K outgoing IP traffic. worker1 # [ 134.108536] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 134.114552] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 134.140208] nix-daemon[848]: reaped child process 1562, status = succeeded worker1 # [ 134.142406] nix-daemon[848]: reaped child process 1525, status = succeeded worker1 # [ 134.152957] nix-daemon[1564]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 134.161712] nix-daemon[848]: reaped child process 1564, status = failed with exit code 1 worker1 # [ 134.203805] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 134.205774] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 134.208821] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 134.213055] nix-grpc-daemon[1600]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 134.215167] nix-grpc-daemon[1600]: E0000 00:00:1790084848.485533 1600 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 134.221063] nix-grpc-daemon[1600]: E0000 00:00:1790084848.490895 1600 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 134.224093] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 134.227589] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 134.225887] niks3-server[1149]: 2026/09/22 13:47:29 INFO lead: acquired remote=192.168.1.3:54988 worker1 # [ 134.232123] nix-grpc-daemon[1600]: E0000 00:00:1790084848.501957 1642 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 134.235264] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=scheduler_take_over worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.19 seconds) client: must succeed: sleep 5.0 worker1 # [ 134.243843] nix-grpc-daemon[1600]: E0000 00:00:1790084848.516490 1642 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 134.247130] nix-grpc-daemon[1600]: E0000 00:00:1790084848.518682 1642 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 134.257712] nix-grpc-daemon[1600]: E0000 00:00:1790084848.530389 1642 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 134.266904] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.273323] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48436 worker1 # [ 134.274951] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 134.303959] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.299626] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 134.301060] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48436 worker1 # [ 134.302696] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 134.609619] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 134.614966] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 134.661162] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48452 worker1 # [ 134.671173] nix-daemon[848]: accepted connection from pid 1600, user nix-grpc-daemon (trusted) worker1 # [ 134.685901] nix-daemon[848]: accepted connection from pid 1600, user nix-grpc-daemon (trusted) client # [ 134.724490] nix[1403]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 134.701194] nix-daemon[848]: accepted connection from pid 1600, user nix-grpc-daemon (trusted) lb # [ 135.586672] envoy[917]: conn peer=[2001:db8:1::1]:42152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2960 tx=1516 ms=8018 lb # [ 135.588445] envoy[917]: conn peer=[2001:db8:1::4]:48192 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=35600 tx=2164 ms=34780 lb # [ 135.590088] envoy[917]: conn peer=[2001:db8:1::3]:40802 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=794 tx=311 ms=15916 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 139.527300] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:33Z level=info event=niks3_push_started pid=1684 worker1 # [ 139.560292] nix-daemon[848]: reaped child process 1659, status = succeeded worker1 # [ 139.633907] nix-grpc-daemon[1684]: time=2026-09-22T13:47:33.906Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 139.716891] nix-daemon[848]: accepted connection from pid 1697, user nix-grpc-daemon (trusted) worker1 # [ 139.728130] nix-daemon[848]: reaped child process 1700, status = succeeded lb # [ 139.732812] niks3-server[1149]: 2026/09/22 13:47:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.739846] nix-grpc-daemon[1684]: time=2026-09-22T13:47:34.012Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.741399] nix-grpc-daemon[1684]: time=2026-09-22T13:47:34.014Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 139.759116] niks3-server[1149]: 2026/09/22 13:47:34 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 139.764365] niks3-server[1149]: 2026/09/22 13:47:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 139.766353] niks3-server[1149]: 2026/09/22 13:47:34 INFO Signed narinfos id=52 count=1 worker1 # [ 139.769230] nix-grpc-daemon[1684]: time=2026-09-22T13:47:34.041Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.776759] niks3-server[1149]: 2026/09/22 13:47:34 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 139.779371] niks3-server[1149]: 2026/09/22 13:47:34 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 139.783036] niks3-server[1149]: 2026/09/22 13:47:34 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 139.786382] niks3-server[1149]: 2026/09/22 13:47:34 INFO Completed upload id=52 worker1 # [ 139.788827] nix-grpc-daemon[1684]: time=2026-09-22T13:47:34.061Z level=INFO msg="Upload complete. (151ms)" worker1 # [ 139.791333] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48452 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 lb # [ 139.790810] niks3-server[1149]: 2026/09/22 13:47:34 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 139.799885] nix-daemon[848]: reaped child process 1657, status = succeeded client # [ 139.849852] systemd[1]: mid.service: Deactivated successfully. client # [ 139.853558] systemd[1]: mid.service: Consumed 146ms CPU time over 9.247s wall clock time, 43.4M memory peak, 8.7K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.03 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 140.611965] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 69ad2647762c4184965a80097256c201 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker2 # [ 140.725339] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 140.734678] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client # [ 140.761266] nix[1439]: don't know how to build these paths: client # [ 140.762137] nix[1439]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 140.744494] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:35Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 140.748511] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:35Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 140.796788] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 140.806176] nix-grpc-daemon[1667]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5) worker2 # [ 140.848216] nix-grpc-daemon[1667]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5) worker2 # [ 140.889709] nix-grpc-daemon[1667]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 3/5) worker2 # [ 141.000291] nix-grpc-daemon[1667]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 394 ms (attempt 4/5) worker2 # [ 141.396764] nix-grpc-daemon[1667]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 141.400656] nix-grpc-daemon[1667]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 141.417662] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 client # [ 141.444304] nix[1439]: copying 1 paths to 'lb:50051'... client # [ 141.448146] nix[1439]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 141.432464] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 141.440830] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 141.463235] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:36Z level=info event=niks3_push_started pid=1759 worker2 # [ 141.563319] nix-grpc-daemon[1759]: time=2026-09-22T13:47:36.625Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 141.649051] nix-daemon[870]: accepted connection from pid 1771, user nix-grpc-daemon (trusted) worker2 # [ 141.661820] nix-daemon[870]: reaped child process 1774, status = succeeded worker2 # [ 141.745203] nix-daemon[870]: accepted connection from pid 1776, user nix-grpc-daemon (trusted) worker2 # [ 141.767923] nix-daemon[870]: reaped child process 1782, status = succeeded lb # [ 141.758702] niks3-server[1149]: 2026/09/22 13:47:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.778482] nix-grpc-daemon[1759]: time=2026-09-22T13:47:36.841Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 141.780248] nix-grpc-daemon[1759]: time=2026-09-22T13:47:36.842Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 141.792653] niks3-server[1149]: 2026/09/22 13:47:36 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 141.806223] niks3-server[1149]: 2026/09/22 13:47:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 141.814237] niks3-server[1149]: 2026/09/22 13:47:36 INFO Signed narinfos id=53 count=1 worker2 # [ 141.829254] nix-grpc-daemon[1759]: time=2026-09-22T13:47:36.891Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.824913] niks3-server[1149]: 2026/09/22 13:47:36 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 141.834312] niks3-server[1149]: 2026/09/22 13:47:36 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 141.841351] niks3-server[1149]: 2026/09/22 13:47:36 INFO Completed upload id=53 worker2 # [ 141.853220] nix-grpc-daemon[1759]: time=2026-09-22T13:47:36.915Z level=INFO msg="Upload complete. (286ms)" lb # [ 141.844344] niks3-server[1149]: 2026/09/22 13:47:36 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 141.855831] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 141.858757] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 141.866288] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 141.871138] nix-daemon[870]: reaped child process 1757, status = succeeded client # [ 141.889858] nix[1439]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... worker2 # [ 141.874115] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 142.912935] systemd[1]: intr.service: Sent signal SIGINT to main process 1439 (nix) on client request. client # [ 142.915343] nix[1439]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.02 seconds) client # [ 142.918438] nix[1439]: error: interrupted by the user worker2 # [ 142.902688] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:37Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 142.936726] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 142.938455] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 142.940366] systemd[1]: intr.service: Consumed 114ms CPU time over 2.326s wall clock time, 43.4M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 143.092914] nix-daemon[870]: reaped child process 1785, status = succeeded worker2 # [ 143.094526] nix-daemon[1787]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 143.099492] nix-daemon[870]: reaped child process 1787, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.48 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 144.121705] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 59f49c95be7e447ab0d6c1acbe497003 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds) worker1 # [ 144.232389] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48452 client # [ 144.263878] nix[1459]: don't know how to build these paths: client # [ 144.264809] nix[1459]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 144.246115] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:38Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 144.250929] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:38Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 144.290323] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48452 worker1 # [ 144.300865] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 1/5) worker1 # [ 144.356499] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5) worker1 # [ 144.544583] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 270 ms (attempt 3/5) worker1 # [ 144.815636] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 548 ms (attempt 4/5) worker1 # [ 145.365552] nix-grpc-daemon[1600]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 145.367139] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 145.378690] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48452 worker1 # [ 145.386398] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48452 client # [ 145.411841] nix[1459]: copying 1 paths to 'lb:50051'... client # [ 145.413754] nix[1459]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 145.396510] nix-daemon[848]: accepted connection from pid 1600, user nix-grpc-daemon (trusted) worker1 # [ 145.477964] nix-daemon[848]: accepted connection from pid 1740, user nix-grpc-daemon (trusted) worker1 # [ 145.490422] nix-daemon[848]: reaped child process 1743, status = succeeded worker1 # [ 145.570339] nix-daemon[848]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 145.582363] nix-daemon[848]: reaped child process 1748, status = succeeded lb # [ 145.587783] niks3-server[1149]: 2026/09/22 13:47:40 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 145.594776] envoy[917]: conn peer=[2001:db8:1::1]:32794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3921 tx=1963 ms=9085 lb # [ 145.598529] envoy[917]: conn peer=[2001:db8:1::1]:50782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2980 tx=830 ms=2192 worker1 # [ 145.605881] nix-grpc-daemon[1684]: time=2026-09-22T13:47:39.878Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.607419] nix-grpc-daemon[1684]: time=2026-09-22T13:47:39.880Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 145.622719] niks3-server[1149]: 2026/09/22 13:47:40 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 145.638522] niks3-server[1149]: 2026/09/22 13:47:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 145.642481] niks3-server[1149]: 2026/09/22 13:47:40 INFO Signed narinfos id=54 count=1 worker1 # [ 145.647877] nix-grpc-daemon[1684]: time=2026-09-22T13:47:39.920Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.648298] niks3-server[1149]: 2026/09/22 13:47:40 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 145.658746] niks3-server[1149]: 2026/09/22 13:47:40 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 145.662061] niks3-server[1149]: 2026/09/22 13:47:40 INFO Completed upload id=54 worker1 # [ 145.664975] nix-grpc-daemon[1684]: time=2026-09-22T13:47:39.937Z level=INFO msg="Upload complete. (264ms)" worker1 # [ 145.667240] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48452 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 145.665161] niks3-server[1149]: 2026/09/22 13:47:40 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 145.670468] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48452 worker1 # [ 145.679750] nix-daemon[848]: accepted connection from pid 1600, user nix-grpc-daemon (trusted) worker1 # [ 145.682570] nix-daemon[848]: reaped child process 1738, status = succeeded worker1 # [ 145.686968] nix-daemon[848]: accepted connection from pid 1600, user nix-grpc-daemon (trusted) client # [ 145.711792] nix[1459]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 147.581377] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 147.609782] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker2 # [ 147.805605] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53166 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 147.814082] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 worker1 # [ 147.827437] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:42Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 147.830192] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:42Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 147.880169] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 147.890897] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 client # copying 1 paths to 'lb:50051'... worker2 # [ 147.901956] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 147.929281] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 148.029917] nix-daemon[870]: accepted connection from pid 1838, user nix-grpc-daemon (trusted) worker2 # [ 148.043434] nix-daemon[870]: reaped child process 1841, status = succeeded worker2 # [ 148.125205] nix-daemon[870]: accepted connection from pid 1844, user nix-grpc-daemon (trusted) worker2 # [ 148.140095] nix-daemon[870]: reaped child process 1847, status = succeeded lb # [ 148.132823] niks3-server[1149]: 2026/09/22 13:47:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.149111] nix-grpc-daemon[1759]: time=2026-09-22T13:47:43.211Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 148.150591] nix-grpc-daemon[1759]: time=2026-09-22T13:47:43.213Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 148.152062] niks3-server[1149]: 2026/09/22 13:47:43 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 148.158266] niks3-server[1149]: 2026/09/22 13:47:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 148.160546] niks3-server[1149]: 2026/09/22 13:47:43 INFO Signed narinfos id=55 count=1 worker2 # [ 148.172525] nix-grpc-daemon[1759]: time=2026-09-22T13:47:43.235Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.167284] niks3-server[1149]: 2026/09/22 13:47:43 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 148.173146] niks3-server[1149]: 2026/09/22 13:47:43 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 148.177865] niks3-server[1149]: 2026/09/22 13:47:43 INFO Completed upload id=55 worker2 # [ 148.190867] nix-grpc-daemon[1759]: time=2026-09-22T13:47:43.253Z level=INFO msg="Upload complete. (250ms)" worker2 # [ 148.193121] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 148.196762] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 148.203496] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 148.205934] nix-daemon[870]: reaped child process 1836, status = succeeded worker2 # [ 148.211170] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 148.224579] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:42Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 149.449677] nix-daemon[870]: reaped child process 1851, status = succeeded worker2 # [ 149.533529] nix-daemon[870]: accepted connection from pid 1867, user nix-grpc-daemon (trusted) worker2 # [ 149.549326] nix-daemon[870]: reaped child process 1870, status = succeeded lb # [ 149.540595] niks3-server[1149]: 2026/09/22 13:47:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.558961] nix-grpc-daemon[1759]: time=2026-09-22T13:47:44.621Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 149.560529] nix-grpc-daemon[1759]: time=2026-09-22T13:47:44.623Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 149.566827] niks3-server[1149]: 2026/09/22 13:47:44 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 149.571246] niks3-server[1149]: 2026/09/22 13:47:44 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 149.578103] niks3-server[1149]: 2026/09/22 13:47:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 149.581965] niks3-server[1149]: 2026/09/22 13:47:44 INFO Signed narinfos id=56 count=1 worker2 # [ 149.593817] nix-grpc-daemon[1759]: time=2026-09-22T13:47:44.656Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.584164] niks3-server[1149]: 2026/09/22 13:47:44 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 149.592040] niks3-server[1149]: 2026/09/22 13:47:44 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 149.597514] niks3-server[1149]: 2026/09/22 13:47:44 INFO Completed upload id=56 worker2 # [ 149.609403] nix-grpc-daemon[1759]: time=2026-09-22T13:47:44.672Z level=INFO msg="Upload complete. (190ms)" lb # [ 149.601505] niks3-server[1149]: 2026/09/22 13:47:44 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 149.612358] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker1 # [ 149.609924] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:43Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 149.620591] nix-daemon[870]: reaped child process 1849, status = succeeded worker1 # [ 149.611635] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:43Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 149.662316] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 149.679993] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 149.693273] nix-grpc-daemon[1759]: time=2026-09-22T13:47:44.755Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 149.701967] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 149.719616] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 149.815980] nix-daemon[870]: accepted connection from pid 1874, user nix-grpc-daemon (trusted) worker2 # [ 149.829802] nix-daemon[870]: reaped child process 1877, status = succeeded worker2 # [ 149.905025] nix-daemon[870]: accepted connection from pid 1879, user nix-grpc-daemon (trusted) worker2 # [ 149.920432] nix-daemon[870]: reaped child process 1882, status = succeeded lb # [ 149.912125] niks3-server[1149]: 2026/09/22 13:47:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.939899] nix-grpc-daemon[1759]: time=2026-09-22T13:47:45.002Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 149.941975] nix-grpc-daemon[1759]: time=2026-09-22T13:47:45.004Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 149.945622] niks3-server[1149]: 2026/09/22 13:47:45 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 149.956716] niks3-server[1149]: 2026/09/22 13:47:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 149.963262] niks3-server[1149]: 2026/09/22 13:47:45 INFO Signed narinfos id=57 count=1 worker2 # [ 149.977989] nix-grpc-daemon[1759]: time=2026-09-22T13:47:45.040Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.970843] niks3-server[1149]: 2026/09/22 13:47:45 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 149.982159] niks3-server[1149]: 2026/09/22 13:47:45 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 149.987185] niks3-server[1149]: 2026/09/22 13:47:45 INFO Completed upload id=57 worker2 # [ 150.001070] nix-grpc-daemon[1759]: time=2026-09-22T13:47:45.063Z level=INFO msg="Upload complete. (266ms)" lb # [ 149.990627] niks3-server[1149]: 2026/09/22 13:47:45 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 150.005415] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 150.009927] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 150.020252] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 150.030121] nix-daemon[870]: reaped child process 1872, status = succeeded worker2 # [ 150.032965] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 151.048500] nix-daemon[870]: reaped child process 1886, status = succeeded worker2 # [ 151.123501] nix-daemon[870]: accepted connection from pid 1902, user nix-grpc-daemon (trusted) worker2 # [ 151.137287] nix-daemon[870]: reaped child process 1905, status = succeeded lb # [ 151.133269] niks3-server[1149]: 2026/09/22 13:47:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 151.154102] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.216Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 151.155596] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.218Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 151.172254] niks3-server[1149]: 2026/09/22 13:47:46 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 151.183182] niks3-server[1149]: 2026/09/22 13:47:46 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 151.191377] niks3-server[1149]: 2026/09/22 13:47:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker2 # [ 151.210677] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.273Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.199094] niks3-server[1149]: 2026/09/22 13:47:46 INFO Signed narinfos id=58 count=1 lb # [ 151.210327] niks3-server[1149]: 2026/09/22 13:47:46 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 151.214245] niks3-server[1149]: 2026/09/22 13:47:46 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 151.219109] niks3-server[1149]: 2026/09/22 13:47:46 INFO Completed upload id=58 worker2 # [ 151.232394] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.295Z level=INFO msg="Upload complete. (192ms)" lb # [ 151.221125] niks3-server[1149]: 2026/09/22 13:47:46 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 151.235361] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker1 # [ 151.232558] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:45Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 151.243410] nix-daemon[870]: reaped child process 1884, status = succeeded worker1 # [ 151.234378] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:45Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 151.285126] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 151.293509] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 151.302689] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.365Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 151.308761] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 151.324451] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 151.411466] nix-daemon[870]: accepted connection from pid 1909, user nix-grpc-daemon (trusted) worker2 # [ 151.426045] nix-daemon[870]: reaped child process 1912, status = succeeded worker2 # [ 151.506664] nix-daemon[870]: accepted connection from pid 1914, user nix-grpc-daemon (trusted) worker2 # [ 151.519827] nix-daemon[870]: reaped child process 1917, status = succeeded lb # [ 151.515891] niks3-server[1149]: 2026/09/22 13:47:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 151.535954] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.598Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 151.537565] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.600Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 151.546810] niks3-server[1149]: 2026/09/22 13:47:46 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 151.556418] niks3-server[1149]: 2026/09/22 13:47:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker2 # [ 151.574244] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.636Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.562294] niks3-server[1149]: 2026/09/22 13:47:46 INFO Signed narinfos id=59 count=1 lb # [ 151.575636] niks3-server[1149]: 2026/09/22 13:47:46 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 151.582186] niks3-server[1149]: 2026/09/22 13:47:46 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete worker2 # [ 151.599636] nix-grpc-daemon[1759]: time=2026-09-22T13:47:46.662Z level=INFO msg="Upload complete. (267ms)" lb # [ 151.587909] niks3-server[1149]: 2026/09/22 13:47:46 INFO Completed upload id=59 worker2 # [ 151.601781] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 151.605285] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 lb # [ 151.594137] niks3-server[1149]: 2026/09/22 13:47:46 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 151.613484] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 151.617098] nix-daemon[870]: reaped child process 1907, status = succeeded worker2 # [ 151.620889] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 152.035127] nix-daemon[870]: reaped child process 1921, status = succeeded worker2 # [ 152.105396] nix-daemon[870]: accepted connection from pid 1937, user nix-grpc-daemon (trusted) worker2 # [ 152.119729] nix-daemon[870]: reaped child process 1940, status = succeeded lb # [ 152.112847] niks3-server[1149]: 2026/09/22 13:47:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 152.133195] nix-grpc-daemon[1759]: time=2026-09-22T13:47:47.195Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 152.134690] nix-grpc-daemon[1759]: time=2026-09-22T13:47:47.197Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 152.146601] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 152.166335] niks3-server[1149]: 2026/09/22 13:47:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 152.170303] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst worker2 # [ 152.186338] nix-grpc-daemon[1759]: time=2026-09-22T13:47:47.248Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.174740] niks3-server[1149]: 2026/09/22 13:47:47 INFO Signed narinfos id=60 count=1 lb # [ 152.184852] niks3-server[1149]: 2026/09/22 13:47:47 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 152.189294] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 152.191523] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo lb # [ 152.194067] niks3-server[1149]: 2026/09/22 13:47:47 INFO Completed upload id=60 worker2 # [ 152.207468] nix-grpc-daemon[1759]: time=2026-09-22T13:47:47.270Z level=INFO msg="Upload complete. (181ms)" worker2 # [ 152.212800] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 152.226902] nix-daemon[870]: reaped child process 1919, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.63 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 152.508583] nix-daemon[848]: reaped child process 1752, status = succeeded worker1 # [ 152.580263] nix-daemon[848]: accepted connection from pid 1799, user nix-grpc-daemon (trusted) worker1 # [ 152.592335] nix-daemon[848]: reaped child process 1802, status = succeeded lb # [ 152.596928] niks3-server[1149]: 2026/09/22 13:47:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.607780] nix-grpc-daemon[1684]: time=2026-09-22T13:47:46.880Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.609296] nix-grpc-daemon[1684]: time=2026-09-22T13:47:46.882Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 152.627660] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 152.644956] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 152.658882] niks3-server[1149]: 2026/09/22 13:47:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 152.662833] niks3-server[1149]: 2026/09/22 13:47:47 INFO Signed narinfos id=61 count=1 worker1 # [ 152.668643] nix-grpc-daemon[1684]: time=2026-09-22T13:47:46.940Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.667449] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 152.677542] niks3-server[1149]: 2026/09/22 13:47:47 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 152.681567] niks3-server[1149]: 2026/09/22 13:47:47 INFO Completed upload id=61 worker1 # [ 152.684384] nix-grpc-daemon[1684]: time=2026-09-22T13:47:46.957Z level=INFO msg="Upload complete. (185ms)" lb # [ 152.684499] niks3-server[1149]: 2026/09/22 13:47:47 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 152.692442] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48452 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 152.705881] nix-daemon[848]: reaped child process 1750, status = succeeded client # [ 152.745746] systemd[1]: sw.service: Deactivated successfully. client # [ 152.750315] systemd[1]: sw.service: Consumed 131ms CPU time over 8.627s wall clock time, 43.4M memory peak, 7.6K incoming IP traffic, 8.6K outgoing IP traffic. worker1 # [ 153.226318] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:47Z level=info event=signal_exit lb # [ 153.232701] niks3-server[1149]: 2026/09/22 13:47:48 INFO lead: released remote=192.168.1.3:54988 client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 154.244985] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:49Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 154.240317] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:48Z level=info event=scheduler_restarting worker1 # [ 154.244069] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48436 worker1 # [ 154.248231] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:48Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 154.252270] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 154.255599] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48436 worker1 # [ 154.259123] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:48Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 154.274363] nix-daemon[848]: reaped child process 1655, status = succeeded worker2 # [ 154.445933] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.450175] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 154.449447] nix-grpc-daemon[1600]: ts=2026-09-22T13:47:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 154.650817] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.652664] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 154.853459] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.855267] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 155.003267] nix-grpc-daemon[1600]: E0000 00:00:1790084869.275801 1646 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 20, started true, shutdown true worker1 # [ 155.005249] nix-grpc-daemon[1600]: E0000 00:00:1790084869.275955 1646 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 155.056108] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.058042] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.259298] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.260968] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.454817] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_take_over lb # [ 155.443498] niks3-server[1149]: 2026/09/22 13:47:50 INFO lead: acquired remote=192.168.1.4:57324 worker2 # [ 155.461604] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.463241] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 155.587423] envoy[917]: conn peer=[2001:db8:1::1]:52732 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9568 tx=4381 ms=4464 lb # [ 155.591151] envoy[917]: conn peer=[2001:db8:1::1]:52726 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1558 ms=8469 lb # [ 155.594701] envoy[917]: conn peer=[2001:db8:1::3]:34250 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=958 tx=344 ms=20178 worker2 # [ 155.664588] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.668536] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.869729] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.873599] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 156.074772] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.078867] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.257484] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 156.262561] systemd[1]: nix-grpc-daemon.service: Consumed 601ms CPU time over 22.163s wall clock time, 36.8M memory peak, 24.2K incoming IP traffic, 31.4K outgoing IP traffic. worker2 # [ 156.279914] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.281580] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.277168] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 156.365636] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 156.369916] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 156.372848] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 156.376370] nix-grpc-daemon[1816]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 156.381971] nix-grpc-daemon[1816]: E0000 00:00:1790084870.645185 1816 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 156.385382] nix-grpc-daemon[1816]: E0000 00:00:1790084870.648899 1816 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 156.389817] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 156.392143] nix-grpc-daemon[1816]: E0000 00:00:1790084870.661146 1857 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 156.397156] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 156.406080] nix-grpc-daemon[1816]: E0000 00:00:1790084870.676664 1857 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 156.408169] nix-grpc-daemon[1816]: E0000 00:00:1790084870.677116 1857 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.89 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 156.419742] nix-grpc-daemon[1816]: E0000 00:00:1790084870.691764 1857 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 156.429584] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.448487] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:33346 worker2 # [ 156.450421] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 156.482070] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.486060] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 156.487790] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:33346 worker2 # [ 156.489372] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.54 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 157.745755] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53166 worker1 # [ 157.748630] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 157.759822] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 157.775902] nix-grpc-daemon[1816]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 1/5) worker1 # [ 157.876888] nix-grpc-daemon[1816]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 2/5) worker1 # [ 157.945905] nix-grpc-daemon[1816]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 3/5) worker1 # [ 158.104854] nix-grpc-daemon[1816]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 4/5) worker1 # [ 158.134555] nix-grpc-daemon[1816]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 158.137654] nix-grpc-daemon[1816]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 158.191715] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:53Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 158.195954] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:53Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 158.200285] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:53Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 158.204073] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:53Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 158.226074] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 158.234984] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 158.242291] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 158.245914] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 158.257689] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:52Z level=info event=niks3_push_started pid=1876 worker1 # [ 158.346719] nix-grpc-daemon[1876]: time=2026-09-22T13:47:52.619Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 158.429784] nix-daemon[848]: accepted connection from pid 1889, user nix-grpc-daemon (trusted) worker1 # [ 158.442803] nix-daemon[848]: reaped child process 1892, status = succeeded worker1 # [ 158.522843] nix-daemon[848]: accepted connection from pid 1894, user nix-grpc-daemon (trusted) worker1 # [ 158.535966] nix-daemon[848]: reaped child process 1897, status = succeeded lb # [ 158.539984] niks3-server[1149]: 2026/09/22 13:47:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.551978] nix-grpc-daemon[1876]: time=2026-09-22T13:47:52.823Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.553335] nix-grpc-daemon[1876]: time=2026-09-22T13:47:52.823Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 158.577406] niks3-server[1149]: 2026/09/22 13:47:53 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 158.590916] niks3-server[1149]: 2026/09/22 13:47:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 158.600482] nix-grpc-daemon[1876]: time=2026-09-22T13:47:52.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.597532] niks3-server[1149]: 2026/09/22 13:47:53 INFO Signed narinfos id=62 count=1 lb # [ 158.607574] niks3-server[1149]: 2026/09/22 13:47:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 158.617847] niks3-server[1149]: 2026/09/22 13:47:53 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 158.622120] niks3-server[1149]: 2026/09/22 13:47:53 INFO Completed upload id=62 worker1 # [ 158.624805] nix-grpc-daemon[1876]: time=2026-09-22T13:47:52.897Z level=INFO msg="Upload complete. (275ms)" worker1 # [ 158.627143] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 158.624936] niks3-server[1149]: 2026/09/22 13:47:53 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 158.630085] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 158.638088] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 158.639375] nix-daemon[848]: reaped child process 1874, status = succeeded worker1 # [ 158.644426] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 159.685685] nix-daemon[848]: reaped child process 1901, status = succeeded worker1 # [ 159.759661] nix-daemon[848]: accepted connection from pid 1917, user nix-grpc-daemon (trusted) worker1 # [ 159.770472] nix-daemon[848]: reaped child process 1920, status = succeeded lb # [ 159.775637] niks3-server[1149]: 2026/09/22 13:47:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.788782] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.061Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.790334] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.063Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 159.812719] niks3-server[1149]: 2026/09/22 13:47:54 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 159.828199] niks3-server[1149]: 2026/09/22 13:47:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 159.832862] niks3-server[1149]: 2026/09/22 13:47:54 INFO Signed narinfos id=63 count=1 worker1 # [ 159.838368] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.110Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.841931] niks3-server[1149]: 2026/09/22 13:47:54 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 159.847201] niks3-server[1149]: 2026/09/22 13:47:54 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 159.850570] niks3-server[1149]: 2026/09/22 13:47:54 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 159.853110] niks3-server[1149]: 2026/09/22 13:47:54 INFO Completed upload id=63 worker1 # [ 159.857795] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.130Z level=INFO msg="Upload complete. (206ms)" lb # [ 159.856596] niks3-server[1149]: 2026/09/22 13:47:54 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 159.862877] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker2 # [ 159.876309] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:54Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.875652] nix-daemon[848]: reaped child process 1899, status = succeeded worker2 # [ 159.883961] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:54Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 159.910321] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 159.922642] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 159.933468] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 159.943165] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 160.036098] nix-daemon[848]: accepted connection from pid 1924, user nix-grpc-daemon (trusted) worker1 # [ 160.048592] nix-daemon[848]: reaped child process 1927, status = succeeded worker1 # [ 160.128324] nix-daemon[848]: accepted connection from pid 1929, user nix-grpc-daemon (trusted) worker1 # [ 160.140846] nix-daemon[848]: reaped child process 1932, status = succeeded lb # [ 160.144442] niks3-server[1149]: 2026/09/22 13:47:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.155276] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.427Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.157169] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.429Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 160.172210] niks3-server[1149]: 2026/09/22 13:47:55 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 160.180728] niks3-server[1149]: 2026/09/22 13:47:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 160.185239] niks3-server[1149]: 2026/09/22 13:47:55 INFO Signed narinfos id=64 count=1 worker1 # [ 160.190921] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.463Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.200675] niks3-server[1149]: 2026/09/22 13:47:55 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 160.208093] niks3-server[1149]: 2026/09/22 13:47:55 INFO Completed upload id=64 worker1 # [ 160.210839] nix-grpc-daemon[1876]: time=2026-09-22T13:47:54.483Z level=INFO msg="Upload complete. (256ms)" worker1 # [ 160.214224] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 160.214985] niks3-server[1149]: 2026/09/22 13:47:55 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 160.219127] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 160.227131] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) lb # [ 160.225655] niks3-server[1149]: 2026/09/22 13:47:55 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls worker1 # [ 160.232639] nix-daemon[848]: reaped child process 1922, status = succeeded worker1 # [ 160.236675] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 161.651976] nix-daemon[848]: reaped child process 1936, status = succeeded worker1 # [ 161.724715] nix-daemon[848]: accepted connection from pid 1952, user nix-grpc-daemon (trusted) worker1 # [ 161.737278] nix-daemon[848]: reaped child process 1955, status = succeeded lb # [ 161.742276] niks3-server[1149]: 2026/09/22 13:47:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.756280] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.028Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 161.757926] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.030Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 161.776776] niks3-server[1149]: 2026/09/22 13:47:56 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 161.795926] niks3-server[1149]: 2026/09/22 13:47:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker1 # [ 161.804715] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.077Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.801613] niks3-server[1149]: 2026/09/22 13:47:56 INFO Signed narinfos id=65 count=1 lb # [ 161.808177] niks3-server[1149]: 2026/09/22 13:47:56 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 161.814297] niks3-server[1149]: 2026/09/22 13:47:56 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 161.820286] niks3-server[1149]: 2026/09/22 13:47:56 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 161.823376] niks3-server[1149]: 2026/09/22 13:47:56 INFO Completed upload id=65 worker1 # [ 161.826432] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.099Z level=INFO msg="Upload complete. (182ms)" lb # [ 161.825938] niks3-server[1149]: 2026/09/22 13:47:56 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 161.832739] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker2 # [ 161.847285] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:56Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 161.852985] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:56Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 161.848159] nix-daemon[848]: reaped child process 1934, status = succeeded worker1 # [ 161.878522] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 161.890757] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 161.902063] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 161.911358] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 162.005900] nix-daemon[848]: accepted connection from pid 1959, user nix-grpc-daemon (trusted) worker1 # [ 162.017876] nix-daemon[848]: reaped child process 1962, status = succeeded worker1 # [ 162.098155] nix-daemon[848]: accepted connection from pid 1964, user nix-grpc-daemon (trusted) worker1 # [ 162.110267] nix-daemon[848]: reaped child process 1967, status = succeeded lb # [ 162.114567] niks3-server[1149]: 2026/09/22 13:47:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.125258] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.397Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 162.126680] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.397Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 162.141107] niks3-server[1149]: 2026/09/22 13:47:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker1 # [ 162.150387] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.422Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.147839] niks3-server[1149]: 2026/09/22 13:47:57 INFO Signed narinfos id=66 count=1 lb # [ 162.154657] niks3-server[1149]: 2026/09/22 13:47:57 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 162.163423] niks3-server[1149]: 2026/09/22 13:47:57 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 162.173931] niks3-server[1149]: 2026/09/22 13:47:57 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker1 # [ 162.182491] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.455Z level=INFO msg="Upload complete. (259ms)" lb # [ 162.179568] niks3-server[1149]: 2026/09/22 13:47:57 INFO Completed upload id=66 worker1 # [ 162.184716] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 162.186807] niks3-server[1149]: 2026/09/22 13:47:57 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 162.189267] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 162.197342] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 162.201795] nix-daemon[848]: reaped child process 1957, status = succeeded worker1 # [ 162.206541] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 162.618286] nix-daemon[848]: reaped child process 1971, status = succeeded worker1 # [ 162.692441] nix-daemon[848]: accepted connection from pid 1987, user nix-grpc-daemon (trusted) worker1 # [ 162.704473] nix-daemon[848]: reaped child process 1990, status = succeeded lb # [ 162.709187] niks3-server[1149]: 2026/09/22 13:47:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.719666] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.992Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 162.722461] nix-grpc-daemon[1876]: time=2026-09-22T13:47:56.993Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 162.736789] niks3-server[1149]: 2026/09/22 13:47:57 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 162.755714] niks3-server[1149]: 2026/09/22 13:47:57 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 162.763690] niks3-server[1149]: 2026/09/22 13:47:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 162.767308] niks3-server[1149]: 2026/09/22 13:47:57 INFO Signed narinfos id=67 count=1 worker1 # [ 162.772916] nix-grpc-daemon[1876]: time=2026-09-22T13:47:57.045Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.777837] niks3-server[1149]: 2026/09/22 13:47:57 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 162.786279] niks3-server[1149]: 2026/09/22 13:47:57 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 162.790124] niks3-server[1149]: 2026/09/22 13:47:57 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo lb # [ 162.792268] niks3-server[1149]: 2026/09/22 13:47:57 INFO Completed upload id=67 worker1 # [ 162.795363] nix-grpc-daemon[1876]: time=2026-09-22T13:47:57.067Z level=INFO msg="Upload complete. (183ms)" worker1 # [ 162.800365] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker2 # [ 162.810878] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:57Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 162.820164] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:57Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 162.815083] nix-daemon[848]: reaped child process 1969, status = succeeded worker1 # [ 162.846581] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 162.857792] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 162.870304] nix-grpc-daemon[1876]: time=2026-09-22T13:47:57.142Z level=INFO msg="All 1 paths already cached" worker1 # [ 162.877489] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 162.885301] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 162.980662] nix-daemon[848]: accepted connection from pid 1994, user nix-grpc-daemon (trusted) worker1 # [ 162.993254] nix-daemon[848]: reaped child process 1997, status = succeeded worker1 # [ 163.072652] nix-daemon[848]: accepted connection from pid 1999, user nix-grpc-daemon (trusted) worker1 # [ 163.084652] nix-daemon[848]: reaped child process 2002, status = succeeded lb # [ 163.089187] niks3-server[1149]: 2026/09/22 13:47:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.100280] nix-grpc-daemon[1876]: time=2026-09-22T13:47:57.372Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.101677] nix-grpc-daemon[1876]: time=2026-09-22T13:47:57.372Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 163.113278] niks3-server[1149]: 2026/09/22 13:47:58 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 163.126791] niks3-server[1149]: 2026/09/22 13:47:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker1 # [ 163.137719] nix-grpc-daemon[1876]: time=2026-09-22T13:47:57.410Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.134294] niks3-server[1149]: 2026/09/22 13:47:58 INFO Signed narinfos id=68 count=1 lb # [ 163.139064] niks3-server[1149]: 2026/09/22 13:47:58 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 163.151765] niks3-server[1149]: 2026/09/22 13:47:58 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker1 # [ 163.161257] nix-grpc-daemon[1876]: time=2026-09-22T13:47:57.433Z level=INFO msg="Upload complete. (262ms)" lb # [ 163.159171] niks3-server[1149]: 2026/09/22 13:47:58 INFO Completed upload id=68 worker1 # [ 163.163378] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 163.162994] niks3-server[1149]: 2026/09/22 13:47:58 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 163.170072] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 163.171788] nix-daemon[848]: reaped child process 1992, status = succeeded worker1 # [ 163.174699] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 163.181081] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 164.446590] nix-daemon[848]: reaped child process 2006, status = succeeded worker1 # [ 164.488078] nix-daemon[848]: accepted connection from pid 2022, user nix-grpc-daemon (trusted) worker1 # [ 164.500651] nix-daemon[848]: reaped child process 2025, status = succeeded lb # [ 164.502461] niks3-server[1149]: 2026/09/22 13:47:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.513863] nix-grpc-daemon[1876]: time=2026-09-22T13:47:58.786Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.515794] nix-grpc-daemon[1876]: time=2026-09-22T13:47:58.788Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 164.528901] niks3-server[1149]: 2026/09/22 13:47:59 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 164.535874] niks3-server[1149]: 2026/09/22 13:47:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 164.540669] niks3-server[1149]: 2026/09/22 13:47:59 INFO Signed narinfos id=69 count=1 worker1 # [ 164.545874] nix-grpc-daemon[1876]: time=2026-09-22T13:47:58.818Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.547078] niks3-server[1149]: 2026/09/22 13:47:59 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 164.552687] niks3-server[1149]: 2026/09/22 13:47:59 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 164.557956] niks3-server[1149]: 2026/09/22 13:47:59 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 164.561290] niks3-server[1149]: 2026/09/22 13:47:59 INFO Completed upload id=69 worker1 # [ 164.564197] nix-grpc-daemon[1876]: time=2026-09-22T13:47:58.836Z level=INFO msg="Upload complete. (175ms)" lb # [ 164.563765] niks3-server[1149]: 2026/09/22 13:47:59 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 164.566854] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker1 # [ 164.573994] nix-daemon[848]: reaped child process 2004, status = succeeded worker2 # [ 164.579658] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:59Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 164.588709] nix-grpc-daemon[1667]: ts=2026-09-22T13:47:59Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 164.613356] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 164.620690] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 164.628386] nix-grpc-daemon[1876]: time=2026-09-22T13:47:58.901Z level=INFO msg="All 1 paths already cached" worker1 # [ 164.632265] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 164.636878] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 164.713742] nix-daemon[848]: accepted connection from pid 2029, user nix-grpc-daemon (trusted) worker1 # [ 164.727173] nix-daemon[848]: reaped child process 2032, status = succeeded worker1 # [ 164.799318] nix-daemon[848]: accepted connection from pid 2034, user nix-grpc-daemon (trusted) worker1 # [ 164.814054] nix-daemon[848]: reaped child process 2037, status = succeeded lb # [ 164.810849] niks3-server[1149]: 2026/09/22 13:47:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.822346] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.094Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.823740] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.094Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 164.839557] niks3-server[1149]: 2026/09/22 13:47:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 164.849422] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.122Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.846894] niks3-server[1149]: 2026/09/22 13:47:59 INFO Signed narinfos id=70 count=1 lb # [ 164.852326] niks3-server[1149]: 2026/09/22 13:47:59 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 164.857120] niks3-server[1149]: 2026/09/22 13:47:59 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 164.873089] niks3-server[1149]: 2026/09/22 13:47:59 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete worker1 # [ 164.880255] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.152Z level=INFO msg="Upload complete. (238ms)" lb # [ 164.877620] niks3-server[1149]: 2026/09/22 13:47:59 INFO Completed upload id=70 worker1 # [ 164.882286] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 164.882680] niks3-server[1149]: 2026/09/22 13:48:00 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 164.888686] nix-daemon[848]: reaped child process 2027, status = succeeded worker1 # [ 164.890299] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 164.893433] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 164.899610] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 165.531620] nix-daemon[848]: reaped child process 2041, status = succeeded worker1 # [ 165.609933] nix-daemon[848]: accepted connection from pid 2057, user nix-grpc-daemon (trusted) worker1 # [ 165.623939] nix-daemon[848]: reaped child process 2060, status = succeeded lb # [ 165.627914] niks3-server[1149]: 2026/09/22 13:48:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.638505] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.911Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 165.640144] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.912Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 165.662861] niks3-server[1149]: 2026/09/22 13:48:00 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 165.677154] niks3-server[1149]: 2026/09/22 13:48:00 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 165.682102] niks3-server[1149]: 2026/09/22 13:48:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 165.686265] niks3-server[1149]: 2026/09/22 13:48:00 INFO Signed narinfos id=71 count=1 worker1 # [ 165.691695] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.964Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.693093] niks3-server[1149]: 2026/09/22 13:48:00 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 165.697411] niks3-server[1149]: 2026/09/22 13:48:00 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 165.700436] niks3-server[1149]: 2026/09/22 13:48:00 INFO Completed upload id=71 worker1 # [ 165.704909] nix-grpc-daemon[1876]: time=2026-09-22T13:47:59.977Z level=INFO msg="Upload complete. (197ms)" lb # [ 165.703516] niks3-server[1149]: 2026/09/22 13:48:00 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 165.711311] nix-grpc-daemon[1816]: ts=2026-09-22T13:47:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker2 # [ 165.720886] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:00Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 165.723271] nix-daemon[848]: reaped child process 2039, status = succeeded worker1 # [ 165.755188] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker2 # [ 165.766399] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:00Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 165.766701] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 165.778112] nix-grpc-daemon[1876]: time=2026-09-22T13:48:00.050Z level=INFO msg="All 1 paths already cached" worker1 # [ 165.786131] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 165.795171] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 165.891602] nix-daemon[848]: accepted connection from pid 2064, user nix-grpc-daemon (trusted) worker1 # [ 165.904897] nix-daemon[848]: reaped child process 2067, status = succeeded worker1 # [ 165.983561] nix-daemon[848]: accepted connection from pid 2069, user nix-grpc-daemon (trusted) worker1 # [ 165.997692] nix-daemon[848]: reaped child process 2072, status = succeeded lb # [ 165.998485] niks3-server[1149]: 2026/09/22 13:48:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.009921] nix-grpc-daemon[1876]: time=2026-09-22T13:48:00.282Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 166.011290] nix-grpc-daemon[1876]: time=2026-09-22T13:48:00.282Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 166.025149] niks3-server[1149]: 2026/09/22 13:48:01 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 166.036570] niks3-server[1149]: 2026/09/22 13:48:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign worker1 # [ 166.044963] nix-grpc-daemon[1876]: time=2026-09-22T13:48:00.317Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.041936] niks3-server[1149]: 2026/09/22 13:48:01 INFO Signed narinfos id=72 count=1 lb # [ 166.047582] niks3-server[1149]: 2026/09/22 13:48:01 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 166.056184] niks3-server[1149]: 2026/09/22 13:48:01 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 166.060323] niks3-server[1149]: 2026/09/22 13:48:01 INFO Completed upload id=72 worker1 # [ 166.063141] nix-grpc-daemon[1876]: time=2026-09-22T13:48:00.335Z level=INFO msg="Upload complete. (257ms)" lb # [ 166.062061] niks3-server[1149]: 2026/09/22 13:48:01 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 166.065368] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 166.069471] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 166.076087] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 166.077340] nix-daemon[848]: reaped child process 2062, status = succeeded worker1 # [ 166.082307] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 167.520131] nix-daemon[848]: reaped child process 2076, status = succeeded worker1 # [ 167.598878] nix-daemon[848]: accepted connection from pid 2092, user nix-grpc-daemon (trusted) worker1 # [ 167.611729] nix-daemon[848]: reaped child process 2095, status = succeeded lb # [ 167.615537] niks3-server[1149]: 2026/09/22 13:48:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.626230] nix-grpc-daemon[1876]: time=2026-09-22T13:48:01.898Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 167.627887] nix-grpc-daemon[1876]: time=2026-09-22T13:48:01.900Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 167.651623] niks3-server[1149]: 2026/09/22 13:48:02 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 167.661906] niks3-server[1149]: 2026/09/22 13:48:02 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 167.667193] niks3-server[1149]: 2026/09/22 13:48:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 167.672825] niks3-server[1149]: 2026/09/22 13:48:02 INFO Signed narinfos id=73 count=1 worker1 # [ 167.678630] nix-grpc-daemon[1876]: time=2026-09-22T13:48:01.951Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.683155] niks3-server[1149]: 2026/09/22 13:48:02 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 167.691615] niks3-server[1149]: 2026/09/22 13:48:02 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 167.696646] niks3-server[1149]: 2026/09/22 13:48:02 INFO Completed upload id=73 worker1 # [ 167.699846] nix-grpc-daemon[1876]: time=2026-09-22T13:48:01.972Z level=INFO msg="Upload complete. (209ms)" lb # [ 167.699394] niks3-server[1149]: 2026/09/22 13:48:02 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 167.705860] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker2 # [ 167.716646] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:02Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 167.715323] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker2 # [ 167.725799] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:02Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 167.726062] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 167.734583] nix-daemon[848]: reaped child process 2074, status = succeeded worker1 # [ 167.737799] nix-grpc-daemon[1876]: time=2026-09-22T13:48:02.009Z level=INFO msg="All 2 paths already cached" worker1 # [ 167.741605] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 167.746348] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 167.827862] nix-daemon[848]: accepted connection from pid 2099, user nix-grpc-daemon (trusted) worker1 # [ 167.843323] nix-daemon[848]: reaped child process 2102, status = succeeded worker1 # [ 167.919041] nix-daemon[848]: accepted connection from pid 2104, user nix-grpc-daemon (trusted) worker1 # [ 167.932614] nix-daemon[848]: reaped child process 2107, status = succeeded lb # [ 167.934616] niks3-server[1149]: 2026/09/22 13:48:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.945178] nix-grpc-daemon[1876]: time=2026-09-22T13:48:02.217Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 167.946766] nix-grpc-daemon[1876]: time=2026-09-22T13:48:02.219Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 167.965754] niks3-server[1149]: 2026/09/22 13:48:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 167.972456] niks3-server[1149]: 2026/09/22 13:48:03 INFO Signed narinfos id=74 count=1 worker1 # [ 167.978110] nix-grpc-daemon[1876]: time=2026-09-22T13:48:02.250Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.976357] niks3-server[1149]: 2026/09/22 13:48:03 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 167.984233] niks3-server[1149]: 2026/09/22 13:48:03 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 167.997084] niks3-server[1149]: 2026/09/22 13:48:03 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 168.002436] niks3-server[1149]: 2026/09/22 13:48:03 INFO Completed upload id=74 worker1 # [ 168.007809] nix-grpc-daemon[1876]: time=2026-09-22T13:48:02.280Z level=INFO msg="Upload complete. (256ms)" worker1 # [ 168.010457] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 168.009581] niks3-server[1149]: 2026/09/22 13:48:03 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 168.016998] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 168.027130] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 168.030127] nix-daemon[848]: reaped child process 2097, status = succeeded worker1 # [ 168.035132] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 168.850843] nix-daemon[848]: reaped child process 2111, status = succeeded worker1 # [ 168.923550] nix-daemon[848]: accepted connection from pid 2127, user nix-grpc-daemon (trusted) worker1 # [ 168.935760] nix-daemon[848]: reaped child process 2130, status = succeeded lb # [ 168.941252] niks3-server[1149]: 2026/09/22 13:48:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.952267] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.224Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.953887] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.226Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 168.975144] niks3-server[1149]: 2026/09/22 13:48:04 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 168.988761] niks3-server[1149]: 2026/09/22 13:48:04 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 169.001408] niks3-server[1149]: 2026/09/22 13:48:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 169.006340] niks3-server[1149]: 2026/09/22 13:48:04 INFO Signed narinfos id=75 count=1 worker1 # [ 169.011369] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.283Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.012548] niks3-server[1149]: 2026/09/22 13:48:04 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 169.021038] niks3-server[1149]: 2026/09/22 13:48:04 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 169.023461] niks3-server[1149]: 2026/09/22 13:48:04 INFO Completed upload id=75 worker1 # [ 169.026469] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.299Z level=INFO msg="Upload complete. (184ms)" lb # [ 169.026534] niks3-server[1149]: 2026/09/22 13:48:04 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 169.032915] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 worker2 # [ 169.042740] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:04Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 169.047246] nix-daemon[848]: reaped child process 2109, status = succeeded worker1 # [ 169.083830] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 169.095819] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 169.108217] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.380Z level=INFO msg="All 2 paths already cached" worker1 # [ 169.115904] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 169.125350] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 169.221069] nix-daemon[848]: accepted connection from pid 2134, user nix-grpc-daemon (trusted) worker1 # [ 169.234117] nix-daemon[848]: reaped child process 2137, status = succeeded worker1 # [ 169.314772] nix-daemon[848]: accepted connection from pid 2139, user nix-grpc-daemon (trusted) worker1 # [ 169.329209] nix-daemon[848]: reaped child process 2142, status = succeeded lb # [ 169.329548] niks3-server[1149]: 2026/09/22 13:48:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.341036] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.613Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 169.342548] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.613Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 169.358158] niks3-server[1149]: 2026/09/22 13:48:04 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 169.368994] niks3-server[1149]: 2026/09/22 13:48:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign lb # [ 169.373398] niks3-server[1149]: 2026/09/22 13:48:04 INFO Signed narinfos id=76 count=1 worker1 # [ 169.379389] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.651Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.380374] niks3-server[1149]: 2026/09/22 13:48:04 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 169.393575] niks3-server[1149]: 2026/09/22 13:48:04 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete worker1 # [ 169.401614] nix-grpc-daemon[1876]: time=2026-09-22T13:48:03.674Z level=INFO msg="Upload complete. (264ms)" lb # [ 169.398740] niks3-server[1149]: 2026/09/22 13:48:04 INFO Completed upload id=76 worker1 # [ 169.403838] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 169.404109] niks3-server[1149]: 2026/09/22 13:48:04 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 169.409675] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 169.418439] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 169.425079] nix-daemon[848]: reaped child process 2132, status = succeeded worker1 # [ 169.427832] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 170.260745] nix-daemon[848]: reaped child process 2146, status = succeeded worker1 # [ 170.340561] nix-daemon[848]: accepted connection from pid 2162, user nix-grpc-daemon (trusted) worker1 # [ 170.351570] nix-daemon[848]: reaped child process 2165, status = succeeded lb # [ 170.356888] niks3-server[1149]: 2026/09/22 13:48:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.367904] nix-grpc-daemon[1876]: time=2026-09-22T13:48:04.640Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.369439] nix-grpc-daemon[1876]: time=2026-09-22T13:48:04.642Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 170.392996] niks3-server[1149]: 2026/09/22 13:48:05 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 170.403286] niks3-server[1149]: 2026/09/22 13:48:05 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 170.411158] niks3-server[1149]: 2026/09/22 13:48:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 170.419798] niks3-server[1149]: 2026/09/22 13:48:05 INFO Signed narinfos id=77 count=1 worker1 # [ 170.425077] nix-grpc-daemon[1876]: time=2026-09-22T13:48:04.697Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.428115] niks3-server[1149]: 2026/09/22 13:48:05 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 170.436392] niks3-server[1149]: 2026/09/22 13:48:05 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 170.442443] niks3-server[1149]: 2026/09/22 13:48:05 INFO Completed upload id=77 worker1 # [ 170.445503] nix-grpc-daemon[1876]: time=2026-09-22T13:48:04.718Z level=INFO msg="Upload complete. (210ms)" lb # [ 170.445780] niks3-server[1149]: 2026/09/22 13:48:05 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 170.451774] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker2 # [ 170.461569] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:05Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 170.466472] nix-daemon[848]: reaped child process 2144, status = succeeded worker1 # [ 170.503165] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 170.515248] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 170.527949] nix-grpc-daemon[1876]: time=2026-09-22T13:48:04.800Z level=INFO msg="All 2 paths already cached" worker1 # [ 170.535841] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 170.545343] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 170.640859] nix-daemon[848]: accepted connection from pid 2169, user nix-grpc-daemon (trusted) worker1 # [ 170.653289] nix-daemon[848]: reaped child process 2172, status = succeeded worker1 # [ 170.733711] nix-daemon[848]: accepted connection from pid 2174, user nix-grpc-daemon (trusted) worker1 # [ 170.745815] nix-daemon[848]: reaped child process 2177, status = succeeded lb # [ 170.750443] niks3-server[1149]: 2026/09/22 13:48:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.761202] nix-grpc-daemon[1876]: time=2026-09-22T13:48:05.033Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.762613] nix-grpc-daemon[1876]: time=2026-09-22T13:48:05.033Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 170.778129] niks3-server[1149]: 2026/09/22 13:48:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign worker1 # [ 170.792127] nix-grpc-daemon[1876]: time=2026-09-22T13:48:05.064Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.790284] niks3-server[1149]: 2026/09/22 13:48:05 INFO Signed narinfos id=78 count=1 lb # [ 170.793698] niks3-server[1149]: 2026/09/22 13:48:05 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 170.799785] niks3-server[1149]: 2026/09/22 13:48:05 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 170.810564] niks3-server[1149]: 2026/09/22 13:48:05 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete worker1 # [ 170.819808] nix-grpc-daemon[1876]: time=2026-09-22T13:48:05.092Z level=INFO msg="Upload complete. (262ms)" lb # [ 170.817161] niks3-server[1149]: 2026/09/22 13:48:05 INFO Completed upload id=78 worker1 # [ 170.822243] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 170.822243] niks3-server[1149]: 2026/09/22 13:48:05 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 170.829803] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 worker1 # [ 170.839414] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 170.841417] nix-daemon[848]: reaped child process 2167, status = succeeded worker1 # [ 170.846673] nix-daemon[848]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 172.084573] nix-daemon[848]: reaped child process 2181, status = succeeded worker1 # [ 172.169299] nix-daemon[848]: accepted connection from pid 2197, user nix-grpc-daemon (trusted) worker1 # [ 172.182818] nix-daemon[848]: reaped child process 2200, status = succeeded lb # [ 172.186328] niks3-server[1149]: 2026/09/22 13:48:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.199265] nix-grpc-daemon[1876]: time=2026-09-22T13:48:06.471Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 172.202055] nix-grpc-daemon[1876]: time=2026-09-22T13:48:06.473Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 172.224503] niks3-server[1149]: 2026/09/22 13:48:07 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 172.235798] niks3-server[1149]: 2026/09/22 13:48:07 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 172.244736] niks3-server[1149]: 2026/09/22 13:48:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 172.250942] niks3-server[1149]: 2026/09/22 13:48:07 INFO Signed narinfos id=79 count=1 worker1 # [ 172.256702] nix-grpc-daemon[1876]: time=2026-09-22T13:48:06.529Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.257313] niks3-server[1149]: 2026/09/22 13:48:07 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 172.267596] niks3-server[1149]: 2026/09/22 13:48:07 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 172.270072] niks3-server[1149]: 2026/09/22 13:48:07 INFO Completed upload id=79 worker1 # [ 172.273144] nix-grpc-daemon[1876]: time=2026-09-22T13:48:06.545Z level=INFO msg="Upload complete. (218ms)" lb # [ 172.272360] niks3-server[1149]: 2026/09/22 13:48:07 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 172.279489] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57554 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 worker1 # [ 172.295782] nix-daemon[848]: reaped child process 2179, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 14.74 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 172.431617] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 3604f1954d9e4b68882071f30754cbb3 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 172.545497] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57554 client # [ 172.576536] nix[1539]: don't know how to build these paths: client # [ 172.577418] nix[1539]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 172.565214] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 client # [ 172.600916] nix[1539]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 172.584178] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:07Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 175.589906] envoy[917]: conn peer=[2001:db8:1::1]:59486 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27051 tx=12290 ms=14561 client # [ 202.603169] nix[1539]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 202.609572] nix[1539]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 202.643400] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 202.647575] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 202.650805] systemd[1]: gpu.service: Consumed 157ms CPU time over 30.211s wall clock time, 37.6M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.36 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.55 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.95 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 204.393947] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:38Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 worker2 # [ 205.296459] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53166 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker1 # [ 205.294733] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57554 worker2 # [ 205.315586] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 205.318155] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 205.358582] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 205.365363] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 205.371387] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 205.377330] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 205.462761] nix-daemon[870]: accepted connection from pid 1974, user nix-grpc-daemon (trusted) worker2 # [ 205.484941] nix-daemon[870]: reaped child process 1977, status = succeeded worker2 # [ 205.559899] nix-daemon[870]: accepted connection from pid 1979, user nix-grpc-daemon (trusted) worker2 # [ 205.576316] nix-daemon[870]: reaped child process 1982, status = succeeded lb # [ 205.568068] niks3-server[1149]: 2026/09/22 13:48:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.586133] nix-grpc-daemon[1759]: time=2026-09-22T13:48:40.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 205.587710] nix-grpc-daemon[1759]: time=2026-09-22T13:48:40.648Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 205.586196] niks3-server[1149]: 2026/09/22 13:48:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign lb # [ 205.589218] niks3-server[1149]: 2026/09/22 13:48:40 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 205.592159] niks3-server[1149]: 2026/09/22 13:48:40 INFO Signed narinfos id=80 count=1 worker2 # [ 205.604031] nix-grpc-daemon[1759]: time=2026-09-22T13:48:40.666Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.593744] envoy[917]: conn peer=[2001:db8:1::1]:37302 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=30052 lb # [ 205.601532] niks3-server[1149]: 2026/09/22 13:48:40 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 205.604096] niks3-server[1149]: 2026/09/22 13:48:40 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 205.607732] niks3-server[1149]: 2026/09/22 13:48:40 INFO Completed upload id=80 worker2 # [ 205.619589] nix-grpc-daemon[1759]: time=2026-09-22T13:48:40.682Z level=INFO msg="Upload complete. (237ms)" worker2 # [ 205.621723] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 205.625094] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 lb # [ 205.615579] niks3-server[1149]: 2026/09/22 13:48:40 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 205.630298] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker2 # [ 205.641405] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 205.644226] nix-daemon[870]: reaped child process 1972, status = succeeded client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 206.462583] nix-daemon[870]: reaped child process 1986, status = succeeded worker2 # [ 206.536344] nix-daemon[870]: accepted connection from pid 2002, user nix-grpc-daemon (trusted) worker2 # [ 206.550404] nix-daemon[870]: reaped child process 2005, status = succeeded lb # [ 206.544594] niks3-server[1149]: 2026/09/22 13:48:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.562299] nix-grpc-daemon[1759]: time=2026-09-22T13:48:41.625Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 206.563753] nix-grpc-daemon[1759]: time=2026-09-22T13:48:41.626Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 206.569051] niks3-server[1149]: 2026/09/22 13:48:41 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 206.571151] niks3-server[1149]: 2026/09/22 13:48:41 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 206.575394] niks3-server[1149]: 2026/09/22 13:48:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 206.577316] niks3-server[1149]: 2026/09/22 13:48:41 INFO Signed narinfos id=81 count=1 worker2 # [ 206.590614] nix-grpc-daemon[1759]: time=2026-09-22T13:48:41.653Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.581875] niks3-server[1149]: 2026/09/22 13:48:41 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 206.587157] niks3-server[1149]: 2026/09/22 13:48:41 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 206.591165] niks3-server[1149]: 2026/09/22 13:48:41 INFO Completed upload id=81 worker2 # [ 206.602987] nix-grpc-daemon[1759]: time=2026-09-22T13:48:41.665Z level=INFO msg="Upload complete. (153ms)" lb # [ 206.592431] niks3-server[1149]: 2026/09/22 13:48:41 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 206.605662] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker2 # [ 206.613132] nix-daemon[870]: reaped child process 1984, status = succeeded worker2 # [ 206.652624] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:41Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 206.656774] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:41Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 206.701416] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 206.712287] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 206.725725] nix-grpc-daemon[1759]: time=2026-09-22T13:48:41.788Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 206.733979] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 206.744170] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 206.839381] nix-daemon[870]: accepted connection from pid 2011, user nix-grpc-daemon (trusted) worker2 # [ 206.853340] nix-daemon[870]: reaped child process 2014, status = succeeded worker2 # [ 206.934777] nix-daemon[870]: accepted connection from pid 2016, user nix-grpc-daemon (trusted) worker2 # [ 206.948904] nix-daemon[870]: reaped child process 2019, status = succeeded lb # [ 206.943199] niks3-server[1149]: 2026/09/22 13:48:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.966510] nix-grpc-daemon[1759]: time=2026-09-22T13:48:42.028Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 206.967942] nix-grpc-daemon[1759]: time=2026-09-22T13:48:42.028Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 206.971158] niks3-server[1149]: 2026/09/22 13:48:42 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 206.984274] niks3-server[1149]: 2026/09/22 13:48:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 206.989089] niks3-server[1149]: 2026/09/22 13:48:42 INFO Signed narinfos id=82 count=1 worker2 # [ 207.003898] nix-grpc-daemon[1759]: time=2026-09-22T13:48:42.066Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.995538] niks3-server[1149]: 2026/09/22 13:48:42 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 207.005068] niks3-server[1149]: 2026/09/22 13:48:42 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 207.008817] niks3-server[1149]: 2026/09/22 13:48:42 INFO Completed upload id=82 worker2 # [ 207.020606] nix-grpc-daemon[1759]: time=2026-09-22T13:48:42.083Z level=INFO msg="Upload complete. (265ms)" lb # [ 207.010219] niks3-server[1149]: 2026/09/22 13:48:42 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 207.022782] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 207.025933] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 207.030449] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 207.037075] nix-daemon[870]: reaped child process 2009, status = succeeded worker2 # [ 207.041968] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 207.863219] nix-daemon[870]: reaped child process 2023, status = succeeded worker2 # [ 207.942585] nix-daemon[870]: accepted connection from pid 2039, user nix-grpc-daemon (trusted) worker2 # [ 207.957338] nix-daemon[870]: reaped child process 2042, status = succeeded lb # [ 207.951664] niks3-server[1149]: 2026/09/22 13:48:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.971920] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.034Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 207.973493] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.036Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 207.992518] niks3-server[1149]: 2026/09/22 13:48:43 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 208.004967] niks3-server[1149]: 2026/09/22 13:48:43 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 208.013714] niks3-server[1149]: 2026/09/22 13:48:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 208.019217] niks3-server[1149]: 2026/09/22 13:48:43 INFO Signed narinfos id=83 count=1 worker2 # [ 208.033609] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.096Z level=INFO msg="Uploading 1 narinfos" lb # [ 208.030119] niks3-server[1149]: 2026/09/22 13:48:43 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 208.035276] niks3-server[1149]: 2026/09/22 13:48:43 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 208.040251] niks3-server[1149]: 2026/09/22 13:48:43 INFO Completed upload id=83 worker2 # [ 208.052327] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.114Z level=INFO msg="Upload complete. (197ms)" lb # [ 208.044123] niks3-server[1149]: 2026/09/22 13:48:43 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 208.059718] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 worker2 # [ 208.071577] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 208.075281] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 208.085462] nix-daemon[870]: reaped child process 2021, status = succeeded worker2 # [ 208.115288] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 208.128064] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 208.141215] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.203Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 208.150805] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 208.159739] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 208.266353] nix-daemon[870]: accepted connection from pid 2048, user nix-grpc-daemon (trusted) worker2 # [ 208.281616] nix-daemon[870]: reaped child process 2051, status = succeeded worker2 # [ 208.370173] nix-daemon[870]: accepted connection from pid 2053, user nix-grpc-daemon (trusted) worker2 # [ 208.384424] nix-daemon[870]: reaped child process 2056, status = succeeded lb # [ 208.378933] niks3-server[1149]: 2026/09/22 13:48:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 208.400350] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.462Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 208.401757] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.462Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 208.400802] niks3-server[1149]: 2026/09/22 13:48:43 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 208.407285] niks3-server[1149]: 2026/09/22 13:48:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign lb # [ 208.412643] niks3-server[1149]: 2026/09/22 13:48:43 INFO Signed narinfos id=84 count=1 worker2 # [ 208.428574] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.490Z level=INFO msg="Uploading 1 narinfos" lb # [ 208.418366] niks3-server[1149]: 2026/09/22 13:48:43 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 208.424515] niks3-server[1149]: 2026/09/22 13:48:43 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 208.428819] niks3-server[1149]: 2026/09/22 13:48:43 INFO Completed upload id=84 worker2 # [ 208.440686] nix-grpc-daemon[1759]: time=2026-09-22T13:48:43.503Z level=INFO msg="Upload complete. (267ms)" lb # [ 208.430451] niks3-server[1149]: 2026/09/22 13:48:43 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 208.442917] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 208.446734] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 worker2 # [ 208.454066] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 208.456523] nix-daemon[870]: reaped child process 2046, status = succeeded worker2 # [ 208.461852] nix-daemon[870]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 209.704442] nix-daemon[870]: reaped child process 2060, status = succeeded worker2 # [ 209.778515] nix-daemon[870]: accepted connection from pid 2076, user nix-grpc-daemon (trusted) worker2 # [ 209.792850] nix-daemon[870]: reaped child process 2079, status = succeeded lb # [ 209.787115] niks3-server[1149]: 2026/09/22 13:48:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 209.803936] nix-grpc-daemon[1759]: time=2026-09-22T13:48:44.866Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 209.805430] nix-grpc-daemon[1759]: time=2026-09-22T13:48:44.868Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 209.822184] niks3-server[1149]: 2026/09/22 13:48:44 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 209.832149] niks3-server[1149]: 2026/09/22 13:48:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign worker2 # [ 209.852279] nix-grpc-daemon[1759]: time=2026-09-22T13:48:44.914Z level=INFO msg="Uploading 1 narinfos" lb # [ 209.839886] niks3-server[1149]: 2026/09/22 13:48:44 INFO Signed narinfos id=85 count=1 lb # [ 209.845217] niks3-server[1149]: 2026/09/22 13:48:44 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 209.852553] niks3-server[1149]: 2026/09/22 13:48:44 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 209.860721] niks3-server[1149]: 2026/09/22 13:48:44 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 209.867581] niks3-server[1149]: 2026/09/22 13:48:44 INFO Completed upload id=85 worker2 # [ 209.880650] nix-grpc-daemon[1759]: time=2026-09-22T13:48:44.943Z level=INFO msg="Upload complete. (210ms)" lb # [ 209.869301] niks3-server[1149]: 2026/09/22 13:48:44 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 209.885053] nix-grpc-daemon[1667]: ts=2026-09-22T13:48:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53166 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 worker2 # [ 209.893461] nix-daemon[870]: reaped child process 2058, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 4.76 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.12 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.09 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 210.395359] nix-grpc-daemon[1816]: ts=2026-09-22T13:48:44Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.04 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.06 seconds) (finished: run the VM test script, in 212.12 seconds) test script finished in 212.37s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T13:48:47Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T13:48:48Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T13:48:48Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T13:48:48Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.08 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh