tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) client # Formatting '/build/vm-state-client/tmp.Lfp6ShbdSN', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: 25cfa1e7-df3e-4523-9fd0-db9134629aa6 client # Superblock backups stored on blocks: client # 32768, 98304, 163840, 229376 client # client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done client # worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) worker1 # Formatting '/build/vm-state-worker1/tmp.1DHARLjqYu', fmt=raw size=1073741824 worker2: QEMU running (pid 52) worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Disk image does not exist, creating the virtualisation disk image... worker1 # Discarding device blocks: 0/262144 done worker2 # Formatting '/build/vm-state-worker2/tmp.Nz0xsFCe9I', fmt=raw size=1073741824 worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Filesystem UUID: 532642d2-c6f1-49f2-a2b4-3782e76d531f worker2 # Discarding device blocks: 0/262144 done worker1 # Superblock backups stored on blocks: worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # 32768, 98304, 163840, 229376 worker2 # Filesystem UUID: 55846195-6ef6-4740-bf73-4ddfc108f09a worker1 # worker2 # Superblock backups stored on blocks: worker1 # Allocating group tables: 0/8 done worker2 # 32768, 98304, 163840, 229376 worker1 # Writing inode tables: 0/8 done worker2 # worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. worker1 # Starting virtiofs daemons... worker1 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests worker2 # Allocating group tables: 0/8 done client # Virtualisation disk image created. worker2 # Writing inode tables: 0/8 done client # Starting virtiofs daemons... worker2 # Creating journal (8192 blocks): done client # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. worker2 # Starting virtiofs daemons... worker2 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) lb # Formatting '/build/vm-state-lb/tmp.tkitIUtndL', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: 8ebeaf7c-8052-4a07-b2b8-f23a52899149 lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 lb # (finished: start all VMs, in 0.34 seconds) client: waiting for unit network-addresses-eth1.service lb # Allocating group tables: 0/8 done client: waiting for the VM to finish booting lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T05:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T05:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T05:11:32Z INFO virtiofsd] Client connected, servicing requests client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # client # worker2 # worker2 # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # lb # Booting from ROM... client # Booting from ROM... worker2 # Booting from ROM... worker1 # Booting from ROM... client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test/init regInfo=/nix/store/hmvlr8b2278pc080sma8byzfjan2y23p-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] kvm-clock: using sched offset of 459410443 cycles client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vhp4sld1igrws2rdxgli0qdljgmsnza3-nixos-system-worker2-test/init regInfo=/nix/store/7r6pyv5kjf3bmhc3psizy6pjwb2p8ghw-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ckamkygndjknysls7i47y9vrkanbxzr1-nixos-system-worker1-test/init regInfo=/nix/store/5psc4qmnnvn37sl0sb72chfm0rpi87nv-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.002722] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.002743] Using GB pages for direct mapping worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.002851] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.002859] ACPI: Early table checksum verification disabled worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002861] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.002865] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002868] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.002875] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.002877] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.002878] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.002880] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] Hypervisor detected: KVM client # [ 0.002882] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002883] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.002884] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.000000] kvm-clock: using sched offset of 458893125 cycles worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.002886] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002886] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.000001] kvm-clock: using sched offset of 462330939 cycles client # [ 0.002887] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002887] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002888] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002888] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.003105] No NUMA configuration found worker2 # [ 0.002744] Using GB pages for direct mapping worker1 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.002820] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.003106] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002829] ACPI: Early table checksum verification disabled client # [ 0.003109] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.002724] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.005382] Zone ranges: worker2 # [ 0.002832] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002736] Using GB pages for direct mapping client # [ 0.005382] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.002819] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.002836] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005384] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.002829] ACPI: Early table checksum verification disabled client # [ 0.005385] Normal empty lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.005386] Device empty worker1 # [ 0.002832] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002840] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005386] Movable zone start for each node client # [ 0.005387] Early memory node ranges worker2 # [ 0.002847] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002836] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005387] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.002849] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002840] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005388] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.002851] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002847] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005390] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ggsnp37phfgq4b11zirffk4vxgicg7h8-nixos-system-lb-test/init regInfo=/nix/store/94h72crvqzbw5sjsl7v7v31gd90khbjb-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.002852] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002850] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.005409] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.005673] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002854] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.002851] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.032795] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.002855] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002853] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.033246] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.002857] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.033257] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.002854] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.002858] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.033283] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.002856] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.033286] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.002858] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002857] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.033287] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.002859] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.002858] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.033289] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.002859] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.002859] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.033290] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.002860] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.002859] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.033290] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.002860] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.002860] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.003090] No NUMA configuration found client # [ 0.033293] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.033294] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.003091] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.002860] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000000] APIC: Static calls initialized client # [ 0.033297] TSC deadline timer available lb # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.003094] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.033301] CPU topo: Max. logical packages: 1 worker1 # [ 0.002860] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.005534] Zone ranges: worker1 # [ 0.003093] No NUMA configuration found client # [ 0.033302] CPU topo: Max. logical dies: 1 lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.005535] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.033302] CPU topo: Max. dies per package: 1 worker1 # [ 0.003094] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.005537] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.033305] CPU topo: Max. threads per core: 1 lb # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.005538] Normal empty worker1 # [ 0.003097] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.033306] CPU topo: Num. cores per package: 1 worker1 # [ 0.005526] Zone ranges: worker2 # [ 0.005539] Device empty lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.033306] CPU topo: Num. threads per package: 1 worker2 # [ 0.005539] Movable zone start for each node lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.005527] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.005540] Early memory node ranges client # [ 0.033307] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.000001] kvm-clock: using sched offset of 470398907 cycles worker1 # [ 0.005529] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.005540] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.005530] Normal empty client # [ 0.033325] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.005531] Device empty worker2 # [ 0.005542] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.005531] Movable zone start for each node client # [ 0.033354] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.005532] Early memory node ranges lb # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.005543] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.000820] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.033356] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.005533] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.005563] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.033357] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.005534] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.005838] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.033358] Booting paravirtualized kernel on KVM worker2 # [ 0.034494] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.005535] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.000850] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.034952] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.005556] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.002762] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.033361] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.034963] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.002774] Using GB pages for direct mapping worker1 # [ 0.005837] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.037875] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.034994] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.002888] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker1 # [ 0.034073] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.002898] ACPI: Early table checksum verification disabled worker1 # [ 0.034525] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.034997] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.040061] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.002900] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.040100] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.034537] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.034999] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.034563] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.002904] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.035000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.034566] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.002908] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.035001] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.034568] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.035002] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.002916] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.034569] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.002918] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.035004] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.040101] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test/init regInfo=/nix/store/hmvlr8b2278pc080sma8byzfjan2y23p-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.035005] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.034570] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.002920] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.035009] TSC deadline timer available worker1 # [ 0.034570] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.035013] CPU topo: Max. logical packages: 1 client # [ 0.040194] Unknown kernel command line parameters "regInfo=/nix/store/hmvlr8b2278pc080sma8byzfjan2y23p-closure-info/registration", will be passed to user space. lb # [ 0.002921] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.035014] CPU topo: Max. logical dies: 1 worker1 # [ 0.034573] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.040207] random: crng init done worker2 # [ 0.035014] CPU topo: Max. dies per package: 1 worker1 # [ 0.034574] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.002923] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.040207] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.035017] CPU topo: Max. threads per core: 1 worker1 # [ 0.034577] TSC deadline timer available worker1 # [ 0.034581] CPU topo: Max. logical packages: 1 worker2 # [ 0.035018] CPU topo: Num. cores per package: 1 lb # [ 0.002924] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.042366] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.035018] CPU topo: Num. threads per package: 1 worker1 # [ 0.034582] CPU topo: Max. logical dies: 1 lb # [ 0.002926] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.034582] CPU topo: Max. dies per package: 1 client # [ 0.043756] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.035018] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.034585] CPU topo: Max. threads per core: 1 client # [ 0.043787] Fallback order for Node 0: 0 lb # [ 0.002927] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.035040] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.034586] CPU topo: Num. cores per package: 1 client # [ 0.043789] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.002927] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.034586] CPU topo: Num. threads per package: 1 client # [ 0.043790] Policy zone: DMA32 worker2 # [ 0.035071] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.002928] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.034587] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.046311] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.035073] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.002928] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.034605] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.049436] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.035075] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.052793] allocated 3145728 bytes of page_ext lb # [ 0.002929] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.035076] Booting paravirtualized kernel on KVM worker1 # [ 0.034636] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.062585] ftrace: allocating 48787 entries in 192 pages lb # [ 0.002929] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.034638] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.062586] ftrace: allocated 192 pages with 2 groups lb # [ 0.003160] No NUMA configuration found worker2 # [ 0.035079] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.063421] Dynamic Preempt: lazy worker1 # [ 0.034639] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.003161] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.063548] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.039582] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.034640] Booting paravirtualized kernel on KVM lb # [ 0.003164] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.063548] rcu: RCU event tracing is enabled. lb # [ 0.005597] Zone ranges: worker2 # [ 0.041892] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.063549] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.034644] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.041938] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.005598] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.063551] Trampoline variant of Tasks RCU enabled. lb # [ 0.005599] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.039135] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.063551] Rude variant of Tasks RCU enabled. lb # [ 0.005601] Normal empty lb # [ 0.005602] Device empty worker1 # [ 0.041429] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.063551] Tracing variant of Tasks RCU enabled. lb # [ 0.005602] Movable zone start for each node worker1 # [ 0.041470] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.005603] Early memory node ranges client # [ 0.063552] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.005603] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.063553] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.041940] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vhp4sld1igrws2rdxgli0qdljgmsnza3-nixos-system-worker2-test/init regInfo=/nix/store/7r6pyv5kjf3bmhc3psizy6pjwb2p8ghw-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.005604] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.063562] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005605] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.005626] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.063563] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.042036] Unknown kernel command line parameters "regInfo=/nix/store/7r6pyv5kjf3bmhc3psizy6pjwb2p8ghw-closure-info/registration", will be passed to user space. worker2 # [ 0.042048] random: crng init done lb # [ 0.005915] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.041472] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ckamkygndjknysls7i47y9vrkanbxzr1-nixos-system-worker1-test/init regInfo=/nix/store/5psc4qmnnvn37sl0sb72chfm0rpi87nv-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.063564] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.034421] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.042049] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.034892] ACPI: PM-Timer IO Port: 0x608 client # [ 0.068302] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.044315] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.041566] Unknown kernel command line parameters "regInfo=/nix/store/5psc4qmnnvn37sl0sb72chfm0rpi87nv-closure-info/registration", will be passed to user space. lb # [ 0.034903] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.068570] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.041578] random: crng init done lb # [ 0.034932] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.045739] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.041579] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.045770] Fallback order for Node 0: 0 client # [ 0.068575] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.034935] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.045773] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.043843] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.034937] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.068680] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.045774] Policy zone: DMA32 client # [ 0.072211] Console: colour VGA+ 80x25 worker1 # [ 0.045261] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.034938] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.048429] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.072214] printk: legacy console [tty0] enabled worker1 # [ 0.045294] Fallback order for Node 0: 0 lb # [ 0.034939] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.051843] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.101725] printk: legacy console [ttyS0] enabled worker1 # [ 0.045297] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.055339] allocated 3145728 bytes of page_ext lb # [ 0.034940] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.045298] Policy zone: DMA32 client # [ 0.197412] ACPI: Core revision 20250807 worker2 # [ 0.065694] ftrace: allocating 48787 entries in 192 pages lb # [ 0.034942] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.047926] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.065696] ftrace: allocated 192 pages with 2 groups lb # [ 0.034943] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.066600] Dynamic Preempt: lazy worker1 # [ 0.051373] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.034947] TSC deadline timer available client # [ 0.198320] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.054866] allocated 3145728 bytes of page_ext worker2 # [ 0.066734] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.034951] CPU topo: Max. logical packages: 1 client # [ 0.199847] APIC: Switch to symmetric I/O mode setup lb # [ 0.034952] CPU topo: Max. logical dies: 1 worker2 # [ 0.066735] rcu: RCU event tracing is enabled. worker1 # [ 0.065150] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.065152] ftrace: allocated 192 pages with 2 groups client # [ 0.200772] x2apic enabled lb # [ 0.034952] CPU topo: Max. dies per package: 1 worker2 # [ 0.066736] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.066012] Dynamic Preempt: lazy lb # [ 0.034956] CPU topo: Max. threads per core: 1 worker2 # [ 0.066737] Trampoline variant of Tasks RCU enabled. lb # [ 0.034956] CPU topo: Num. cores per package: 1 worker1 # [ 0.066188] rcu: Preemptible hierarchical RCU implementation. client # [ 0.201496] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.066738] Rude variant of Tasks RCU enabled. lb # [ 0.034957] CPU topo: Num. threads per package: 1 worker1 # [ 0.066188] rcu: RCU event tracing is enabled. worker2 # [ 0.066738] Tracing variant of Tasks RCU enabled. lb # [ 0.034957] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.066189] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.066739] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.066191] Trampoline variant of Tasks RCU enabled. client # [ 0.203426] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.034976] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.066739] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.066191] Rude variant of Tasks RCU enabled. lb # [ 0.035008] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.066191] Tracing variant of Tasks RCU enabled. worker2 # [ 0.066797] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.204365] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.035010] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.066192] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.035011] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.066799] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.066193] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.035013] Booting paravirtualized kernel on KVM client # [ 0.205996] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.066800] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.066214] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.207080] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.035015] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.071246] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.066216] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.071536] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.039551] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.208133] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.041746] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.066217] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.208994] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.071543] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.041789] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.070955] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.071653] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.071223] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.075517] Console: colour VGA+ 80x25 client # [ 0.209998] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.075520] printk: legacy console [tty0] enabled worker1 # [ 0.071230] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.105030] printk: legacy console [ttyS0] enabled client # [ 0.211994] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.200915] ACPI: Core revision 20250807 worker1 # [ 0.071335] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.041791] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ggsnp37phfgq4b11zirffk4vxgicg7h8-nixos-system-lb-test/init regInfo=/nix/store/94h72crvqzbw5sjsl7v7v31gd90khbjb-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.212994] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.074883] Console: colour VGA+ 80x25 worker1 # [ 0.074886] printk: legacy console [tty0] enabled client # [ 0.213994] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.201776] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.104419] printk: legacy console [ttyS0] enabled lb # [ 0.041887] Unknown kernel command line parameters "regInfo=/nix/store/94h72crvqzbw5sjsl7v7v31gd90khbjb-closure-info/registration", will be passed to user space. client # [ 0.214994] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.041901] random: crng init done worker2 # [ 0.203280] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.200749] ACPI: Core revision 20250807 worker2 # [ 0.204218] x2apic enabled lb # [ 0.041901] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.201644] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.044313] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.204987] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.203226] APIC: Switch to symmetric I/O mode setup lb # [ 0.045383] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.045417] Fallback order for Node 0: 0 worker1 # [ 0.204236] x2apic enabled worker2 # [ 0.206795] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.215994] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.045421] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.045422] Policy zone: DMA32 worker1 # [ 0.204999] APIC: Switched APIC routing to: physical x2apic client # [ 0.218000] Spectre V2 : Enabling IBPB for BPF lb # [ 0.047919] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.207764] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.218994] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.051333] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.206809] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.054674] allocated 3145728 bytes of page_ext client # [ 0.219994] active return thunk: srso_alias_return_thunk worker2 # [ 0.209420] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.065106] ftrace: allocating 48787 entries in 192 pages lb # [ 0.065108] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.210506] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.221015] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.207787] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.065984] Dynamic Preempt: lazy lb # [ 0.066125] rcu: Preemptible hierarchical RCU implementation. client # [ 0.221994] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.211548] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.066126] rcu: RCU event tracing is enabled. worker1 # [ 0.209465] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.222994] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.212418] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.066127] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.210558] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.066128] Trampoline variant of Tasks RCU enabled. client # [ 0.223994] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.066129] Rude variant of Tasks RCU enabled. worker1 # [ 0.211594] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.213420] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.066129] Tracing variant of Tasks RCU enabled. client # [ 0.224994] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.213132] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.066130] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.225994] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.214417] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.066131] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.215417] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.226993] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.213466] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.066147] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.216417] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.227994] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.066148] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.215462] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.217417] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.228994] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.066149] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.216463] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.229994] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.070624] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.217462] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.230994] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.070916] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.218462] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.231994] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.070922] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.218417] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.232994] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.071033] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.220425] Spectre V2 : Enabling IBPB for BPF lb # [ 0.074522] Console: colour VGA+ 80x25 lb # [ 0.074525] printk: legacy console [tty0] enabled worker2 # [ 0.221418] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.104168] printk: legacy console [ttyS0] enabled worker1 # [ 0.219462] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.222418] active return thunk: srso_alias_return_thunk lb # [ 0.198473] ACPI: Core revision 20250807 worker1 # [ 0.221470] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.223438] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.199390] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.223037] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.224417] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.200930] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.223463] active return thunk: srso_alias_return_thunk worker2 # [ 0.225417] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.201879] x2apic enabled worker2 # [ 0.226417] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.224340] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.202673] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.227417] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.225462] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.228417] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.226462] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.204479] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.227462] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.229417] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.205511] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.228463] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.231310] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.232124] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.207205] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.229462] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.233122] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.208290] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.230462] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.234130] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.209354] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.231463] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.234417] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.210873] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.232462] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.233462] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.235417] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.211958] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.234462] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.213202] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.235462] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.214202] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.236462] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.215948] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.216897] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.217997] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.219209] Spectre V2 : Enabling IBPB for BPF lb # [ 0.220202] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.221202] active return thunk: srso_alias_return_thunk lb # [ 0.222111] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.223201] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.224201] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.225201] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.267610] Freeing SMP alternatives memory: 44K lb # [ 0.226201] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.267997] pid_max: default: 32768 minimum: 301 lb # [ 0.227202] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.269079] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.228201] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.270098] landlock: Up and running. client # [ 0.270711] Yama: becoming mindful. lb # [ 0.229202] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.271615] LSM support for eBPF active lb # [ 0.230937] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.272103] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.231949] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.232939] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.273031] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.233932] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.275885] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.234981] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.276505] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.276998] ... version: 2 client # [ 0.277690] ... bit width: 48 client # [ 0.277996] ... generic counters: 6 client # [ 0.278677] ... generic bitmap: 000000000000003f client # [ 0.279040] ... fixed-purpose counters: 0 client # [ 0.279741] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.279996] ... value mask: 0000ffffffffffff client # [ 0.280867] ... max period: 00007fffffffffff worker2 # [ 0.271356] Freeing SMP alternatives memory: 44K client # [ 0.281657] ... global_ctrl mask: 000000000000003f worker2 # [ 0.271992] pid_max: default: 32768 minimum: 301 client # [ 0.282107] signal: max sigframe size: 3376 worker2 # [ 0.272520] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.282850] rcu: Hierarchical SRCU implementation. worker2 # [ 0.273525] landlock: Up and running. client # [ 0.283550] rcu: Max phase no-delay instances is 400. worker1 # [ 0.271888] Freeing SMP alternatives memory: 44K worker2 # [ 0.274418] Yama: becoming mindful. worker1 # [ 0.272465] pid_max: default: 32768 minimum: 301 worker2 # [ 0.275621] LSM support for eBPF active worker1 # [ 0.273558] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.276355] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.274567] landlock: Up and running. worker1 # [ 0.275212] Yama: becoming mindful. worker2 # [ 0.277457] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.276104] LSM support for eBPF active client # [ 0.288564] smp: Bringing up secondary CPUs ... worker1 # [ 0.276592] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.289010] smp: Brought up 1 node, 1 CPU worker2 # [ 0.279911] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.289675] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.277506] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.281006] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.281422] ... version: 2 client # [ 0.290155] Memory: 1454640K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.282138] ... bit width: 48 worker1 # [ 0.280760] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.291265] devtmpfs: initialized worker2 # [ 0.282420] ... generic counters: 6 worker2 # [ 0.283099] ... generic bitmap: 000000000000003f client # [ 0.292109] x86/mm: Memory block size: 128MB worker1 # [ 0.282056] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.283430] ... fixed-purpose counters: 0 worker1 # [ 0.282471] ... version: 2 worker2 # [ 0.284142] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.283261] ... bit width: 48 client # [ 0.293911] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.283465] ... generic counters: 6 worker2 # [ 0.284419] ... value mask: 0000ffffffffffff worker2 # [ 0.285298] ... max period: 00007fffffffffff worker1 # [ 0.284157] ... generic bitmap: 000000000000003f client # [ 0.294886] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.284465] ... fixed-purpose counters: 0 worker2 # [ 0.286064] ... global_ctrl mask: 000000000000003f client # [ 0.296076] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.286533] signal: max sigframe size: 3376 worker1 # [ 0.285194] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.297199] PM: RTC time: 05:11:32, date: 2026-09-23 worker2 # [ 0.287363] rcu: Hierarchical SRCU implementation. worker1 # [ 0.285464] ... value mask: 0000ffffffffffff worker2 # [ 0.288021] rcu: Max phase no-delay instances is 400. worker1 # [ 0.286366] ... max period: 00007fffffffffff worker1 # [ 0.287189] ... global_ctrl mask: 000000000000003f worker1 # [ 0.287577] signal: max sigframe size: 3376 client # [ 0.300746] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.288438] rcu: Hierarchical SRCU implementation. worker1 # [ 0.289074] rcu: Max phase no-delay instances is 400. client # [ 0.302322] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.270275] Freeing SMP alternatives memory: 44K client # [ 0.303022] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.293246] smp: Bringing up secondary CPUs ... worker2 # [ 0.293995] smp: Brought up 1 node, 1 CPU lb # [ 0.271032] pid_max: default: 32768 minimum: 301 client # [ 0.304280] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.294420] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.271828] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.305006] audit: initializing netlink subsys (disabled) lb # [ 0.272317] landlock: Up and running. lb # [ 0.273624] Yama: becoming mindful. worker1 # [ 0.294219] smp: Bringing up secondary CPUs ... worker2 # [ 0.295538] Memory: 1454612K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) client # [ 0.305998] audit: type=2000 audit(1790140293.389:1): state=initialized audit_enabled=0 res=1 lb # [ 0.274417] LSM support for eBPF active worker1 # [ 0.294480] smp: Brought up 1 node, 1 CPU worker2 # [ 0.296731] devtmpfs: initialized client # [ 0.307225] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.275255] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.295150] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.297483] x86/mm: Memory block size: 128MB client # [ 0.307227] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.276241] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.307997] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.295677] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.299290] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.308974] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.296756] devtmpfs: initialized client # [ 0.309716] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.300301] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.278921] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.297608] x86/mm: Memory block size: 128MB client # [ 0.310009] cpuidle: using governor menu worker2 # [ 0.301529] pinctrl core: initialized pinctrl subsystem lb # [ 0.279789] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.312202] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.302674] PM: RTC time: 05:11:32, date: 2026-09-23 lb # [ 0.280206] ... version: 2 worker1 # [ 0.299491] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.280923] ... bit width: 48 client # [ 0.313218] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.281204] ... generic counters: 6 worker1 # [ 0.300490] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.313999] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.281935] ... generic bitmap: 000000000000003f worker1 # [ 0.301549] pinctrl core: initialized pinctrl subsystem lb # [ 0.282258] ... fixed-purpose counters: 0 client # [ 0.315009] PCI: Using configuration type 1 for base access worker2 # [ 0.306288] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.302673] PM: RTC time: 05:11:32, date: 2026-09-23 lb # [ 0.282945] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.316088] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.283205] ... value mask: 0000ffffffffffff worker2 # [ 0.307659] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.284096] ... max period: 00007fffffffffff worker2 # [ 0.308445] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.284923] ... global_ctrl mask: 000000000000003f lb # [ 0.285333] signal: max sigframe size: 3376 worker1 # [ 0.306388] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.309710] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.286149] rcu: Hierarchical SRCU implementation. worker2 # [ 0.310429] audit: initializing netlink subsys (disabled) worker1 # [ 0.307723] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.286829] rcu: Max phase no-delay instances is 400. worker2 # [ 0.311542] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.308490] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.311544] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.323020] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.312420] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.309754] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.313351] thermal_sys: Registered thermal governor 'user_space' client # [ 0.323997] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.310475] audit: initializing netlink subsys (disabled) worker2 # [ 0.314152] audit: type=2000 audit(1790140293.406:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.311624] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.291815] smp: Bringing up secondary CPUs ... worker2 # [ 0.315423] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.311626] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.292218] smp: Brought up 1 node, 1 CPU worker2 # [ 0.315443] cpuidle: using governor menu worker1 # [ 0.312466] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.292921] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.317632] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.313449] thermal_sys: Registered thermal governor 'user_space' client # [ 0.328997] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.314223] audit: type=2000 audit(1790140293.408:1): state=initialized audit_enabled=0 res=1 client # [ 0.329997] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.318663] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.293420] Memory: 1454588K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) worker1 # [ 0.316467] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.294502] devtmpfs: initialized worker2 # [ 0.319423] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.316482] cpuidle: using governor menu worker2 # [ 0.320433] PCI: Using configuration type 1 for base access lb # [ 0.295278] x86/mm: Memory block size: 128MB worker1 # [ 0.318735] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.321476] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.297327] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.319705] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.298236] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.320468] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.321476] PCI: Using configuration type 1 for base access lb # [ 0.299294] pinctrl core: initialized pinctrl subsystem lb # [ 0.300461] PM: RTC time: 05:11:32, date: 2026-09-23 worker1 # [ 0.322602] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.326712] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.327421] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.341241] ACPI: Added _OSI(Module Device) client # [ 0.341971] ACPI: Added _OSI(Processor Device) lb # [ 0.304420] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.342575] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.327741] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.305769] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.332421] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.328466] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.306232] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.333420] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.307500] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.308215] audit: initializing netlink subsys (disabled) client # [ 0.348355] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.309403] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.333466] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.309406] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.334464] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.310208] audit: type=2000 audit(1790140293.434:1): state=initialized audit_enabled=0 res=1 lb # [ 0.312206] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.352421] ACPI: Interpreter enabled lb # [ 0.312207] thermal_sys: Registered thermal governor 'user_space' client # [ 0.353011] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.353745] ACPI: Using IOAPIC for interrupt routing lb # [ 0.313204] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.314242] cpuidle: using governor menu worker2 # [ 0.343904] ACPI: Added _OSI(Module Device) worker2 # [ 0.344422] ACPI: Added _OSI(Processor Device) lb # [ 0.316475] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.345116] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.356051] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.317477] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.356997] PCI: Using E820 reservations for host bridge windows lb # [ 0.318208] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.319216] PCI: Using configuration type 1 for base access worker1 # [ 0.344848] ACPI: Added _OSI(Module Device) worker1 # [ 0.345466] ACPI: Added _OSI(Processor Device) client # [ 0.360123] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.320408] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.346220] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.352845] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.325513] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.326205] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.367637] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.352381] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.356829] ACPI: Interpreter enabled worker2 # [ 0.357436] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.368003] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.358110] ACPI: Using IOAPIC for interrupt routing client # [ 0.369075] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.370120] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.331205] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.371388] PCI host bridge to bus 0000:00 worker2 # [ 0.360491] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.332205] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.358436] ACPI: Interpreter enabled client # [ 0.372001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.361421] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.358932] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.359466] ACPI: Using IOAPIC for interrupt routing client # [ 0.372997] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.373996] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.360343] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.364499] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.374996] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.375997] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.376996] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.377997] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.365465] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.366600] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.378998] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.342667] ACPI: Added _OSI(Module Device) lb # [ 0.343206] ACPI: Added _OSI(Processor Device) client # [ 0.380464] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.343979] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.372714] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.373428] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.374512] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.375542] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.376777] PCI host bridge to bus 0000:00 worker1 # [ 0.374487] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.377424] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.375470] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.378420] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.383086] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.376543] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.379420] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.384008] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.352591] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.377587] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.380420] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.384958] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.378812] PCI host bridge to bus 0000:00 worker2 # [ 0.381420] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.379469] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.386298] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.382420] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.380465] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.356627] ACPI: Interpreter enabled worker2 # [ 0.383420] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.381464] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.357220] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.387734] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.384355] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.357937] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.382465] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.383465] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.385839] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.391035] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.384465] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.391893] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.360273] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.385474] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.392766] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.361206] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.386468] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.393860] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.387911] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.364321] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.395691] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.398036] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.388540] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.398854] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.389503] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.399732] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.390443] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.400578] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.391784] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.372026] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.390567] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.373003] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.393153] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.391519] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.374287] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.403005] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.392488] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.403865] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.375334] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.395430] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.404760] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.376573] PCI host bridge to bus 0000:00 worker1 # [ 0.393782] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.396324] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.377209] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.397196] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.405581] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.395190] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.378204] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.398264] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.379205] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.407035] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.380205] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.399982] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.397483] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.407878] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.381204] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.398315] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.408735] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.399205] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.382204] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.401458] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.409003] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.383205] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.399471] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.402304] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.403166] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.384204] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.410548] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.401022] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.385638] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.404034] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.412009] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.402508] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.413002] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.403416] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.414590] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.404285] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.406458] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.407317] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.405902] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.408219] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.416009] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.417019] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.409840] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.418577] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.408489] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.388348] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.409363] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.411456] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.389257] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.420009] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.410231] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.412293] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.390228] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.421007] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.413129] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.411037] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.391536] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.413426] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.422570] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.412473] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.392926] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.414997] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.413310] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.424009] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.416312] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.425018] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.414241] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.417174] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.396243] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.415471] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.426541] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.397173] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.418018] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.417014] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.398013] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.428014] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.399211] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.418288] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.428896] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.419433] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.419193] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.429791] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.400794] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.420476] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.420073] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.422048] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.431395] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.402240] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.421491] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.423212] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.403194] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.433036] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.424151] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.422464] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.403994] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.433996] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.434960] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.424994] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.424020] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.405601] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.436434] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.426360] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.425316] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.407242] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.426274] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.437782] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.427195] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.408105] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.438217] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.427869] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.408990] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.428809] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.429475] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.440331] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.410677] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.430479] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.431341] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.441198] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.430443] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.432206] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.442662] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.432032] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.413241] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.433871] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.414240] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.433492] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.434365] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.415253] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.416210] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.435225] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.435428] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.436426] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.436002] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.417765] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.437419] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.419093] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.439036] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.420004] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.437486] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.440036] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.438472] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.421673] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.440632] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.439487] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.443263] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.441977] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.423137] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.441046] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.445659] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.424025] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.442609] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.442051] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.446277] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.443997] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.425729] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.442668] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.447371] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.444064] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.427217] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.448302] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.428210] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.444660] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.450025] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.446001] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.450909] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.429764] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.452035] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.430993] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.432001] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.453622] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.433686] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.444641] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.457501] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.435249] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.458103] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.446987] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.436214] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.459097] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.437189] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.447712] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.460095] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.461097] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.446728] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.448704] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.438788] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.462094] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.448996] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.449797] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.463095] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.440212] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.449700] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.464094] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.441117] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.451432] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.465045] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.441924] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.452296] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.450757] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.466013] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.453454] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.451716] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.467011] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.442792] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.467942] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.455035] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.443856] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.453346] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.468774] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.454093] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.469730] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.444969] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.470008] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.454782] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.470963] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.446724] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.458562] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.456032] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.472734] iommu: Default domain type: Translated lb # [ 0.447456] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.459530] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.473004] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.460523] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.448772] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.474281] ACPI: bus type USB registered worker2 # [ 0.461520] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.475054] usbcore: registered new interface driver usbfs worker2 # [ 0.462517] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.459514] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.475956] usbcore: registered new interface driver hub worker2 # [ 0.463515] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.476663] usbcore: registered new device driver usb worker1 # [ 0.460572] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.464557] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.461564] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.477931] NetLabel: Initializing worker2 # [ 0.465530] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.462562] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.478431] NetLabel: domain hash size = 128 worker2 # [ 0.466457] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.478996] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.463575] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.467427] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.479927] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.464573] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.480670] PCI: Using ACPI for IRQ routing worker2 # [ 0.468436] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.465564] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.469437] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.466564] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.470432] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.467503] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.471432] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.468482] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.472431] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.469472] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.449428] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.473436] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.470481] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.451746] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.471477] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.475507] iommu: Default domain type: Translated worker1 # [ 0.472477] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.476335] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.452489] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.473449] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.477441] ACPI: bus type USB registered worker1 # [ 0.474230] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.453489] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.478243] usbcore: registered new interface driver usbfs worker2 # [ 0.479162] usbcore: registered new interface driver hub worker1 # [ 0.475508] iommu: Default domain type: Translated lb # [ 0.454494] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.479431] usbcore: registered new device driver usb worker1 # [ 0.476333] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.456155] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.477530] ACPI: bus type USB registered worker2 # [ 0.481162] NetLabel: Initializing worker2 # [ 0.481426] NetLabel: domain hash size = 128 worker1 # [ 0.478295] usbcore: registered new interface driver usbfs lb # [ 0.456897] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.482156] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.479154] usbcore: registered new interface driver hub lb # [ 0.457528] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.482461] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.479487] usbcore: registered new device driver usb worker2 # [ 0.483389] PCI: Using ACPI for IRQ routing worker1 # [ 0.481168] NetLabel: Initializing lb # [ 0.459218] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.481472] NetLabel: domain hash size = 128 worker1 # [ 0.482237] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.482502] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.483454] PCI: Using ACPI for IRQ routing lb # [ 0.463212] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.464310] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.465306] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.466313] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.467307] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.468313] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.469306] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.470305] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.471252] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.472221] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.473224] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.474224] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.475229] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.476232] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.477218] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.478219] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.480350] iommu: Default domain type: Translated lb # [ 0.481212] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.482517] ACPI: bus type USB registered lb # [ 0.483276] usbcore: registered new interface driver usbfs client # [ 0.523569] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.484224] usbcore: registered new interface driver hub client # [ 0.523993] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.485146] usbcore: registered new device driver usb client # [ 0.523993] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.524001] vgaarb: loaded lb # [ 0.486980] NetLabel: Initializing client # [ 0.524744] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.487205] NetLabel: domain hash size = 128 client # [ 0.524996] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.487976] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.488259] NetLabel: unlabeled traffic allowed by default lb # [ 0.489219] PCI: Using ACPI for IRQ routing client # [ 0.529081] clocksource: Switched to clocksource kvm-clock client # [ 0.532598] VFS: Disk quotas dquot_6.6.0 client # [ 0.533314] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.534698] pnp: PnP ACPI init client # [ 0.535566] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.536557] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.527950] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.538094] pnp: PnP ACPI: found 5 devices worker2 # [ 0.528416] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.528416] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.528425] vgaarb: loaded worker1 # [ 0.527554] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.529221] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.528461] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.530033] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.528461] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.528469] vgaarb: loaded worker1 # [ 0.529241] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.529467] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.545855] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.547315] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.534504] clocksource: Switched to clocksource kvm-clock client # [ 0.548287] NET: Registered PF_INET protocol family client # [ 0.549526] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.532548] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.538121] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.538883] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.540335] pnp: PnP ACPI init worker1 # [ 0.536365] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.541129] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.537129] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.542111] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.538517] pnp: PnP ACPI init worker2 # [ 0.543765] pnp: PnP ACPI: found 5 devices worker1 # [ 0.539343] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.540316] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.541945] pnp: PnP ACPI: found 5 devices worker2 # [ 0.551602] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.553102] clocksource: Switched to clocksource acpi_pm client # [ 0.566054] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.554059] NET: Registered PF_INET protocol family worker1 # [ 0.549593] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.567608] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.555222] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.551091] clocksource: Switched to clocksource acpi_pm client # [ 0.568919] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.552068] NET: Registered PF_INET protocol family client # [ 0.570289] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.553311] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.571595] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.572751] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.574071] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.575183] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.576453] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.538657] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.577455] NET: Registered PF_XDP protocol family lb # [ 0.539200] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.578306] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.539200] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.579339] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.539211] vgaarb: loaded client # [ 0.580377] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.540038] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.540813] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.581549] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.582668] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.583837] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.585612] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.572102] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.544325] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.573654] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.546169] VFS: Disk quotas dquot_6.6.0 client # [ 0.587819] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.570037] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.575013] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.571561] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.576365] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.589756] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.577600] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.548960] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.572854] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.550358] pnp: PnP ACPI init client # [ 0.592002] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.578680] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.574151] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.551180] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.579896] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.575355] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.593687] PCI: CLS 0 bytes, default 64 lb # [ 0.552219] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.580992] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.576472] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.582152] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.553763] pnp: PnP ACPI: found 5 devices client # [ 0.594588] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.577717] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.583058] NET: Registered PF_XDP protocol family client # [ 0.596314] Trying to unpack rootfs image as initramfs... worker1 # [ 0.578764] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.583869] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.579924] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.584891] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.580895] NET: Registered PF_XDP protocol family worker2 # [ 0.585913] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.581753] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.587036] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.582778] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.588180] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.583792] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.589316] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.584895] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.561429] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.591012] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.586007] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.563114] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.587114] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.564262] NET: Registered PF_INET protocol family worker2 # [ 0.593296] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.588869] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.565568] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.595541] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.591663] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.597556] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.593944] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.599369] PCI: CLS 0 bytes, default 64 worker1 # [ 0.595982] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.600339] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.602133] Trying to unpack rootfs image as initramfs... worker1 # [ 0.597739] PCI: CLS 0 bytes, default 64 worker1 # [ 0.598676] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.600553] Trying to unpack rootfs image as initramfs... lb # [ 0.582634] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.584402] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.585837] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.587260] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.588614] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.589763] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.591085] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.592257] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.593566] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.594593] NET: Registered PF_XDP protocol family lb # [ 0.595479] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.596531] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.597596] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.639818] Initialise system trusted keyrings lb # [ 0.598643] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.640952] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.599718] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.600812] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.602673] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.605042] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.607021] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.609450] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.611178] PCI: CLS 0 bytes, default 64 lb # [ 0.612100] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.613879] Trying to unpack rootfs image as initramfs... worker2 # [ 0.646024] Initialise system trusted keyrings worker1 # [ 0.642337] Initialise system trusted keyrings worker2 # [ 0.648943] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.645304] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.664562] Key type asymmetric registered client # [ 0.665307] Asymmetric key parser 'x509' registered client # [ 0.666186] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.671580] io scheduler mq-deadline registered client # [ 0.672391] io scheduler kyber registered client # [ 0.674956] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.676300] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.682093] Linux agpgart interface v0.103 client # [ 0.682902] ACPI: bus type drm_connector registered worker2 # [ 0.670347] Key type asymmetric registered worker2 # [ 0.672909] Asymmetric key parser 'x509' registered client # [ 0.685880] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.669431] Key type asymmetric registered client # [ 0.686953] usbserial: USB Serial support registered for generic worker2 # [ 0.673754] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.670185] Asymmetric key parser 'x509' registered worker1 # [ 0.671131] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.677044] io scheduler mq-deadline registered worker2 # [ 0.677838] io scheduler kyber registered client # [ 0.690456] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.690456] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.674366] io scheduler mq-deadline registered worker1 # [ 0.675149] io scheduler kyber registered client # [ 0.692719] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.680457] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.681746] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.677879] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.695569] drop_monitor: Initializing network drop monitor service client # [ 0.696697] NET: Registered PF_INET6 protocol family worker1 # [ 0.679152] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.699944] Segment Routing with IPv6 worker2 # [ 0.687740] Linux agpgart interface v0.103 worker2 # [ 0.688621] ACPI: bus type drm_connector registered lb # [ 0.660751] Initialise system trusted keyrings worker1 # [ 0.684878] Linux agpgart interface v0.103 client # [ 0.703463] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.685778] ACPI: bus type drm_connector registered lb # [ 0.661780] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.704490] IPI shorthand broadcast: enabled worker2 # [ 0.691337] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.692416] usbserial: USB Serial support registered for generic worker1 # [ 0.688774] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.689892] usbserial: USB Serial support registered for generic worker2 # [ 0.696904] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.692270] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.696904] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.692270] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.699138] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.694540] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.712695] sched_clock: Marking stable (579014297, 133417803)->(785022015, -72589915) worker2 # [ 0.702076] drop_monitor: Initializing network drop monitor service worker2 # [ 0.703327] NET: Registered PF_INET6 protocol family worker1 # [ 0.699393] drop_monitor: Initializing network drop monitor service client # [ 0.717618] registered taskstats version 1 worker1 # [ 0.700665] NET: Registered PF_INET6 protocol family client # [ 0.718619] Loading compiled-in X.509 certificates worker2 # [ 0.707368] Segment Routing with IPv6 worker1 # [ 0.703819] Segment Routing with IPv6 worker2 # [ 0.709913] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.710988] IPI shorthand broadcast: enabled worker1 # [ 0.706281] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.707413] IPI shorthand broadcast: enabled lb # [ 0.685467] Key type asymmetric registered lb # [ 0.686239] Asymmetric key parser 'x509' registered lb # [ 0.687158] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.718450] sched_clock: Marking stable (584014961, 133873241)->(791009925, -73121723) lb # [ 0.692488] io scheduler mq-deadline registered worker1 # [ 0.715900] sched_clock: Marking stable (581014430, 134231429)->(790506217, -75260358) lb # [ 0.693307] io scheduler kyber registered client # [ 0.735092] Demotion targets for Node 0: null worker1 # [ 0.720346] registered taskstats version 1 worker2 # [ 0.725099] registered taskstats version 1 client # [ 0.738480] Key type .fscrypt registered lb # [ 0.696942] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.721349] Loading compiled-in X.509 certificates worker2 # [ 0.726079] Loading compiled-in X.509 certificates client # [ 0.739126] Key type fscrypt-provisioning registered client # [ 0.740008] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.698196] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.742444] ima: Allocated hash algorithm: sha1 client # [ 0.743200] ima: No architecture policies found lb # [ 0.702135] Linux agpgart interface v0.103 lb # [ 0.702947] ACPI: bus type drm_connector registered client # [ 0.745444] PM: Magic number: 10:890:163 client # [ 0.747052] RAS: Correctable Errors collector initialized. lb # [ 0.708109] usbcore: registered new interface driver usbserial_generic lb # [ 0.709220] usbserial: USB Serial support registered for generic lb # [ 0.710244] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.710244] Please enable it if your BIOS has the CPPC option. lb # [ 0.712550] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.756109] clk: Disabling unused clocks worker2 # [ 0.744904] Demotion targets for Node 0: null worker1 # [ 0.740269] Demotion targets for Node 0: null worker2 # [ 0.745798] Key type .fscrypt registered worker1 # [ 0.742303] Key type .fscrypt registered lb # [ 0.718452] drop_monitor: Initializing network drop monitor service client # [ 0.760468] PM: genpd: Disabling unused power domains worker1 # [ 0.742987] Key type fscrypt-provisioning registered lb # [ 0.719603] NET: Registered PF_INET6 protocol family worker1 # [ 0.743915] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.748893] Key type fscrypt-provisioning registered worker2 # [ 0.749826] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.750788] ima: Allocated hash algorithm: sha1 lb # [ 0.722875] Segment Routing with IPv6 worker2 # [ 0.751648] ima: No architecture policies found worker1 # [ 0.748256] ima: Allocated hash algorithm: sha1 worker1 # [ 0.749150] ima: No architecture policies found worker2 # [ 0.753907] PM: Magic number: 10:890:163 lb # [ 0.726338] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.755556] RAS: Correctable Errors collector initialized. worker1 # [ 0.751260] PM: Magic number: 10:890:163 lb # [ 0.727445] IPI shorthand broadcast: enabled worker1 # [ 0.752956] RAS: Correctable Errors collector initialized. worker2 # [ 0.764586] clk: Disabling unused clocks lb # [ 0.735584] sched_clock: Marking stable (603014019, 132278968)->(809438263, -74145276) worker1 # [ 0.761878] clk: Disabling unused clocks worker2 # [ 0.767922] PM: genpd: Disabling unused power domains lb # [ 0.740535] registered taskstats version 1 worker1 # [ 0.765266] PM: genpd: Disabling unused power domains lb # [ 0.741568] Loading compiled-in X.509 certificates lb # [ 0.757927] Demotion targets for Node 0: null lb # [ 0.761342] Key type .fscrypt registered lb # [ 0.762034] Key type fscrypt-provisioning registered lb # [ 0.763041] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.765406] ima: Allocated hash algorithm: sha1 lb # [ 0.766217] ima: No architecture policies found lb # [ 0.770307] PM: Magic number: 10:890:163 lb # [ 0.771994] RAS: Correctable Errors collector initialized. lb # [ 0.780107] clk: Disabling unused clocks lb # [ 0.784320] PM: genpd: Disabling unused power domains client # [ 0.925331] Freeing initrd memory: 29056K client # [ 0.928551] Freeing unused decrypted memory: 2028K client # [ 0.931226] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.932308] Write protecting the kernel read-only data: 32768k client # [ 0.934217] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.935764] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.938044] Freeing initrd memory: 29060K worker2 # [ 0.941371] Freeing unused decrypted memory: 2028K worker2 # [ 0.944118] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.945224] Write protecting the kernel read-only data: 32768k worker2 # [ 0.947133] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.948674] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.946993] Freeing initrd memory: 29056K worker1 # [ 0.950367] Freeing unused decrypted memory: 2028K worker1 # [ 0.953088] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.954189] Write protecting the kernel read-only data: 32768k worker1 # [ 0.956148] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.957697] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.986752] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.987878] Run /init as init process lb # [ 0.951896] Freeing initrd memory: 29064K lb # [ 0.955142] Freeing unused decrypted memory: 2028K client # [ 0.998592] systemd[1]: Inserted module 'autofs4' lb # [ 0.957898] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.959023] Write protecting the kernel read-only data: 32768k lb # [ 0.960961] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.962546] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.999588] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.000934] Run /init as init process client # [ 1.018393] fuse: init (API version 7.45) worker2 # [ 1.012381] systemd[1]: Inserted module 'autofs4' client # [ 1.025880] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.008815] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.010028] Run /init as init process client # [ 1.028543] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.031569] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.033511] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.021204] systemd[1]: Inserted module 'autofs4' client # [ 1.038944] virtiofs virtio5: discovered new tag: nix-store client # [ 1.040524] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.032525] fuse: init (API version 7.45) client # [ 1.047785] virtiofs virtio6: discovered new tag: shared client # [ 1.049516] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.052531] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.040123] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.053953] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.013508] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.042601] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.014649] Run /init as init process worker2 # [ 1.045517] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.041060] fuse: init (API version 7.45) worker2 # [ 1.047498] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.052668] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.048670] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.025636] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.054292] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.051297] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.054026] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.056268] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.061179] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.062840] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.078620] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.066111] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.061569] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.067573] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.063114] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.045403] fuse: init (API version 7.45) worker1 # [ 1.071401] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.073219] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.052902] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.077672] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.079334] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.055762] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.058723] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.060711] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.093036] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.065891] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.067485] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.075913] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.101369] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.077617] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.082138] virtiofs virtio7: discovered new tag: xchg lb # [ 1.083810] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.106270] systemd[1]: Successfully made /usr/ read-only. client # [ 1.414281] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.419110] systemd[1]: Detected virtualization kvm. client # [ 1.419957] systemd[1]: Detected architecture x86-64. client # [ 1.420811] systemd[1]: Running in initrd. client # [ 1.421946] systemd[1]: Initializing machine ID from random generator. client # [ 1.423254] systemd[1]: Hostname set to . worker2 # [ 1.429628] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.441738] systemd[1]: Detected virtualization kvm. worker2 # [ 1.443951] systemd[1]: Detected architecture x86-64. worker2 # [ 1.446060] systemd[1]: Running in initrd. worker1 # [ 1.437192] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.443319] systemd[1]: Detected virtualization kvm. worker1 # [ 1.444365] systemd[1]: Detected architecture x86-64. worker1 # [ 1.445403] systemd[1]: Running in initrd. worker2 # [ 1.448593] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.446764] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.451601] systemd[1]: Hostname set to . worker1 # [ 1.448225] systemd[1]: Hostname set to . lb # [ 1.443236] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.455356] systemd[1]: Detected virtualization kvm. lb # [ 1.457464] systemd[1]: Detected architecture x86-64. lb # [ 1.459572] systemd[1]: Running in initrd. lb # [ 1.461940] systemd[1]: Initializing machine ID from random generator. lb # [ 1.464898] systemd[1]: Hostname set to . client # [ 1.627035] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.664621] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.680668] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.662728] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.685039] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.686198] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.687573] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.688648] systemd[1]: Reached target Path Units. client # [ 1.689530] systemd[1]: Reached target Slice Units. client # [ 1.690363] systemd[1]: Reached target Swaps. client # [ 1.691119] systemd[1]: Reached target Timer Units. client # [ 1.692125] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.693284] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.694465] systemd[1]: Listening on Journal Sockets. client # [ 1.695475] systemd[1]: Listening on udev Control Socket. client # [ 1.696485] systemd[1]: Listening on udev Kernel Socket. client # [ 1.697407] systemd[1]: Reached target Socket Units. client # [ 1.699192] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.703509] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.704984] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.709287] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.710458] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.713130] systemd[1]: Starting Journal Service... worker2 # [ 1.711952] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.713022] systemd[1]: Reached target Path Units. lb # [ 1.683499] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.713934] systemd[1]: Reached target Slice Units. worker2 # [ 1.714797] systemd[1]: Reached target Swaps. worker2 # [ 1.715629] systemd[1]: Reached target Timer Units. worker2 # [ 1.716634] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.717911] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.719095] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.720138] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.721174] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.716174] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.722107] systemd[1]: Reached target Socket Units. worker2 # [ 1.723957] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.720619] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.739528] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.721806] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.723152] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.727740] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.724267] systemd[1]: Reached target Path Units. worker1 # [ 1.725170] systemd[1]: Reached target Slice Units. worker1 # [ 1.726081] systemd[1]: Reached target Swaps. client # [ 1.743538] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.726870] systemd[1]: Reached target Timer Units. worker1 # [ 1.727835] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.729046] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.730267] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.731289] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.732338] systemd[1]: Listening on udev Kernel Socket. client # [ 1.750619] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.733364] systemd[1]: Reached target Socket Units. worker1 # [ 1.735210] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.739121] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.762315] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.739988] systemd[1]: Starting Journal Service... client # [ 1.765544] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.771185] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.776832] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.749451] systemd[1]: Starting Journal Service... worker2 # [ 1.766079] systemd[1]: Starting Load Kernel Modules... lb # [ 1.737307] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.741664] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.769993] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.742857] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.783832] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.744313] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.745459] systemd[1]: Reached target Path Units. lb # [ 1.746385] systemd[1]: Reached target Slice Units. lb # [ 1.747317] systemd[1]: Reached target Swaps. lb # [ 1.748146] systemd[1]: Reached target Timer Units. worker2 # [ 1.777073] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.749157] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.750429] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.751649] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.775881] systemd[1]: Starting Load Kernel Modules... lb # [ 1.752649] systemd[1]: Listening on udev Control Socket. lb # [ 1.753669] systemd[1]: Listening on udev Kernel Socket. client # [ 1.795583] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.754622] systemd[1]: Reached target Socket Units. lb # [ 1.756358] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.780387] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.789504] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.761207] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.802890] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.792226] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.790479] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.798005] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.814627] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.801014] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.806183] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.802598] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.810342] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.771956] systemd[1]: Starting Journal Service... worker1 # [ 1.809582] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.817644] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.823965] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.837608] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.797999] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.821680] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.829605] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.846648] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.805428] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.835480] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.841138] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.813955] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.860058] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.847340] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.824346] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.869188] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.827662] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.855288] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.833678] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.867570] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.840711] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.846751] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.755193] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.889766] systemd[1]: Finished Create Static Device Nodes in /dev. client # client # [ 1.758185] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.880234] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.761265] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.896377] systemd[1]: Started Journal Service. worker1 # [ 1.882897] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.860381] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.890468] systemd[1]: Finished Load Kernel Modules. client # [ 1.770900] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.775077] systemd[1]: Reached target Local File Systems. worker1 # [ 1.892467] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.777916] systemd[1]: Starting Create System Files and Directories... lb # [ 1.867269] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.901988] systemd[1]: Starting Apply Kernel Variables... client # [ 1.783164] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.902828] systemd[1]: Finished Load Kernel Modules. lb # [ 1.879329] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.790651] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.912332] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.781468] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.918422] systemd[1]: Started Journal Service. worker2 # worker2 # [ 1.785490] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.786613] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.794430] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.902424] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.928868] systemd[1]: Started Journal Service. client # [ 1.813599] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.793907] systemd-modules-load[67]: Inserted module 'dm_mod' worker1 # [ 1.797041] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.804086] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.799294] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.806071] systemd[1]: Reached target Local File Systems. lb # [ 1.913608] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.809517] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.807064] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.814068] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.924865] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.815088] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.820889] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.817089] systemd[1]: Reached target Local File Systems. client # [ 1.835435] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 1.821114] systemd[1]: Starting Create System Files and Directories... lb # [ 1.934019] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.825956] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.833071] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.843508] systemd[1]: Finished Create System Files and Directories. lb # [ 1.817412] systemd-modules-load[67]: Inserted module 'dm_mod'[ 1.950894] systemd[1]: Started Journal Service. lb # client # [ 1.861160] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.821331] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.822382] systemd-modules-load[67]: Inserted module 'virtio_gpu' lb # [ 1.828859] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.857317] systemd[1]: Finished Create System Files and Directories. lb # [ 1.839092] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.867084] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.840994] systemd[1]: Reached target Local File Systems. lb # [ 1.842081] systemd[1]: Starting Create System Files and Directories... lb # [ 1.846874] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.853638] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.884281] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.890684] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.915785] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.875170] systemd[1]: Finished Create System Files and Directories. client # [ 1.916763] systemd[1]: Reached target System Initialization. client # [ 1.917595] systemd[1]: Reached target Basic System. worker1 # [ 1.909077] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.901369] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.948759] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.949748] systemd[1]: Reached target System Initialization. worker2 # [ 1.950583] systemd[1]: Reached target Basic System. lb # [ 1.925364] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.968084] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.968960] systemd[1]: Reached target System Initialization. worker1 # [ 1.971686] systemd[1]: Reached target Basic System. lb # [ 1.981172] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.982078] systemd[1]: Reached target System Initialization. lb # [ 1.982874] systemd[1]: Reached target Basic System. client # [ 2.243891] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.246687] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.252633] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.253501] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.254757] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.262454] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.263697] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.265476] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.266597] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.269631] usb usb1: Product: EHCI Host Controller client # [ 2.270303] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.271632] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.273533] hub 1-0:1.0: USB hub found client # [ 2.275030] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.275754] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.276640] hub 1-0:1.0: 6 ports detected client # [ 2.279985] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.268229] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.295445] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.296503] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.297231] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.286455] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.287658] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.291743] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.292648] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.294497] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.301913] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.303244] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.304386] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.318062] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.319262] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.307541] usb usb1: Product: EHCI Host Controller worker2 # [ 2.309490] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.310208] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.311051] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.311770] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.312845] hub 1-0:1.0: USB hub found worker2 # [ 2.313897] hub 1-0:1.0: 6 ports detected worker2 # [ 2.317399] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.318126] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.316886] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.319859] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.338126] usb usb2: Product: UHCI Host Controller worker2 # [ 2.331909] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.327385] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.332688] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.328141] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.329997] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.347730] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.331173] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.331879] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.351188] SCSI subsystem initialized worker1 # [ 2.335858] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.311933] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.314918] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.357039] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.339260] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.344071] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.340175] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.224964] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.345232] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.342267] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.227514] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.321015] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.345249] usb usb1: Product: EHCI Host Controller worker1 # [ 2.346079] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.347815] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.324878] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.350453] hub 1-0:1.0: USB hub found worker1 # [ 2.351068] hub 1-0:1.0: 6 ports detected client # [ 2.236233] (udev-worker)[86]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.353387] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.330307] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.354119] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.360028] usb usb2: Product: UHCI Host Controller worker2 # [ 2.360706] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.240289] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.362274] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.363093] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.369019] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.385547] hub 2-0:1.0: USB hub found worker2 # [ 2.375240] hub 2-0:1.0: USB hub found lb # [ 2.348137] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.348929] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.373006] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.378521] hub 2-0:1.0: 2 ports detected worker1 # [ 2.374177] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.350724] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.392437] hub 2-0:1.0: 2 ports detected client # [ 2.262703] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.359543] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.360679] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.404964] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.363317] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.388991] usb usb2: Product: UHCI Host Controller client # [ 2.406467] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.365940] usb usb1: Product: EHCI Host Controller worker2 # [ 2.394603] SCSI subsystem initialized lb # [ 2.366628] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.276067] systemd[1]: Finished Virtual Console Setup. lb # [ 2.368536] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.393599] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.266781] systemd[1]: Starting Virtual Console Setup... lb # [ 2.372363] hub 1-0:1.0: USB hub found lb # [ 2.372936] hub 1-0:1.0: 6 ports detected lb # [ 2.377491] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.401854] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.378221] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.410174] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.410944] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.423886] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.385780] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.294396] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.410653] hub 2-0:1.0: USB hub found client # [ 2.428783] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.281688] (udev-worker)[86]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.297132] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.284120] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.298390] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.432975] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.391470] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.418853] hub 2-0:1.0: 2 ports detected worker2 # [ 2.291187] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.438675] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.439792] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.401266] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.402552] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.294310] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.447444] usb usb3: Product: UHCI Host Controller client # [ 2.448117] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.435101] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.298574] systemd[1]: Starting Virtual Console Setup... client # [ 2.452498] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.435183] SCSI subsystem initialized client # [ 2.454302] hub 3-0:1.0: USB hub found lb # [ 2.413895] SCSI subsystem initialized worker2 # [ 2.308653] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.456496] hub 3-0:1.0: 2 ports detected worker2 # [ 2.313401] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.444389] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.449474] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.445106] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.463294] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.289472] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.331299] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.423340] usb usb2: Product: UHCI Host Controller lb # [ 2.424072] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.466521] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.454798] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.314915] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.336668] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.319053] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.298078] systemd[1]: Starting Virtual Console Setup... client # [ 2.473560] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.462446] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.476549] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.463624] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.477874] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.480482] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.463650] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.482481] usb usb4: Product: UHCI Host Controller client # [ 2.483176] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.442596] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.485470] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.469376] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.487629] hub 4-0:1.0: USB hub found worker2 # [ 2.475043] usb usb3: Product: UHCI Host Controller worker2 # [ 2.475744] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.472259] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.317814] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.493854] hub 4-0:1.0: 2 ports detected worker2 # [ 2.346877] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.320179] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.348048] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.350067] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.484954] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.481329] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.487135] hub 3-0:1.0: USB hub found worker1 # [ 2.482486] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.491228] hub 3-0:1.0: 2 ports detected lb # [ 2.462897] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.464680] hub 2-0:1.0: USB hub found worker1 # [ 2.359325] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.337994] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.362064] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.500915] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.514471] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.501646] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.342817] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.503922] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.476176] hub 2-0:1.0: 2 ports detected worker2 # [ 2.504696] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.521399] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.509271] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.511915] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.373894] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.513929] usb usb4: Product: UHCI Host Controller worker2 # [ 2.514618] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.376870] systemd[1]: Reached target Initrd Root Device. client # [ 2.529715] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.517008] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.531071] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.513684] usb usb3: Product: UHCI Host Controller worker2 # [ 2.519348] hub 4-0:1.0: USB hub found worker1 # [ 2.381181] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.521026] hub 4-0:1.0: 2 ports detected client # [ 2.535059] scsi host0: ahci lb # [ 2.494480] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.536854] scsi host1: ahci lb # [ 2.495266] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.538493] scsi host2: ahci worker1 # [ 2.521346] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.522103] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.540043] scsi host3: ahci worker2 # [ 2.393154] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.523479] hub 3-0:1.0: USB hub found client # [ 2.541717] scsi host4: ahci client # [ 2.543341] scsi host5: ahci worker2 # [ 2.397555] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.544649] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.372258] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.546071] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.529260] hub 3-0:1.0: 2 ports detected lb # [ 2.505493] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.547321] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.375100] systemd[1]: Reached target Initrd Root Device. client # [ 2.548511] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.549679] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.508448] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.550856] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.378311] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.539410] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.540181] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.516408] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.517563] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.544324] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.545150] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.523321] usb usb3: Product: UHCI Host Controller lb # [ 2.524017] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.548601] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.526306] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.551286] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.557917] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.554383] usb usb4: Product: UHCI Host Controller worker1 # [ 2.555100] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.532343] hub 3-0:1.0: USB hub found lb # [ 2.533204] hub 3-0:1.0: 2 ports detected worker1 # [ 2.559364] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.427393] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.539366] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.563644] hub 4-0:1.0: USB hub found lb # [ 2.540136] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.569696] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.570804] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.432040] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.543578] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.570054] hub 4-0:1.0: 2 ports detected worker2 # [ 2.575158] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.548137] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.549778] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.579516] scsi host0: ahci lb # [ 2.419348] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.581458] scsi host1: ahci worker2 # [ 2.582808] scsi host2: ahci worker2 # [ 2.584431] scsi host3: ahci worker2 # [ 2.586175] scsi host4: ahci lb # [ 2.425829] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.587736] scsi host5: ahci worker2 # [ 2.588543] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.561744] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.590648] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.563023] usb usb4: Product: UHCI Host Controller worker2 # [ 2.591858] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.563937] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.593018] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.565390] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.594154] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.590283] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.595331] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.568472] hub 4-0:1.0: USB hub found lb # [ 2.570333] hub 4-0:1.0: 2 ports detected lb # [ 2.580993] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.612264] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.615526] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.592057] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.593004] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.617256] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.621327] scsi host0: ahci worker1 # [ 2.623430] scsi host1: ahci worker1 # [ 2.625044] scsi host2: ahci worker1 # [ 2.626829] scsi host3: ahci client # [ 2.644596] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.628188] scsi host4: ahci client # [ 2.645739] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.647046] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.630019] scsi host5: ahci client # [ 2.647751] usb 1-1: Manufacturer: QEMU client # [ 2.648307] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.607777] scsi host0: ahci worker1 # [ 2.631345] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.632449] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.633956] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.611346] scsi host1: ahci worker1 # [ 2.635130] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.612318] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.636339] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.637531] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.614676] scsi host2: ahci lb # [ 2.616323] scsi host3: ahci lb # [ 2.617899] scsi host4: ahci lb # [ 2.620183] scsi host5: ahci client # [ 2.662201] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.622407] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.623569] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.625057] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.626313] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.627492] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.628652] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.689010] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.691924] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.695214] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.697418] usb 1-1: Manufacturer: QEMU worker2 # [ 2.699397] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.719535] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.720715] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.722047] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.722747] usb 1-1: Manufacturer: QEMU worker1 # [ 2.723402] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.736644] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.737772] hid: raw HID events driver (C) Jiri Kosina client # [ 2.626989] systemd[1]: Mounting /sysroot... lb # [ 2.741799] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.744696] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.747960] usb 1-1: Product: QEMU USB Tablet lb # [ 2.749781] usb 1-1: Manufacturer: QEMU lb # [ 2.751464] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.654896] systemd[1]: Mounting /sysroot... worker1 # [ 2.666503] systemd[1]: Mounting /sysroot... lb # [ 2.783024] hid: raw HID events driver (C) Jiri Kosina client # [ 2.856825] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.865104] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.865977] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.691979] systemd[1]: Mounting /sysroot... client # [ 2.866952] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.867877] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.868851] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.869675] ata3.00: applying bridge limits client # [ 2.870375] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.871342] ata3.00: configured for UDMA/100 client # [ 2.872368] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.911377] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.913843] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.916670] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.919188] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.933722] usbcore: registered new interface driver usbhid worker2 # [ 2.921485] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.937121] usbhid: USB HID core driver worker2 # [ 2.923732] ata3.00: applying bridge limits worker2 # [ 2.925962] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.928549] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.931183] ata3.00: configured for UDMA/100 worker2 # [ 2.933846] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.949576] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.962642] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.964460] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.948845] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.966599] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.949773] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.951001] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.952029] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.952915] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.953889] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.954800] ata3.00: applying bridge limits worker1 # [ 2.955562] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.956482] ata3.00: configured for UDMA/100 worker1 # [ 2.957608] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.939690] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.982952] EXT4-fs (vda): mounted filesystem 25cfa1e7-df3e-4523-9fd0-db9134629aa6 r/w with ordered data mode. Quota mode: none. lb # [ 2.942002] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.853873] systemd[1]: Mounted /sysroot. lb # [ 2.944680] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.856064] systemd[1]: Reached target Initrd Root File System. lb # [ 2.947022] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.949429] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.859448] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.951679] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.953862] ata3.00: applying bridge limits lb # [ 2.955825] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.958104] ata3.00: configured for UDMA/100 lb # [ 2.960496] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.875974] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.878780] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.880252] systemd[1]: Reloading... worker2 # [ 3.016139] usbcore: registered new interface driver usbhid worker1 # [ 3.013359] usbcore: registered new interface driver usbhid worker2 # [ 3.018912] usbhid: USB HID core driver worker1 # [ 3.019673] usbhid: USB HID core driver worker2 # [ 3.028171] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.034139] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 3.039156] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 3.040488] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 3.044644] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 3.054972] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.037867] usbcore: registered new interface driver usbhid lb # [ 3.040705] usbhid: USB HID core driver worker1 # [ 3.069274] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 3.077064] EXT4-fs (vda): mounted filesystem 55846195-6ef6-4740-bf73-4ddfc108f09a r/w with ordered data mode. Quota mode: none. client # [ 2.958954] systemd[1]: Reloading finished in 77 ms. worker2 # [ 2.947437] systemd[1]: Mounted /sysroot. lb # [ 3.052499] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 3.077188] EXT4-fs (vda): mounted filesystem 532642d2-c6f1-49f2-a2b4-3782e76d531f r/w with ordered data mode. Quota mode: none. worker2 # [ 2.950124] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.946624] systemd[1]: Mounted /sysroot. worker1 # [ 3.081717] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.057528] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.953068] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.948952] systemd[1]: Reached target Initrd Root File System. client # [ 2.967199] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.951829] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 2.971094] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker1 # [ 2.954657] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 2.974506] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 2.975852] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 2.977308] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 2.963832] systemd[1]: Mounting /sysroot/run... worker2 # [ 2.968550] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.971059] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.972532] systemd[1]: Reloading... worker1 # [ 2.969904] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.086908] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.977653] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 2.984591] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.097447] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.098746] EXT4-fs (vda): mounted filesystem 8ebeaf7c-8052-4a07-b2b8-f23a52899149 r/w with ordered data mode. Quota mode: none. lb # [ 2.969817] systemd[1]: Mounted /sysroot. lb # [ 2.971454] systemd[1]: Reached target Initrd Root File System. lb # [ 2.976076] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.990132] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.994335] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.016608] systemd-sysroot-fstab-check[145]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.995851] systemd[1]: Reloading... worker1 # [ 3.036844] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.040141] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.040973] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.041630] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.042412] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.050490] systemd[1]: Reloading finished in 77 ms. worker1 # [ 3.052090] systemd[1]: Reload requested from client PID 145 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.053649] systemd[1]: Reloading... worker2 # [ 3.060310] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.062440] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker2 # [ 3.068280] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.069703] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.070853] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.077255] systemd[1]: Reloading finished in 80 ms. lb # [ 3.085071] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... lb # [ 3.089096] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... lb # [ 3.092675] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.094088] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.096115] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.129143] systemd[1]: Reloading finished in 77 ms. worker1 # [ 3.138804] systemd-sysroot-fstab-check[145]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.142105] systemd-sysroot-fstab-check[145]: Requesting swap.target/start/replace... worker1 # [ 3.144894] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.146389] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.147506] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.151379] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.164816] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.166395] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.630164] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.635315] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.644436] systemd[1]: Mounting /sysroot/run... client # [ 3.653293] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.665641] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.656170] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.662183] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.670224] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.666589] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.679303] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.701677] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.704994] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.691723] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.689072] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.690505] systemd[1]: Reached target Initrd File Systems. client # [ 3.709782] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.692134] systemd[1]: Starting Find NixOS closure... client # [ 3.711161] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.713149] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.694632] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.716746] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.727250] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.728714] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.713815] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 3.715508] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 3.694167] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.723575] systemd[1]: Finished Find NixOS closure. lb # [ 3.701154] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.725156] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.731040] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.726843] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.708162] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.735944] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.739060] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.740671] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.742154] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.740937] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.746085] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.742191] systemd[1]: Stopped target Basic System. lb # [ 3.720150] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.744060] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.744862] systemd[1]: Stopped target Path Units. worker1 # [ 3.745567] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.746745] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.747764] systemd[1]: Stopped target Slice Units. worker1 # [ 3.748466] systemd[1]: Stopped target Socket Units. worker1 # [ 3.749274] systemd[1]: Stopped target System Initialization. worker1 # [ 3.750392] systemd[1]: Stopped target Swaps. worker1 # [ 3.751349] systemd[1]: Stopped target Timer Units. worker2 # [ 3.756424] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.752251] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.757878] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.730332] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.753959] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.755059] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.756225] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.757522] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.758510] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.760257] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.761321] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.762487] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.763475] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.764705] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.766335] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.767561] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.769312] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.770391] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.771502] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.773425] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.776251] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.777450] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.779128] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.787902] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.790137] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.772755] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.774075] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.796345] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.774809] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.798142] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.777323] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.778223] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.800908] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.801931] systemd[1]: Closed udev Control Socket. worker1 # [ 3.804079] systemd[1]: Starting Cleanup udev Database... lb # [ 3.782075] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.804863] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.805899] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.807131] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.809115] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.810100] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.811050] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.812299] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.813670] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.792321] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.793749] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.795874] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.830315] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.831870] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.833229] systemd[1]: Reached target Switch Root. worker1 # [ 3.835144] systemd[1]: Starting NixOS Activation... lb # [ 3.817615] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.819075] systemd[1]: Reached target Initrd File Systems. lb # [ 3.820120] systemd[1]: Starting Find NixOS closure... lb # [ 3.822627] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.840758] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.848105] systemd[1]: Finished Find NixOS closure. lb # [ 3.849223] systemd[1]: Reached target Initrd Default Target. lb # [ 3.850971] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.865219] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.866063] systemd[1]: Stopped target Basic System. lb # [ 3.866757] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.867492] systemd[1]: Stopped target Path Units. lb # [ 3.868149] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.869505] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.871132] systemd[1]: Stopped target Slice Units. lb # [ 3.871826] systemd[1]: Stopped target Socket Units. lb # [ 3.872643] systemd[1]: Stopped target System Initialization. lb # [ 3.873584] systemd[1]: Stopped target Swaps. lb # [ 3.874378] systemd[1]: Stopped target Timer Units. lb # [ 3.875241] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.876803] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.877697] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.878688] systemd[1]: Stopped Find NixOS closure. lb # [ 3.879693] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.881133] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.882207] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.883137] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.884295] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.886199] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.887413] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.888653] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.909958] initrd-nixos-activation-start[191]: booting system configuration /nix/store/ckamkygndjknysls7i47y9vrkanbxzr1-nixos-system-worker1-test lb # [ 3.889788] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.890965] systemd[1]: Stopped target Local File Systems. lb # [ 3.891970] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.893126] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.894515] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.898573] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.899607] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.900546] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.906851] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.910085] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.935689] initrd-nixos-activation-start[191]: running activation script... lb # [ 3.915694] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.918144] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.919389] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.921066] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.922570] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.924074] systemd[1]: Closed udev Control Socket. lb # [ 3.925465] systemd[1]: Starting Cleanup udev Database... lb # [ 3.926849] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.927910] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.928787] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.929873] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.931134] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.932099] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.946834] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.948521] systemd[1]: Finished Cleanup udev Database. lb # [ 3.949804] systemd[1]: Reached target Switch Root. lb # [ 3.951671] systemd[1]: Starting NixOS Activation... lb # [ 4.008701] initrd-nixos-activation-start[191]: booting system configuration /nix/store/ggsnp37phfgq4b11zirffk4vxgicg7h8-nixos-system-lb-test lb # [ 4.031689] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 4.117980] initrd-nixos-activation-start[214]: setting up /etc... worker1 # [ 4.209217] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.210785] systemd[1]: Finished NixOS Activation. worker1 # [ 4.212732] systemd[1]: Starting Switch Root... worker1 # [ 4.226540] systemd[1]: Switching root. lb # [ 4.224395] initrd-nixos-activation-start[214]: setting up /etc... lb # [ 4.326706] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.329069] systemd[1]: Finished NixOS Activation. lb # [ 4.330187] systemd[1]: Starting Switch Root... worker1 # [ 4.493677] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.342765] systemd[1]: Switching root. lb # [ 4.601694] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.707349] NET: Registered PF_VSOCK protocol family lb # [ 4.699515] NET: Registered PF_VSOCK protocol family client # [ 4.629695] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.655760] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.678930] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.680433] systemd[1]: Reached target Initrd File Systems. client # [ 4.682896] systemd[1]: Starting Find NixOS closure... client # [ 4.685389] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.703311] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.705798] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.712935] systemd[1]: Finished Find NixOS closure. client # [ 4.714079] systemd[1]: Reached target Initrd Default Target. client # [ 4.715668] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.705730] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.707635] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.711108] systemd[1]: Starting Find NixOS closure... client # [ 4.728237] systemd[1]: Stopped target Initrd Default Target. client # [ 4.729537] systemd[1]: Stopped target Basic System. client # [ 4.730480] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.716245] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.731460] systemd[1]: Stopped target Path Units. client # [ 4.733142] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.734166] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.735185] systemd[1]: Stopped target Slice Units. client # [ 4.735859] systemd[1]: Stopped target Socket Units. client # [ 4.736550] systemd[1]: Stopped target System Initialization. client # [ 4.737417] systemd[1]: Stopped target Swaps. client # [ 4.738389] systemd[1]: Stopped target Timer Units. client # [ 4.739336] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.741132] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.741957] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.743079] systemd[1]: Stopped Find NixOS closure. client # [ 4.744230] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.746106] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.747254] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.748241] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.750058] systemd[1]: Stopped Load Kernel Modules. client # [ 4.750758] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.752503] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.753549] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.740355] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.754861] systemd[1]: Stopped Create System Files and Directories. client # [ 4.755713] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.743058] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.757133] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.758415] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.759858] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.760904] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.763350] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.750643] systemd[1]: Finished Find NixOS closure. client # [ 4.764361] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.751808] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.753647] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.773255] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 4.775123] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.778231] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.780099] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.768082] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.769379] systemd[1]: Stopped target Basic System. client # [ 4.784111] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.771123] systemd[1]: Stopped target Initrd Root Device. client # [ 4.785225] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.771921] systemd[1]: Stopped target Path Units. worker2 # [ 4.772650] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.786663] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.773675] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.787962] systemd[1]: Closed udev Control Socket. worker2 # [ 4.774874] systemd[1]: Stopped target Slice Units. worker2 # [ 4.775723] systemd[1]: Stopped target Socket Units. client # [ 4.789529] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.776786] systemd[1]: Stopped target System Initialization. client # [ 4.790391] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.777785] systemd[1]: Stopped target Swaps. worker2 # [ 4.778627] systemd[1]: Stopped target Timer Units. client # [ 4.791941] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 4.792797] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.779601] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.793836] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.781140] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.795131] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.781977] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.783043] systemd[1]: Stopped Find NixOS closure. client # [ 4.797083] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.784485] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.785419] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.787322] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.788389] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.789578] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.791116] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.792325] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.794376] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.795372] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.796212] systemd[1]: Stopped target Local File Systems. client # [ 4.810259] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.796982] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.797943] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.812075] systemd[1]: Finished Cleanup udev Database. client # [ 4.812779] systemd[1]: Reached target Switch Root. client # [ 4.814248] systemd[1]: Starting NixOS Activation... worker2 # [ 4.800983] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.802841] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.805147] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.806180] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.813288] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.817147] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.819919] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.823140] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.826742] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.828227] systemd[1]: Closed udev Control Socket. worker2 # [ 4.829887] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.830880] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.832045] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.833213] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.835128] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.836119] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.837084] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.837943] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.840424] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.854852] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.856508] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.858140] systemd[1]: Reached target Switch Root. worker2 # [ 4.859375] systemd[1]: Starting NixOS Activation... client # [ 4.878569] initrd-nixos-activation-start[190]: booting system configuration /nix/store/xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test client # [ 4.906186] initrd-nixos-activation-start[190]: running activation script... worker2 # [ 4.924234] initrd-nixos-activation-start[190]: booting system configuration /nix/store/vhp4sld1igrws2rdxgli0qdljgmsnza3-nixos-system-worker2-test worker1 # [ 5.066157] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.070049] systemd[1]: Detected virtualization kvm. worker1 # [ 5.070771] systemd[1]: Detected architecture x86-64. worker1 # [ 5.071559] systemd[1]: Detected first boot. worker1 # [ 5.073908] systemd[1]: Initializing machine ID from random generator. worker2 # [ 4.951334] initrd-nixos-activation-start[190]: running activation script... lb # [ 5.055334] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.064911] systemd[1]: Detected virtualization kvm. lb # [ 5.066735] systemd[1]: Detected architecture x86-64. lb # [ 5.068804] systemd[1]: Detected first boot. lb # [ 5.072718] systemd[1]: Initializing machine ID from random generator. client # [ 5.100556] initrd-nixos-activation-start[213]: setting up /etc... worker2 # [ 5.151915] initrd-nixos-activation-start[213]: setting up /etc... worker1 # [ 5.290847] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.201056] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.202754] systemd[1]: Finished NixOS Activation. client # [ 5.204659] systemd[1]: Starting Switch Root... lb # [ 5.302008] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.216837] systemd[1]: Switching root. worker2 # [ 5.255585] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.257242] systemd[1]: Finished NixOS Activation. worker2 # [ 5.259262] systemd[1]: Starting Switch Root... worker1 # [ 5.399275] systemd[1]: Applying preset policy. worker2 # [ 5.271392] systemd[1]: Switching root. lb # [ 5.388975] systemd[1]: Applying preset policy. client # [ 5.478224] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.531696] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 5.556715] NET: Registered PF_VSOCK protocol family worker1 # [ 5.577352] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.564840] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.633010] NET: Registered PF_VSOCK protocol family worker1 # [ 5.780047] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.781556] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.784198] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 5.761204] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.762592] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.786642] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.788093] systemd[1]: Created slice User and Session Slice. lb # [ 5.764679] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.789032] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.790406] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.766821] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.791582] systemd[1]: Expecting device /dev/hvc0... lb # [ 5.768090] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.792354] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.793159] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.769054] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.794103] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.770397] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.794939] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.771501] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.795837] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.772216] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.796731] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.773003] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.797669] systemd[1]: Reached target Path Units. lb # [ 5.773850] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.798505] systemd[1]: Reached target Remote File Systems. lb # [ 5.774609] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.799381] systemd[1]: Reached target Slice Units. lb # [ 5.775439] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.800178] systemd[1]: Reached target Swaps. lb # [ 5.776328] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.777236] systemd[1]: Reached target Path Units. lb # [ 5.777985] systemd[1]: Reached target Remote File Systems. lb # [ 5.778754] systemd[1]: Reached target Slice Units. worker1 # [ 5.802199] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.779465] systemd[1]: Reached target Swaps. worker1 # [ 5.804879] systemd[1]: Listening on Process Core Dump Socket. lb # [ 5.781318] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.806817] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 5.783701] systemd[1]: Listening on Process Core Dump Socket. lb # [ 5.785392] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.808780] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.822253] systemd[1]: Listening on Hostname Service Socket. lb # [ 5.787246] systemd[1]: Listening on Factory Reset Management. lb # [ 5.799797] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.825802] systemd[1]: Starting Journal Log Access Socket... lb # [ 5.802694] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.826918] systemd[1]: Listening on Journal Audit Socket. lb # [ 5.803830] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.829814] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 5.806179] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.830965] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.807701] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.832101] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.808784] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.833451] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 5.810070] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.837574] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.813955] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.838631] systemd[1]: Listening on udev Control Socket. lb # [ 5.815237] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.839554] systemd[1]: Listening on udev Varlink Socket. lb # [ 5.816456] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.841790] systemd[1]: Mounting Huge Pages File System... lb # [ 5.818551] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.844522] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 5.820948] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 5.826656] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.851660] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.833793] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.860390] systemd[1]: Mounting Kernel Trace File System... lb # [ 5.841959] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.866101] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.877568] systemd[1]: Starting Load Kernel Module configfs... lb # [ 5.854961] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.880036] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.882423] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 5.861135] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.887041] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 5.870142] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.901310] systemd[1]: Mounting FUSE Control File System... client # [ 5.912179] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.902153] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 5.921782] systemd[1]: Detected virtualization kvm. client # [ 5.923583] systemd[1]: Detected architecture x86-64. lb # [ 5.882492] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.925540] systemd[1]: Detected first boot. client # [ 5.929074] systemd[1]: Initializing machine ID from random generator. lb # [ 5.891700] systemd[1]: Mounting FUSE Control File System... lb # [ 5.896496] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.924476] systemd[1]: Starting Journal Service... lb # [ 5.907530] systemd[1]: Starting Journal Service... worker1 # [ 5.933512] systemd[1]: Starting Load Kernel Modules... lb # [ 5.915463] systemd[1]: Starting Load Kernel Modules... worker1 # [ 5.940000] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.946324] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.948644] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.925079] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.955542] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.933741] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.959873] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.935482] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.962361] systemd[1]: Mounted Huge Pages File System. worker1 # [ 5.965693] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 5.967128] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 5.969246] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 5.971713] systemd[1]: Mounted FUSE Control File System. lb # [ 5.948627] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.975506] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 5.979316] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.957590] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 5.966201] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.969641] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.993116] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.973638] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.003040] systemd[1]: Detected virtualization kvm. lb # [ 5.977225] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 6.004941] systemd[1]: Detected architecture x86-64. worker2 # [ 6.007012] systemd[1]: Detected first boot. lb # [ 5.847792] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.010763] systemd[1]: Initializing machine ID from random generator. lb # [ 5.851534] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.009625] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.987688] systemd[1]: Started Journal Service. worker1 # [ 6.012303] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.016685] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.863040] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.869472] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.873359] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.875763] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.876635] systemd[1]: Mounted FUSE Control File System. lb # [ 6.009636] EXT4-fs (vda): re-mounted 8ebeaf7c-8052-4a07-b2b8-f23a52899149. lb # [ 6.013450] loop: module loaded lb # [ 5.883279] systemd-modules-load[285]: Inserted module 'loop' worker1 # [ 6.041716] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.890934] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.048065] EXT4-fs (vda): re-mounted 532642d2-c6f1-49f2-a2b4-3782e76d531f. worker1 # [ 6.055792] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.900925] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.057017] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.060319] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.908538] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 6.068541] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.913085] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.070168] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.913981] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.074053] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 5.924522] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.086436] loop: module loaded worker1 # [ 6.092872] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.096763] systemd[1]: Starting Firewall... lb # [ 5.940869] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.941931] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.101037] systemd[1]: Starting Apply Kernel Variables... lb # [ 5.951696] systemd[1]: Finished Load Kernel Modules. lb # [ 5.967419] systemd[1]: Starting Firewall... lb # [ 5.968418] systemd-oomd[287]: No swap; memory pressure usage will be degraded client # [ 6.149077] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.975412] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 5.999911] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.002399] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.137749] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 5.983097] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.140485] systemd[1]: Started Journal Service. worker1 # [ 6.007234] systemd-modules-load[285]: Inserted module 'loop' worker1 # [ 6.022218] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.142109] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 6.033079] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.044448] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.045419] systemd[1]: Reached target First Boot Complete. worker1 # [ 6.076706] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.216654] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.233419] systemd[1]: Applying preset policy. worker1 # [ 6.088157] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.232596] systemd-journald[284]: Received client request to flush runtime journal. lb # [ 6.116334] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.118536] systemd[1]: Reached target First Boot Complete. lb # [ 6.120789] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.126160] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.127456] systemd[1]: Finished Apply Kernel Variables. lb # [ 6.136342] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.299981] systemd[1]: Applying preset policy. lb # [ 6.141478] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.218247] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 6.220622] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.222382] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.223576] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.226095] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.214970] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.398257] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.243189] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 6.244484] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.247203] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.292082] systemd-udevd[317]: Using default interface naming scheme 'v261'. lb # [ 6.290976] systemd-udevd[323]: Using default interface naming scheme 'v261'. worker2 # [ 6.465387] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.340400] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.366127] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.420544] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.585062] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.586363] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.588754] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.590844] systemd[1]: Created slice Slice /system/getty. client # [ 6.592207] systemd[1]: Created slice User and Session Slice. client # [ 6.593134] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.594361] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.595510] systemd[1]: Expecting device /dev/hvc0... client # [ 6.596186] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.596951] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.597825] systemd[1]: Stopped target initrd-fs.target. client # [ 6.598634] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.599452] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.600288] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.601182] systemd[1]: Reached target Path Units. client # [ 6.601883] systemd[1]: Reached target Remote File Systems. client # [ 6.602769] systemd[1]: Reached target Slice Units. client # [ 6.603508] systemd[1]: Reached target Swaps. client # [ 6.605192] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.607586] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.609310] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.622768] systemd[1]: Listening on Factory Reset Management. client # [ 6.623780] systemd[1]: Listening on Hostname Service Socket. client # [ 6.626683] systemd[1]: Starting Journal Log Access Socket... client # [ 6.627830] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.453716] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.630103] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.631266] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.632707] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.634009] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.637887] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.638923] systemd[1]: Listening on udev Control Socket. client # [ 6.639818] systemd[1]: Listening on udev Varlink Socket. client # [ 6.641978] systemd[1]: Mounting Huge Pages File System... client # [ 6.644198] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.650923] systemd[1]: Mounting Kernel Debug File System... client # [ 6.657867] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.514830] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.667878] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.679705] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.669031] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 6.670410] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 6.672495] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.674691] systemd[1]: Created slice Slice /system/getty. client # [ 6.688229] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.676128] systemd[1]: Created slice User and Session Slice. worker2 # [ 6.677051] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.678301] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.679407] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 6.680138] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 6.680903] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 6.681742] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 6.682571] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 6.683394] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.684298] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 6.685238] systemd[1]: Reached target Path Units. worker2 # [ 6.685944] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.686722] systemd[1]: Reached target Slice Units. client # [ 6.699351] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.687464] systemd[1]: Reached target Swaps. worker2 # [ 6.689340] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.691897] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.705198] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.693649] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.533195] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.715177] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.695534] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.708105] systemd[1]: Listening on Hostname Service Socket. client # [ 6.722093] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.711324] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 6.712480] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.715017] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.554267] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.716476] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 6.717674] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.719020] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.732840] systemd[1]: Starting Journal Service... worker2 # [ 6.723050] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 6.724100] systemd[1]: Listening on udev Control Socket. client # [ 6.737883] systemd[1]: Starting Load Kernel Modules... worker2 # [ 6.725002] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 6.727244] systemd[1]: Mounting Huge Pages File System... worker2 # [ 6.729934] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.748760] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 6.737304] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.603694] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.756642] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.744331] systemd[1]: Mounting Kernel Trace File System... client # [ 6.760592] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.587651] (udev-worker)[352]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.750544] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.589989] (udev-worker)[344]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.595044] (udev-worker)[344]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.770496] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.760062] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.763027] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.628360] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.768374] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.784833] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.773010] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.789907] systemd[1]: Mounted Huge Pages File System. client # [ 6.792195] systemd-journald[283]: Collecting audit messages is enabled. client # [ 6.794249] systemd[1]: Mounted POSIX Message Queue File System. client # [ 6.798565] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.649309] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.788427] systemd[1]: Mounting FUSE Control File System... client # [ 6.802555] systemd[1]: Mounted Kernel Trace File System. client # [ 6.807773] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.635372] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.796035] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.816429] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.821696] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.669591] (udev-worker)[360]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.673231] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.828722] loop: module loaded worker2 # [ 6.815904] systemd[1]: Starting Journal Service... client # [ 6.697296] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.698494] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.822897] systemd[1]: Starting Load Kernel Modules... client # [ 6.836569] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.700992] systemd-modules-load[284]: Inserted module 'loop' worker1 # [ 6.689608] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.828344] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 6.690518] systemd[1]: Reached target Local File Systems. worker1 # [ 6.693180] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.845881] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.672831] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.695307] systemd[1]: Starting register-nix-paths.service... lb # [ 6.673681] systemd[1]: Reached target Local File Systems. client # [ 6.848843] systemd[1]: Started Journal Service. worker1 # [ 6.698304] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 6.837236] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.677893] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 6.699860] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.839649] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.680524] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.702971] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 6.684854] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.707285] systemd[1]: Starting Create System Files and Directories... worker2 # [ 6.846650] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.686482] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.860448] EXT4-fs (vda): re-mounted 25cfa1e7-df3e-4523-9fd0-db9134629aa6. worker2 # [ 6.852188] systemd[1]: Listening on Journal Log Access Socket. client # [ 6.732060] systemd[1]: Finished Load Kernel Modules. worker2 # [ 6.854066] systemd[1]: Mounted Huge Pages File System. lb # [ 6.694425] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.856006] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.858209] systemd[1]: Mounted Kernel Debug File System. client # [ 6.738938] systemd[1]: Mounted FUSE Control File System. worker2 # [ 6.860062] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.722491] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.863641] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.704333] systemd[1]: Starting Create System Files and Directories... worker2 # [ 6.865734] systemd[1]: Mounted FUSE Control File System. client # [ 6.747239] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.871623] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.759090] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.884474] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.765291] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.886941] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.766640] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.767704] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.891110] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.775155] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.787077] systemd[1]: Starting Apply Kernel Variables... client # [ 6.787866] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.789075] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.914129] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.944078] EXT4-fs (vda): re-mounted 55846195-6ef6-4740-bf73-4ddfc108f09a. worker1 # [ 6.807432] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.811185] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.790605] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.954659] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.956278] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.796579] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 6.958274] systemd-journald[283]: Collecting audit messages is enabled. client # [ 6.971343] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.959272] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.965212] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.967119] loop: module loaded worker2 # [ 6.967703] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.978662] systemd[1]: Finished Load Kernel Modules. worker2 # [ 6.982349] systemd[1]: Starting Firewall... worker2 # [ 6.986478] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 6.865089] systemd[1]: Finished Create System Files and Directories. lb # [ 6.845981] systemd[1]: Finished Create System Files and Directories. worker1 # [ 6.870729] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.872387] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.855098] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.861101] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 6.888800] systemd[1]: Queued start job for default target Multi-User System.[ 7.023673] systemd[1]: Started Journal Service. worker2 # lb # [ 6.866103] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 6.894262] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.867256] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.869235] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.871161] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.902076] systemd-modules-load[284]: Inserted module 'loop' lb # [ 6.874606] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.876145] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.878135] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.920350] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.922389] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 6.909376] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.924257] systemd[1]: Reached target First Boot Complete. client # [ 6.927208] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.931896] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.933519] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 6.920825] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.930546] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.935084] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.949333] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.939125] systemd[1]: Reached target First Boot Complete. worker1 # [ 6.948640] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.110588] systemd-journald[283]: Received client request to flush runtime journal. lb # [ 6.972482] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.013924] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.021507] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.022679] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.005164] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.025231] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.007870] systemd[1]: Starting Update is Completed... lb # [ 6.994489] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 7.001840] systemd[1]: Starting Update is Completed... client # [ 7.057722] systemd-udevd[314]: Using default interface naming scheme 'v261'. client # [ 7.092108] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.192029] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.061321] systemd[1]: Finished Update is Completed. worker2 # [ 7.093409] systemd-oomd[285]: No swap; memory pressure usage will be degraded lb # [ 7.200003] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.096577] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.091661] systemd[1]: Finished Update is Completed. worker2 # [ 7.098228] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 7.098936] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 7.101513] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 7.103163] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.105159] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.108263] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.110143] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.112484] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.114539] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.117476] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.119779] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.121779] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.173698] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.184959] systemd-udevd[318]: Using default interface naming scheme 'v261'. client # [ 7.221108] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.236969] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 7.265330] (udev-worker)[319]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.267562] (udev-worker)[319]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.269291] (udev-worker)[317]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.394112] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.269138] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.286376] systemd[1]: Finished Firewall. worker1 # [ 7.438824] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.326380] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.232105] ACPI: button: Power Button [PWRF] lb # [ 7.284205] mousedev: PS/2 mouse device common for all mice client # [ 7.342445] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.343966] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.345363] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.347386] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.349219] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.350387] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.474274] ACPI: button: Power Button [PWRF] worker1 # [ 7.362083] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.363197] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.364598] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.384781] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 7.536690] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.542465] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 7.384857] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T05:11:39 UTC (1790140299) lb # [ 7.384930] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.425550] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.407465] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 7.412827] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.455931] systemd[1]: Mounting /run/wrappers... lb # [ 7.385770] systemd-journald[284]: Time jumped backwards, rotating. lb # [ 7.408893] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.553867] mousedev: PS/2 mouse device common for all mice lb # [ 7.432510] Console: switching to colour dummy device 80x25 lb # [ 7.443590] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.507308] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.443670] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.457162] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.616220] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.616222] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.620792] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.621460] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.532946] systemd[1]: Mounted /run/wrappers. client # [ 7.536568] systemd[1]: Reached target Local File Systems. client # [ 7.562375] ACPI: button: Power Button [PWRF] worker1 # [ 7.576807] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 7.589609] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.502394] systemd[1]: Finished register-nix-paths.service. lb # [ 7.503934] systemd[1]: Reached target System Initialization. lb # [ 7.637850] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.638535] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.547953] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.507856] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.509180] systemd[1]: Started niks3 garbage collection timer. client # [ 7.549780] systemd[1]: Starting register-nix-paths.service... lb # [ 7.510102] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.510979] systemd[1]: Reached target Timer Units. worker2 # [ 7.538828] systemd[1]: Mounting /run/wrappers... lb # [ 7.511730] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.555814] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.567294] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.575333] mousedev: PS/2 mouse device common for all mice client # [ 7.559521] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.520040] systemd[1]: Listening on niks3 server socket. lb # [ 7.520828] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.521539] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.522630] systemd[1]: Reached target Socket Units. lb # [ 7.523335] systemd[1]: Reached target Basic System. client # [ 7.565229] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.589681] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T05:11:40 UTC (1790140300) worker2 # [ 7.554096] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.589757] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.527755] systemd[1]: Started backdoor.service. lb # [ 7.530323] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 7.576210] systemd[1]: Starting Create System Files and Directories... lb # [ 7.538055] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.591741] systemd-journald[284]: Time jumped backwards, rotating. lb # [ 7.552958] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.605803] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.582470] systemd[1]: Mounted /run/wrappers. client # [ 7.607081] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.635675] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.688524] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.583550] systemd[1]: Reached target Local File Systems. client # [ 7.635741] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T05:11:40 UTC (1790140300) worker2 # [ 7.585150] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.558897] systemd[1]: Started Reset console on configuration changes. lb # [ 7.692601] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.589139] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.608652] Console: switching to colour dummy device 80x25 worker1 # [ 7.641608] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 7.641711] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.591451] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.593629] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.597103] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.573039] systemd[1]: Starting resolvconf update... worker1 # [ 7.657161] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.599534] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.730571] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.730573] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.743351] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.744078] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.746304] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.746995] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.591814] systemd[1]: Started rustfs.service. worker2 # [ 7.625086] (udev-worker)[354]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 7.633242] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.606932] systemd[1]: Starting rustfs-bucket.service... client # [ 7.635815] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 7.636651] systemd-journald[283]: Time jumped backwards, rotating. worker2 # [ 7.648256] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.666345] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.673944] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.633955] systemd[1]: Finished Firewall. lb # [ 7.641048] nsncd[521]: Sep 23 05:11:39.888 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.644194] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.695210] systemd[1]: Finished Create System Files and Directories. client # [ 7.649092] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.649183] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # connecting to host... client # [ 7.699739] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.686575] systemd[1]: Finished register-nix-paths.service. client # [ 7.705564] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.693257] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.689555] systemd[1]: Reached target System Initialization. worker1 # [ 7.690486] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 7.691598] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.696958] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 7.692869] systemd[1]: Reached target Timer Units. worker1 # [ 7.693606] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.695360] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 7.697587] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 7.699388] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.678922] systemd[1]: Finished Post-Boot Actions. worker1 # [ 7.701594] systemd[1]: Reached target Socket Units. worker1 # [ 7.702368] systemd[1]: Reached target Basic System. worker1 # [ 7.704178] systemd[1]: Started backdoor.service. worker1 # [ 7.707120] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 7.709430] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.691499] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.714266] systemd[1]: Starting Post-Boot Actions... lb # [ 7.693323] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.719213] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.726292] systemd[1]: Starting resolvconf update... lb # [ 7.705169] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 7.730598] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.674876] Console: switching to colour dummy device 80x25 client # [ 7.700328] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.753175] systemd[1]: Finished Create System Files and Directories. lb # [ 7.729183] systemd[1]: Starting User Login Management... worker2 # [ 7.758993] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.760785] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 7.775778] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 7.746823] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 7.859261] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.859370] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.933134] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.933136] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.805605] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 7.765904] systemd[1]: Starting Virtual Console Setup... client # [ 7.810832] systemd[1]: Starting Update is Completed... worker1 # [ 7.811614] systemd[1]: Finished Post-Boot Actions. client # [ 7.974843] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.975715] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.832078] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.996120] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.844439] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.845763] nsncd[515]: Sep 23 05:11:40.888 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.999583] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 7.867479] systemd[1]: Finished Update is Completed. worker1 # connecting to host... worker1 # [ 7.853279] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.855336] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.857203] systemd[1]: Starting User Login Management... worker1 # [ 7.881493] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.888259] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.892184] systemd[1]: Starting Update is Completed... lb # [ 7.871148] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 7.872217] systemd[1]: Stopped Virtual Console Setup. client # [ 7.917681] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.900270] dbus-broker-launch[519]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.910717] dbus-broker-launch[519]: NSS returned no entry for 'systemd-timesync' worker1 # [ 7.911885] dbus-broker-launch[519]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.892800] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.926039] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 7.810066] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 8.015164] Console: switching to colour frame buffer device 160x50 worker1 # [ 7.957655] dbus-broker-launch[519]: Ready lb # [ 7.938705] dbus-broker-launch[550]: Looking up NSS user entry for 'systemd-timesync'... client # [ 7.980972] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 7.941893] dbus-broker-launch[550]: NSS returned no entry for 'systemd-timesync' client # [ 7.983220] systemd[1]: Stopped Virtual Console Setup. lb # [ 7.945119] dbus-broker-launch[550]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 7.974370] systemd[1]: Starting Virtual Console Setup... client # [ 7.997550] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.985125] systemd[1]: Finished Update is Completed. lb # [ 7.961403] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 7.962527] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 7.963359] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 7.964190] systemd[1]: Stopping User and Group Name Lookups... lb # [ 7.964970] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 7.982130] systemd[1]: nscd.service: Deactivated successfully. lb # [ 7.983593] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 7.810380] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.985866] systemd-logind[553]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 8.032835] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 8.034395] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.037436] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.143926] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 8.038581] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.992736] systemd-logind[553]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.014311] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.015460] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.042041] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.044110] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.045916] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.051976] Console: switching to colour frame buffer device 160x50 lb # [ 8.021192] systemd-logind[553]: New seat seat0. worker1 # [ 8.179961] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.021354] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 8.049841] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.054134] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.035202] systemd[1]: Started User Login Management. worker1 # [ 8.057230] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 8.061198] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 8.040683] systemd[1]: Starting linger-users.service... worker1 # [ 8.063206] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.066268] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.067152] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.068207] systemd-logind[532]: New seat seat0. worker1 # [ 8.068927] systemd[1]: Started User Login Management. worker1 # [ 8.071270] systemd[1]: Starting linger-users.service... lb # [ 8.074578] dbus-broker-launch[550]: Ready worker1 # [ 8.103704] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.229332] Console: switching to colour frame buffer device 160x50 client # [ 8.256920] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.105604] systemd[1]: Stopped Virtual Console Setup. client # [ 8.259957] ppdev: user-space parallel port driver worker1 # [ 8.108107] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.109825] systemd-logind[532]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.116660] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.117964] nsncd[589]: Sep 23 05:11:41.159 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.123204] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.125119] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.111791] systemd-logind[553]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.143887] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.147831] systemd[1]: Finished linger-users.service. lb # [ 8.127105] nsncd[611]: Sep 23 05:11:40.372 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.129790] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.131504] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.152539] systemd[1]: Finished resolvconf update. worker1 # [ 8.154765] systemd[1]: Reached target Preparation for Network. lb # [ 8.133116] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.158857] systemd[1]: Starting DHCP Client... lb # [ 8.139139] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.161217] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.167085] systemd[1]: Finished Firewall. worker1 # [ 8.163908] systemd[1]: Starting Extra networking commands.... lb # [ 8.142470] systemd[1]: Finished linger-users.service. worker1 # [ 8.168811] systemd-logind[532]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.324600] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.155849] systemd[1]: Finished resolvconf update. worker2 # [ 8.316359] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 8.289133] ppdev: user-space parallel port driver lb # [ 8.158960] systemd[1]: Reached target Preparation for Network. worker2 # [ 8.321161] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.338670] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.167915] systemd[1]: Starting DHCP Client... client # [ 8.211097] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.214827] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.175347] systemd[1]: Starting Address configuration of eth1... client # [ 8.223110] systemd[1]: Starting Virtual Console Setup... lb # [ 8.188664] systemd[1]: Starting Extra networking commands.... client # [ 8.249896] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.251886] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.263751] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.265198] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.445979] kvm_amd: TSC scaling supported worker1 # [ 8.293963] network-addresses-eth1-start[621]: adding address 192.168.1.3/24... done client # [ 8.446544] kvm_amd: Nested Virtualization enabled client # [ 8.447031] kvm_amd: Nested Paging enabled client # [ 8.447954] kvm_amd: LBR virtualization supported client # [ 8.448749] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.449348] kvm_amd: Virtual GIF supported client # [ 8.450063] kvm_amd: Virtual NMI enabled lb # [ 8.421141] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 8.312818] network-addresses-eth1-start[621]: adding address 2001:db8:1::3/64... done client # [ 8.488591] EDAC MC: Ver: 3.0.0 worker1 # [ 8.337399] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.474594] ppdev: user-space parallel port driver worker2 # [ 8.340299] ACPI: button: Power Button [PWRF] lb # [ 8.335637] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.342069] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.491647] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.361685] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.413801] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.428358] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 8.378572] network-addresses-eth1-start[642]: adding address 192.168.1.2/24... done worker1 # [ 8.401352] systemd-logind[532]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 8.443652] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 8.443721] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T05:11:41 UTC (1790140301) worker2 # [ 8.443794] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.409714] systemd-vconsole-setup[605]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.414512] systemd[1]: Finished Virtual Console Setup. lb # [ 8.414106] network-addresses-eth1-start[642]: adding address 2001:db8:1::2/64... done worker1 # [ 8.440240] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.442148] systemd[1]: Reached target Network. worker1 # [ 8.445475] dhcpcd[631]: dhcpcd-10.3.2 starting worker2 # [ 8.444282] systemd-journald[283]: Time jumped backwards, rotating. worker2 # [ 8.455617] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.447256] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.454095] dhcpcd[690]: dev: loaded udev worker2 # [ 8.455702] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 8.480789] Console: switching to colour dummy device 80x25 worker1 # [ 8.606742] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 8.609349] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.614506] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.511221] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 8.511748] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 8.464695] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.492159] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.493280] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.493986] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 8.496505] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.615141] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 8.615273] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 8.520971] systemd[1]: Finished Permit User Sessions. client # [ 8.539756] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.524085] systemd[1]: Started Getty on tty1. worker1 # [ 8.524726] systemd[1]: Reached target Login Prompts. worker2 # [ 8.665268] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 8.665675] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 8.546179] systemd-vconsole-setup[416]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.550069] systemd[1]: Finished Virtual Console Setup. client # [ 8.551369] systemd[1]: Reached target System Initialization. client # [ 8.552831] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.554148] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.555412] systemd[1]: Reached target Timer Units. lb # [ 8.515619] dhcpcd[654]: dhcpcd-10.3.2 starting client # [ 8.557146] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.558245] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.559170] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.560455] systemd[1]: Reached target Socket Units. client # [ 8.561888] systemd[1]: Reached target Basic System. client # [ 8.563189] systemd[1]: Started backdoor.service. client # [ 8.566071] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.570488] systemd[1]: Starting nftables firewall... worker2 # [ 8.694256] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 8.695051] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.536342] dhcpcd[712]: dev: loaded udev client # [ 8.576562] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.696589] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 8.703428] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.704540] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 8.585234] systemd[1]: Starting Post-Boot Actions... client # [ 8.594136] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.595268] systemd[1]: Finished register-nix-paths.service. lb # [ 8.700833] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.702688] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.598508] systemd[1]: Reached target System Initialization. worker2 # [ 8.599435] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.572618] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.600860] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 8.603409] systemd[1]: Reached target Timer Units. lb # [ 8.576461] systemd[1]: Reached target Network. client # [ 8.617483] systemd[1]: Starting resolvconf update... worker2 # [ 8.604477] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 8.606198] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 8.608725] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 8.609665] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 8.613425] systemd[1]: Reached target Socket Units. lb # [ 8.586369] systemd[1]: Starting PostgreSQL Server... worker2 # [ 8.614145] systemd[1]: Reached target Basic System. worker2 # [ 8.616169] systemd[1]: Started backdoor.service. lb # [ 8.590238] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.617987] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 8.620628] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.624570] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.756056] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # connecting to host... lb # [ 8.735152] kvm_amd: TSC scaling supported worker2 # [ 8.630069] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.627199] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.738560] kvm_amd: Nested Virtualization enabled lb # [ 8.739101] kvm_amd: Nested Paging enabled lb # [ 8.741775] kvm_amd: LBR virtualization supported worker2 # [ 8.636454] systemd[1]: Starting resolvconf update... lb # [ 8.742226] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 8.743747] kvm_amd: Virtual GIF supported client # [ 8.651804] systemd[1]: Starting D-Bus System Message Bus... lb # [ 8.744142] kvm_amd: Virtual NMI enabled worker2 # [ 8.643874] systemd[1]: Starting D-Bus System Message Bus... client # [ 8.669902] nsncd[427]: Sep 23 05:11:41.666 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.662480] systemd[1]: Starting Virtual Console Setup... client # [ 8.678466] systemd[1]: Started Name Service Cache Daemon (nsncd). client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 8.682979] systemd[1]: Finished Post-Boot Actions. client # [ 8.692072] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.692875] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.708558] systemd[1]: Starting User Login Management... client # [ 8.712867] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.670481] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.832696] kvm_amd: TSC scaling supported lb # [ 8.684322] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.833148] kvm_amd: Nested Virtualization enabled lb # [ 8.692120] systemd[1]: Started Getty on tty1. client: connected to guest root shell worker2 # [ 8.734487] systemd[1]: Finished Post-Boot Actions. worker1 # [ 8.833996] kvm_amd: Nested Paging enabled lb # [ 8.692776] systemd[1]: Reached target Login Prompts. worker1 # [ 8.834621] kvm_amd: LBR virtualization supported client: (connecting took 9.40 seconds) worker1 # [ 8.835083] kvm_amd: Virtual VMLOAD VMSAVE supported client: (finished: waiting for the VM to finish booting, in 9.40 seconds) worker1 # [ 8.835831] kvm_amd: Virtual GIF supported worker1 # [ 8.836450] kvm_amd: Virtual NMI enabled worker1 # [ 8.841297] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.841913] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.844906] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 8.845783] cfg80211: failed to load regulatory.db worker1 # [ 8.888545] EDAC MC: Ver: 3.0.0 lb # [ 8.868604] EDAC MC: Ver: 3.0.0 worker1 # [ 8.895359] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.764564] dhcpcd[690]: eth0: waiting for carrier worker1 # [ 8.767073] dhcpcd[690]: libudev: received NULL device worker1 # [ 8.767883] dhcpcd[690]: libudev: received NULL device worker1 # [ 8.768748] dhcpcd[690]: eth0: carrier acquired worker1 # [ 8.774373] dhcpcd[690]: DUID 00:01:00:01:32:46:1c:0d:52:54:00:12:34:56 worker1 # [ 8.775418] dhcpcd[690]: eth0: IAID 00:12:34:56 worker1 # [ 8.776193] dhcpcd[690]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 8.803892] dbus-broker-launch[438]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.815543] dbus-broker-launch[438]: NSS returned no entry for 'systemd-timesync' client # [ 8.817414] dbus-broker-launch[438]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.918581] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 8.831494] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.833075] systemd-logind[457]: New seat seat0. worker1 # [ 8.815422] systemd-vconsole-setup[694]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.818936] systemd[1]: Finished Virtual Console Setup. client # [ 8.839066] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.840031] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.840960] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.841840] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.842778] systemd-logind[457]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.847995] systemd-logind[457]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.940436] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 8.941205] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 8.849389] systemd-logind[457]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.852101] systemd[1]: Started User Login Management. lb # [ 8.947224] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 8.948107] cfg80211: failed to load regulatory.db client # [ 8.859832] systemd[1]: Starting linger-users.service... client # [ 8.860743] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.863524] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.882637] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.922300] systemd[1]: Started D-Bus System Message Bus. lb # [ 9.017513] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.886631] dhcpcd[712]: eth0: waiting for carrier lb # [ 8.888486] dhcpcd[712]: eth0: carrier acquired client # [ 8.931740] dbus-broker-launch[438]: Ready lb # [ 8.905251] dhcpcd[712]: DUID 00:01:00:01:32:46:1c:0d:52:54:00:12:34:56 lb # [ 8.906166] dhcpcd[712]: eth0: IAID 00:12:34:56 lb # [ 8.906846] dhcpcd[712]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 8.958703] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.922524] postgresql-pre-start[734]: The files belonging to this database system will be owned by user "postgres". client # [ 8.964256] systemd[1]: Finished linger-users.service. lb # [ 8.924434] postgresql-pre-start[734]: This user must also own the server process. worker2 # [ 9.084506] Console: switching to colour frame buffer device 160x50 worker2 # [ 9.086778] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.928264] postgresql-pre-start[734]: The database cluster will be initialized with locale "en_US.UTF-8". worker2 # connecting to host... lb # [ 8.929505] postgresql-pre-start[734]: The default database encoding has accordingly been set to "UTF8". lb # [ 8.930646] postgresql-pre-start[734]: The default text search configuration will be set to "english". worker2 # [ 8.771489] nsncd[514]: Sep 23 05:11:41.958 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.931734] postgresql-pre-start[734]: Data page checksums are enabled. client # [ 8.971434] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.959460] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.932558] postgresql-pre-start[734]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok client # [ 8.973394] nsncd[512]: Sep 23 05:11:41.968 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.934164] postgresql-pre-start[734]: creating subdirectories ... ok lb # [ 8.935669] postgresql-pre-start[734]: selecting dynamic shared memory implementation ... posix client # [ 8.978945] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.981449] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.969348] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 8.973211] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' worker2 # [ 8.976352] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 8.991370] systemd[1]: Finished resolvconf update. worker2 # [ 8.980558] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.985366] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.999691] systemd[1]: Starting DHCP Client... worker2 # [ 8.990076] systemd[1]: Starting User Login Management... worker2 # [ 8.990836] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.994139] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.998376] nsncd[585]: Sep 23 05:11:42.182 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.000386] dbus-broker-launch[518]: Ready worker2 # [ 9.000988] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 9.004734] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 9.006227] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 9.008168] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 9.011102] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.011973] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.015238] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 9.017570] systemd-logind[539]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 9.023680] systemd-logind[539]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 9.026071] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.026931] systemd-logind[539]: New seat seat0. worker2 # [ 9.031193] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.035169] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.035890] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.036726] systemd[1]: Started User Login Management. worker2 # [ 9.037440] systemd[1]: Starting linger-users.service... worker2 # [ 9.038357] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 9.042200] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 9.043128] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.043941] systemd[1]: Finished resolvconf update. worker2 # [ 9.044639] systemd[1]: Reached target Preparation for Network. worker2 # [ 9.045418] systemd[1]: Starting DHCP Client... lb # [ 9.020453] postgresql-pre-start[734]: selecting default "max_connections" ... 100 worker2 # [ 9.053536] systemd[1]: Starting Address configuration of eth1... worker2 # [ 9.054394] systemd[1]: Starting Extra networking commands.... lb # [ 9.044087] systemd-vconsole-setup[665]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.048527] systemd[1]: Finished Virtual Console Setup. client # [ 9.089597] dhcpcd[551]: dhcpcd-10.3.2 starting worker2 # [ 9.212540] ppdev: user-space parallel port driver client # [ 9.095179] dhcpcd[558]: dev: loaded udev worker2 # [ 9.088168] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 9.089096] systemd[1]: Finished linger-users.service. client # [ 9.238031] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.113605] dhcpcd[690]: eth0: soliciting a DHCP lease lb # [ 9.102162] postgresql-pre-start[734]: selecting default "shared_buffers" ... 128MB client # [ 9.148493] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.265733] NET: Registered PF_PACKET protocol family worker1 # [ 9.138776] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 9.141359] dhcpcd[690]: eth0: probing address 10.0.2.15/24 client # [ 9.311959] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 9.183549] network-addresses-eth1-start[617]: adding address 192.168.1.4/24... done client # [ 9.333953] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.334835] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 9.337095] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.338135] cfg80211: failed to load regulatory.db worker2 # [ 9.202959] network-addresses-eth1-start[617]: adding address 2001:db8:1::4/64... done worker2 # [ 9.229713] systemd[1]: Finished Address configuration of eth1. client # [ 9.378338] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.246577] dhcpcd[558]: eth0: waiting for carrier client # [ 9.247578] dhcpcd[558]: eth0: carrier acquired client # [ 9.255720] dhcpcd[558]: DUID 00:01:00:01:32:46:1c:0e:52:54:00:12:34:56 client # [ 9.256943] dhcpcd[558]: eth0: IAID 00:12:34:56 client # [ 9.258105] dhcpcd[558]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 9.265175] systemd[1]: Finished nftables firewall. worker2 # [ 9.387049] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 9.266967] systemd[1]: Reached target Preparation for Network. client # [ 9.269741] systemd[1]: Starting Address configuration of eth1... client # [ 9.273948] systemd[1]: Starting Extra networking commands.... client # [ 9.446695] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 9.324424] network-addresses-eth1-start[584]: adding address 192.168.1.1/24... done worker2 # [ 9.313829] systemd-logind[539]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 9.336609] network-addresses-eth1-start[584]: adding address 2001:db8:1::1/64... done worker2 # [ 9.329719] systemd-vconsole-setup[601]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 9.348115] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.335248] systemd[1]: Finished Virtual Console Setup. worker2 # [ 9.477457] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 9.350619] dhcpcd[630]: dhcpcd-10.3.2 starting worker2 # [ 9.353299] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.354605] systemd[1]: Reached target Network. client # [ 9.368680] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.356440] systemd[1]: Starting Permit User Sessions... client # [ 9.370741] systemd[1]: Reached target Network. worker2 # [ 9.358208] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 9.373302] systemd[1]: Starting Permit User Sessions... worker2 # [ 9.360172] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.361379] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 9.365056] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.368360] dhcpcd[688]: dev: loaded udev client # [ 9.388527] systemd[1]: Finished Permit User Sessions. client # [ 9.391860] systemd[1]: Started Getty on tty1. client # [ 9.393333] systemd[1]: Reached target Login Prompts. worker2 # [ 9.518399] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 9.518822] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.432187] systemd[1]: Finished Permit User Sessions. worker2 # [ 9.440290] systemd[1]: Started Getty on tty1. worker2 # [ 9.440952] systemd[1]: Reached target Login Prompts. worker2 # [ 9.505667] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 9.650945] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 9.709440] kvm_amd: TSC scaling supported worker2 # [ 9.710000] kvm_amd: Nested Virtualization enabled worker2 # [ 9.710468] kvm_amd: Nested Paging enabled worker2 # [ 9.711210] kvm_amd: LBR virtualization supported worker2 # [ 9.711653] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 9.712363] kvm_amd: Virtual GIF supported worker2 # [ 9.712745] kvm_amd: Virtual NMI enabled worker2 # [ 9.722081] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 9.722734] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 9.725311] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 9.726217] cfg80211: failed to load regulatory.db worker2 # [ 9.762248] EDAC MC: Ver: 3.0.0 worker2 # [ 9.769603] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 9.638571] dhcpcd[688]: eth0: waiting for carrier worker2 # [ 9.639592] dhcpcd[688]: eth0: carrier acquired worker2 # [ 9.644953] dhcpcd[688]: DUID 00:01:00:01:32:46:1c:0e:52:54:00:12:34:56 worker2 # [ 9.646171] dhcpcd[688]: eth0: IAID 00:12:34:56 worker2 # [ 9.646875] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 9.686390] systemd-vconsole-setup[689]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 9.689516] systemd[1]: Finished Virtual Console Setup. lb # [ 9.688906] postgresql-pre-start[734]: selecting default time zone ... UTC lb # [ 9.691666] postgresql-pre-start[734]: creating configuration files ... ok lb # [ 9.814105] dhcpcd[712]: eth0: soliciting a DHCP lease lb # [ 9.987626] NET: Registered PF_PACKET protocol family lb # [ 9.865552] dhcpcd[712]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 9.867158] dhcpcd[712]: eth0: probing address 10.0.2.15/24 lb # [ 9.883782] postgresql-pre-start[734]: running bootstrap script ... ok client: (finished: waiting for unit network-addresses-eth1.service, in 10.66 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service lb # [ 10.321212] postgresql-pre-start[734]: performing post-bootstrap initialization ... ok worker1 # [ 10.373666] dhcpcd[690]: eth0: soliciting an IPv6 router worker1 # [ 10.376589] dhcpcd[690]: eth0: Router Advertisement from fe80::2 worker1 # [ 10.378813] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.381070] dhcpcd[690]: eth0: adding route to fec0::/64 worker1 # [ 10.382842] dhcpcd[690]: eth0: adding default route via fe80::2 client # [ 10.423677] dhcpcd[558]: eth0: soliciting a DHCP lease client # [ 10.573957] NET: Registered PF_PACKET protocol family client # [ 10.446873] dhcpcd[558]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 10.450268] dhcpcd[558]: eth0: probing address 10.0.2.15/24 lb # [ 10.528738] postgresql-pre-start[734]: syncing data to disk ... ok lb # [ 10.529761] postgresql-pre-start[734]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.530926] postgresql-pre-start[734]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.532830] postgresql-pre-start[734]: Success. You can now start the database server using: lb # [ 10.533880] postgresql-pre-start[734]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 10.609649] postgres[784]: [784] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.612209] postgres[784]: [784] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.613272] postgres[784]: [784] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.616840] postgres[784]: [784] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 10.626252] postgres[793]: [793] LOG: database system was shut down at 2026-09-23 05:11:42 GMT client # [ 10.668227] dhcpcd[558]: eth0: soliciting an IPv6 router client # [ 10.670554] dhcpcd[558]: eth0: Router Advertisement from fe80::2 lb # [ 10.632559] postgres[784]: [784] LOG: database system is ready to accept connections client # [ 10.673169] dhcpcd[558]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.675435] dhcpcd[558]: eth0: adding route to fec0::/64 lb # [ 10.636474] systemd[1]: Started PostgreSQL Server. client # [ 10.677424] dhcpcd[558]: eth0: adding default route via fe80::2 lb # [ 10.643065] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 10.765615] postgresql-setup-start[804]: CREATE DATABASE lb # [ 10.794326] postgresql-setup-start[809]: CREATE ROLE worker2 # [ 10.823445] dhcpcd[688]: eth0: soliciting a DHCP lease worker2 # [ 10.964956] NET: Registered PF_PACKET protocol family lb # [ 10.806199] postgresql-setup-start[811]: ALTER DATABASE worker2 # [ 10.834680] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 10.837115] dhcpcd[688]: eth0: probing address 10.0.2.15/24 lb # [ 10.811065] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.813183] systemd[1]: Reached target PostgreSQL. lb # [ 11.539642] dhcpcd[712]: eth0: soliciting an IPv6 router lb # [ 11.541074] dhcpcd[712]: eth0: Router Advertisement from fe80::2 lb # [ 11.541867] dhcpcd[712]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.543080] dhcpcd[712]: eth0: adding route to fec0::/64 lb # [ 11.543880] dhcpcd[712]: eth0: adding default route via fe80::2 worker2 # [ 11.714771] dhcpcd[688]: eth0: soliciting an IPv6 router worker2 # [ 11.717311] dhcpcd[688]: eth0: Router Advertisement from fe80::2 worker2 # [ 11.719721] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 11.721918] dhcpcd[688]: eth0: adding route to fec0::/64 worker2 # [ 11.723862] dhcpcd[688]: eth0: adding default route via fe80::2 worker1 # [ 13.987120] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 13.988066] dhcpcd[690]: eth0: adding route to 10.0.2.0/24 worker1 # [ 13.988791] dhcpcd[690]: eth0: adding default route via 10.0.2.2 worker1 # [ 14.049452] systemd[1]: Started DHCP Client. worker1 # [ 14.051065] systemd[1]: Reached target Multi-User System. worker1 # [ 14.052155] systemd[1]: Startup finished in 879ms (kernel) + 3.670s (initrd) + 9.501s (userspace) = 14.051s. lb # [ 14.888228] dhcpcd[712]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 14.892649] dhcpcd[712]: eth0: adding route to 10.0.2.0/24 lb # [ 14.894979] dhcpcd[712]: eth0: adding default route via 10.0.2.2 lb # [ 14.978175] systemd[1]: Started DHCP Client. lb # [ 14.980580] systemd[1]: Reached target Network is Online. lb # [ 14.983597] systemd[1]: Started Envoy reverse proxy. lb # [ 14.987791] systemd[1]: Started mock-oidc.service. lb # [ 15.165506] mock-oidc-server[911]: Mock OIDC Server running lb # [ 15.167245] mock-oidc-server[911]: OIDC Address: 192.168.1.2:8080 lb # [ 15.168476] mock-oidc-server[911]: Issue Address: 0.0.0.0:8081 lb # [ 15.169248] mock-oidc-server[911]: Issuer: http://192.168.1.2:8080/oidc lb # [ 15.170104] mock-oidc-server[911]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 15.171135] mock-oidc-server[911]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 15.172291] mock-oidc-server[911]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 15.311435] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 15.313170] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 15.314562] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 15.317084] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 15.319442] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 15.322353] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 15.325409] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 15.327234] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 15.328810] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 15.330251] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 15.331789] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 15.334057] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 15.336263] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 15.338093] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 15.341127] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 15.357178] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 15.358912] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 15.360511] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 15.362229] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 15.368310] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 15.369951] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 15.374045] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 15.375790] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 15.377825] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.379750] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 15.381483] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 15.385335] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 15.387052] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 15.388832] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 15.391237] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 15.392893] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 15.394606] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 15.398355] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 15.400208] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 15.402490] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 15.403911] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 15.407169] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 15.409247] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 15.410975] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 15.413824] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 15.417967] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 15.421282] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 15.423586] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 15.425571] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 15.428401] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 15.430114] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 15.431897] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 15.439728] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 15.441984] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 15.448899] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 15.451241] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 15.455821] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 15.457863] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 15.460261] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 15.464881] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.466714] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 15.468259] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 15.470050] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 15.471811] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 15.474741] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 15.479106] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 15.481032] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 15.486904] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 15.488594] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 15.492418] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 15.494265] envoy[910]: [2026-09-23 05:11:47.557][910][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 15.496976] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 15.502821] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 15.505621] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 15.507257] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 15.511216] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 15.512746] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 15.514787] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 15.516466] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 15.519210] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 15.520940] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher client # [ 15.561633] dhcpcd[558]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 15.564779] dhcpcd[558]: eth0: adding route to 10.0.2.0/24 lb # [ 15.523163] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 15.528250] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 client # [ 15.567985] dhcpcd[558]: eth0: adding default route via 10.0.2.2 lb # [ 15.529929] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 15.532940] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 15.557865] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 15.560206] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 15.562517] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 15.573337] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 15.574913] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 15.578062] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 15.579911] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 15.582052] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 15.584160] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 15.587081] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 15.588668] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 15.590492] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 15.593160] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 15.596878] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 15.601649] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 15.603762] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 15.605761] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 15.608138] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 15.610511] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 15.612768] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 15.615329] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 15.619488] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 15.622177] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 15.627598] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 15.630042] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 15.632074] envoy[910]: [2026-09-23 05:11:47.558][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 15.633460] envoy[910]: [2026-09-23 05:11:47.599][910][info][main] [source/server/server.cc:531] HTTP header map info: client # [ 15.675478] systemd[1]: Started DHCP Client. client # [ 15.677863] systemd[1]: Reached target Multi-User System. client # [ 15.679122] systemd[1]: Startup finished in 857ms (kernel) + 4.548s (initrd) + 10.272s (userspace) = 15.678s. lb # [ 15.634717] envoy[910]: [2026-09-23 05:11:47.600][910][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 15.647413] envoy[910]: [2026-09-23 05:11:47.600][910][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 15.648845] envoy[910]: [2026-09-23 05:11:47.600][910][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 15.656257] envoy[910]: [2026-09-23 05:11:47.600][910][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 15.659533] envoy[910]: [2026-09-23 05:11:47.857][910][info][main] [source/server/server.cc:968] runtime: {} lb # [ 15.660681] envoy[910]: [2026-09-23 05:11:47.905][910][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 15.662184] envoy[910]: [2026-09-23 05:11:47.905][910][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 15.664525] envoy[910]: [2026-09-23 05:11:47.905][910][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 15.666170] envoy[910]: [2026-09-23 05:11:47.911][910][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 15.667649] envoy[910]: [2026-09-23 05:11:47.911][910][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 15.669428] envoy[910]: [2026-09-23 05:11:47.911][910][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 15.690798] envoy[910]: [2026-09-23 05:11:47.937][910][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 15.696758] envoy[910]: [2026-09-23 05:11:47.943][910][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 15.699225] envoy[910]: [2026-09-23 05:11:47.945][910][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 15.702088] envoy[910]: [2026-09-23 05:11:47.945][910][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 15.721593] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 15.845080] nix-grpc-daemon[783]: ts=2026-09-23T05:11:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 15.858034] nix-grpc-daemon[783]: ts=2026-09-23T05:11:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 15.861110] nix-grpc-daemon[783]: ts=2026-09-23T05:11:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 15.876075] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 15.877800] nix-grpc-daemon[783]: E0000 00:00:1790140308.920040 783 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.885803] nix-grpc-daemon[783]: E0000 00:00:1790140308.930024 783 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.890074] nix-grpc-daemon[783]: ts=2026-09-23T05:11:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 15.891989] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 15.892661] envoy[910]: [2026-09-23 05:11:48.139][910][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 15.894469] envoy[910]: [2026-09-23 05:11:48.141][910][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 15.915909] nix-grpc-daemon[783]: E0000 00:00:1790140308.959567 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 15.896061] envoy[910]: [2026-09-23 05:11:48.141][910][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 15.899173] envoy[910]: [2026-09-23 05:11:48.146][910][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 15.927986] nix-grpc-daemon[783]: E0000 00:00:1790140308.972386 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.932055] nix-grpc-daemon[783]: E0000 00:00:1790140308.974711 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.943459] nix-grpc-daemon[783]: E0000 00:00:1790140308.987880 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.953250] nix-grpc-daemon[783]: ts=2026-09-23T05:11:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.954962] nix-grpc-daemon[783]: ts=2026-09-23T05:11:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.155612] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.157497] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.357997] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.359801] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.406423] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 16.407834] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 worker2 # [ 16.408990] dhcpcd[688]: eth0: adding default route via 10.0.2.2 worker2 # [ 16.465928] systemd[1]: Started DHCP Client. worker2 # [ 16.467967] systemd[1]: Reached target Multi-User System. worker2 # [ 16.470122] systemd[1]: Reached target Network is Online. worker2 # [ 16.471991] systemd[1]: Starting scheduler-token.service... worker2 # [ 16.506304] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 16.507817] systemd[1]: Finished scheduler-token.service. worker2 # [ 16.509122] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 35ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 16.513185] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 16.560730] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.562911] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.600684] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 16.610789] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 16.613061] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 16.625437] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 16.626945] nix-grpc-daemon[783]: E0000 00:00:1790140309.815104 783 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.632833] nix-grpc-daemon[783]: E0000 00:00:1790140309.822728 783 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.635952] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 16.639714] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 16.642797] systemd[1]: Startup finished in 870ms (kernel) + 4.606s (initrd) + 11.161s (userspace) = 16.637s. worker2 # [ 16.660109] nix-grpc-daemon[783]: E0000 00:00:1790140309.849865 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.672582] nix-grpc-daemon[783]: E0000 00:00:1790140309.862602 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.676137] nix-grpc-daemon[783]: E0000 00:00:1790140309.864767 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.687653] nix-grpc-daemon[783]: E0000 00:00:1790140309.877667 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.697993] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.699721] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.763509] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.765271] nix-grpc-daemon[783]: ts=2026-09-23T05:11:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.900663] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.902455] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.966142] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.967676] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.103190] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.105084] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.168474] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.170535] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.305751] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.307478] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.371150] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.373254] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.508141] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.509942] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.574056] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.576336] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.711861] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.714947] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.777366] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.781396] nix-grpc-daemon[783]: ts=2026-09-23T05:11:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.915677] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.917424] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.983452] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.986565] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.118180] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.119943] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.184237] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.188282] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.321351] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.325120] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.389078] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.393069] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.526357] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.530211] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.593570] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.595611] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.732628] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.735750] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.796185] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.798230] nix-grpc-daemon[783]: ts=2026-09-23T05:11:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.933632] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.937408] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.999099] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.000769] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.137844] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.139578] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.201777] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.205874] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.340924] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.345087] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.406884] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.410960] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.546240] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.550585] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.611632] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.615631] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.751571] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.753422] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.816104] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.817961] nix-grpc-daemon[783]: ts=2026-09-23T05:11:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.954715] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.958591] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.018882] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.021509] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.159632] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.163478] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.221913] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.223770] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.364618] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.368396] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.424792] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.428916] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.569065] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.571057] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.629662] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.633247] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.772053] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.773843] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.833969] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.837917] nix-grpc-daemon[783]: ts=2026-09-23T05:11:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.974521] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.976279] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.040833] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.044080] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.177090] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.178775] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.240947] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.243401] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.380093] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.384181] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.444721] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.449690] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.585259] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.589153] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.650798] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.654877] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.789925] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.791704] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.855925] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.859952] nix-grpc-daemon[783]: ts=2026-09-23T05:11:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.992544] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.994243] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.060956] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.063099] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.194948] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.196666] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.264433] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.266890] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.398197] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.402651] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.467676] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.469627] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 22.532625] rustfs-bucket-start[993]: mb s3://farm lb # [ 22.540272] systemd[1]: Finished rustfs-bucket.service. lb # [ 22.548117] systemd[1]: Starting niks3 server... worker2 # [ 22.602885] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.605058] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.670418] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.672312] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 22.657642] postgres[1008]: [1008] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 22.658878] postgres[1008]: [1008] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 22.682452] niks3-server[1002]: 2026/09/23 05:11:54 OK 20241026095416_initial_model.sql (14.15ms) lb # [ 22.686052] niks3-server[1002]: 2026/09/23 05:11:54 OK 20251210153512_drop_unused_gin_index.sql (3.92ms) lb # [ 22.691276] niks3-server[1002]: 2026/09/23 05:11:54 OK 20251218171726_add_pins.sql (5.31ms) lb # [ 22.695550] niks3-server[1002]: 2026/09/23 05:11:54 OK 20260628120000_add_object_size_and_stats.sql (2.96ms) lb # [ 22.699840] niks3-server[1002]: 2026/09/23 05:11:54 OK 20260905000000_add_claims.sql (4.27ms) lb # [ 22.703622] niks3-server[1002]: 2026/09/23 05:11:54 OK 20260920000000_drop_claims.sql (3.82ms) lb # [ 22.704853] niks3-server[1002]: 2026/09/23 05:11:54 goose: successfully migrated database to version: 20260920000000 lb # [ 22.709181] niks3-server[1002]: 2026/09/23 05:11:54 OK 1_commit_pending_closure.sql (2.78ms) lb # [ 22.711691] niks3-server[1002]: 2026/09/23 05:11:54 OK 2_object_stats_trigger.sql (2.43ms) lb # [ 22.712816] niks3-server[1002]: 2026/09/23 05:11:54 goose: up to current file version: 2 lb # [ 22.715681] niks3-server[1002]: 2026/09/23 05:11:54 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 22.741702] niks3-server[1002]: 2026/09/23 05:11:54 INFO Read proxy enabled — serving cache objects from S3 lb # [ 22.743383] niks3-server[1002]: 2026/09/23 05:11:54 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 22.750345] niks3-server[1002]: 2026/09/23 05:11:54 INFO systemd watchdog enabled interval=15s lb # [ 22.751549] niks3-server[1002]: 2026/09/23 05:11:54 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 22.752780] systemd[1]: Started niks3 server. lb # [ 22.753414] systemd[1]: Reached target Multi-User System. lb # [ 22.756189] systemd[1]: Startup finished in 885ms (kernel) + 3.662s (initrd) + 18.206s (userspace) = 22.755s. worker2 # [ 22.806032] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.807682] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.873421] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.878087] nix-grpc-daemon[783]: ts=2026-09-23T05:11:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.008902] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.012752] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.080825] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.084413] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 12.81 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.03 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 23.163177] envoy[910]: conn peer=[::1]:60962 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker2 # [ 23.213737] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.217583] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.285460] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.293866] systemd[1]: Starting scheduler-token.service... worker1 # [ 23.289311] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.327944] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 23.329573] systemd[1]: Finished scheduler-token.service. worker2 # [ 23.330903] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 35ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.03 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 23.418633] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.422228] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.490228] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.494088] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.623238] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.627214] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.694690] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.698263] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.829406] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.832466] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.899237] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.903234] nix-grpc-daemon[783]: ts=2026-09-23T05:11:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.030723] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.034626] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.104808] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.108663] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.235257] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.237072] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.309636] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.313735] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 24.437740] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.439464] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.514733] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.518606] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.640051] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.642038] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.719442] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.723383] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.844264] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.847439] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.923991] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.928085] nix-grpc-daemon[783]: ts=2026-09-23T05:11:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.045230] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.049150] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.130297] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.133473] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.250303] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.254111] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.331159] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.335217] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 25.455239] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 25.458976] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.536151] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.540239] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.659920] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.663790] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.741076] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.745090] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.865544] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.869285] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.946281] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.950859] nix-grpc-daemon[783]: ts=2026-09-23T05:11:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.070402] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.074347] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.151664] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.153568] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.275492] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.279908] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.354675] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.358669] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 26.481587] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.485493] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 26.559662] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.564189] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.686150] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.689940] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.765097] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.769320] nix-grpc-daemon[783]: ts=2026-09-23T05:11:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.891738] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.895489] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.969777] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.973581] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.093703] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.097656] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.175403] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.179174] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.298827] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.302752] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.379757] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.383870] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.503843] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.507897] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 27.584797] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.588796] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.708739] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.712686] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.789664] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.793567] nix-grpc-daemon[783]: ts=2026-09-23T05:12:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.914551] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.918266] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.994366] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.998177] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.119213] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.122923] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.199764] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.203658] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.324225] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.328118] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.404579] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.408312] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.529262] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.533150] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 28.609091] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.613168] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.734077] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.738114] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.814266] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.818329] nix-grpc-daemon[783]: ts=2026-09-23T05:12:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.939932] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.943759] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.019162] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.023152] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.145149] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.148985] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.224910] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.228689] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.350131] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.354209] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.429650] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.433850] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.555291] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.559308] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 29.634681] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.638661] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 29.760421] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.764127] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.839541] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.843559] nix-grpc-daemon[783]: ts=2026-09-23T05:12:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.966323] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.969494] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.044607] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.048546] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.167519] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.171560] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.250524] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.253884] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.372610] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.376510] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.454848] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.458909] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.577549] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.581484] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 30.659874] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.663775] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 30.782440] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.786448] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.864733] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.868645] nix-grpc-daemon[783]: ts=2026-09-23T05:12:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.988476] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.992158] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.069625] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.073476] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.192946] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.196772] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.275457] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.278600] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.397322] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.398960] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.476144] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.478483] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.600218] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.604595] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.678977] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.680880] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 31.805800] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.810257] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.881440] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.883247] nix-grpc-daemon[783]: ts=2026-09-23T05:12:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.014566] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.018461] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.084277] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.088257] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.214709] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.218450] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.289929] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.293816] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.419553] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.423367] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.494947] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.499149] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.624243] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.628484] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.699738] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.703690] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb # [ 32.758070] niks3-server[1002]: 2026/09/23 05:12:05 INFO lead: acquired remote=192.168.1.4:36706 worker2 # [ 32.785433] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_take_over worker2 # [ 32.829559] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.833883] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.903985] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.905712] nix-grpc-daemon[783]: ts=2026-09-23T05:12:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.035848] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.040120] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.106275] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.108182] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.237892] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.242361] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.309989] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.313822] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.443382] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.447855] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.514626] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.518538] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.648737] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.653161] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.719520] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.730902] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53478 worker2 # [ 33.735260] nix-grpc-daemon[783]: ts=2026-09-23T05:12:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 33.853483] nix-grpc-daemon[783]: ts=2026-09-23T05:12:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.860907] nix-grpc-daemon[783]: ts=2026-09-23T05:12:07Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 33.862139] nix-grpc-daemon[783]: ts=2026-09-23T05:12:07Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53478 worker2 # [ 33.863729] nix-grpc-daemon[783]: ts=2026-09-23T05:12:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 11.90 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 35.460745] nix-grpc-daemon[783]: ts=2026-09-23T05:12:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 35.472922] systemd[1]: Started Nix Daemon. worker2 # [ 35.585492] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 35.611893] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) worker2 # [ 35.681991] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5) worker2 # [ 35.832226] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 270 ms (attempt 3/5) worker2 # [ 36.110151] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 206 ms (attempt 4/5) worker2 # [ 36.319265] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 36.322702] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 36.350254] nix-grpc-daemon[783]: ts=2026-09-23T05:12:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 36.355355] systemd[1]: Started Nix Daemon. worker1 # [ 36.451820] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 36.476414] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 1/5) worker1 # [ 36.485641] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 192 ms (attempt 2/5) worker1 # [ 36.679928] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 231 ms (attempt 3/5) worker1 # [ 36.912829] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 252 ms (attempt 4/5) worker1 # [ 37.167865] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 37.171172] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 37.184190] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=path_info_miss path=xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test error="error: path '/nix/store/xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 37.205413] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 37.217722] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=path_info_miss path=xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test error="error: path '/nix/store/xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker2 # [ 37.436548] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53482 worker1 # [ 37.458893] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 37.463479] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:52822 worker1 # [ 37.472687] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=path_info_miss path=xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test error="error: path '/nix/store/xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 37.482362] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:52822 worker1 # [ 37.495688] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=path_info_miss path=xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test error="error: path '/nix/store/xm7zpmh78xsj3jfdbh2jw86x9ziaswkw-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker1 # [ 37.651365] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 37.792259] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.55 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 37.936441] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53482 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 37.941482] nix-grpc-daemon[783]: ts=2026-09-23T05:12:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 37.980676] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 37.984842] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 38.022444] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 38.035308] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 38.047111] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 38.060586] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 38.090172] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=info event=niks3_push_started pid=863 worker1 # [ 38.240471] nix-grpc-daemon[863]: time=2026-09-23T05:12:11.284Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 38.335553] nix-daemon[850]: accepted connection from pid 876, user nix-grpc-daemon (trusted) worker1 # [ 38.350777] nix-daemon[850]: reaped child process 879, status = succeeded lb # [ 38.333601] niks3-server[1002]: 2026/09/23 05:12:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.363301] nix-grpc-daemon[863]: time=2026-09-23T05:12:11.407Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 38.364789] nix-grpc-daemon[863]: time=2026-09-23T05:12:11.409Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 38.371634] niks3-server[1002]: 2026/09/23 05:12:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 38.380799] niks3-server[1002]: 2026/09/23 05:12:10 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 38.394226] niks3-server[1002]: 2026/09/23 05:12:10 INFO Signed narinfos id=1 count=1 worker1 # [ 38.419956] nix-grpc-daemon[863]: time=2026-09-23T05:12:11.463Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.405356] niks3-server[1002]: 2026/09/23 05:12:10 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 38.409350] niks3-server[1002]: 2026/09/23 05:12:10 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 38.419757] niks3-server[1002]: 2026/09/23 05:12:10 INFO Completed upload id=1 worker1 # [ 38.441887] nix-grpc-daemon[863]: time=2026-09-23T05:12:11.486Z level=INFO msg="Upload complete. (197ms)" worker1 # [ 38.444880] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 38.448300] nix-grpc-daemon[783]: ts=2026-09-23T05:12:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 lb # [ 38.430155] niks3-server[1002]: 2026/09/23 05:12:10 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker1 # [ 38.456670] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 38.460454] nix-daemon[850]: reaped child process 861, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker1 # [ 38.466340] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 39.506181] nix-daemon[850]: reaped child process 883, status = succeeded worker1 # [ 39.591420] nix-daemon[850]: accepted connection from pid 899, user nix-grpc-daemon (trusted) worker1 # [ 39.603980] nix-daemon[850]: reaped child process 902, status = succeeded lb # [ 39.589731] niks3-server[1002]: 2026/09/23 05:12:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.630336] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.674Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 39.634068] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.677Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 39.626684] niks3-server[1002]: 2026/09/23 05:12:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 39.629720] niks3-server[1002]: 2026/09/23 05:12:11 INFO Signed narinfos id=2 count=1 worker1 # [ 39.651796] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.695Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.634852] niks3-server[1002]: 2026/09/23 05:12:11 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 39.639322] niks3-server[1002]: 2026/09/23 05:12:11 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 39.642867] niks3-server[1002]: 2026/09/23 05:12:11 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 39.646426] niks3-server[1002]: 2026/09/23 05:12:11 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 39.649906] niks3-server[1002]: 2026/09/23 05:12:11 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 39.652570] niks3-server[1002]: 2026/09/23 05:12:11 INFO Completed upload id=2 worker1 # [ 39.674845] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.719Z level=INFO msg="Upload complete. (200ms)" worker1 # [ 39.678408] nix-grpc-daemon[783]: ts=2026-09-23T05:12:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 39.685816] nix-daemon[850]: reaped child process 881, status = succeeded worker2 # [ 39.695256] nix-grpc-daemon[783]: ts=2026-09-23T05:12:12Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 39.701207] nix-grpc-daemon[783]: ts=2026-09-23T05:12:12Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.733282] nix-grpc-daemon[783]: ts=2026-09-23T05:12:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 39.741772] nix-grpc-daemon[783]: ts=2026-09-23T05:12:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 39.751494] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.795Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 39.756678] nix-grpc-daemon[783]: ts=2026-09-23T05:12:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 39.769915] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 39.858729] nix-daemon[850]: accepted connection from pid 906, user nix-grpc-daemon (trusted) worker1 # [ 39.872764] nix-daemon[850]: reaped child process 909, status = succeeded lb # [ 39.857562] niks3-server[1002]: 2026/09/23 05:12:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.888236] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.932Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 39.889816] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.934Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 39.893151] niks3-server[1002]: 2026/09/23 05:12:12 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 39.898736] niks3-server[1002]: 2026/09/23 05:12:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 39.906334] niks3-server[1002]: 2026/09/23 05:12:12 INFO Signed narinfos id=3 count=1 worker1 # [ 39.932307] nix-grpc-daemon[863]: time=2026-09-23T05:12:12.976Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.916867] niks3-server[1002]: 2026/09/23 05:12:12 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 39.927832] niks3-server[1002]: 2026/09/23 05:12:12 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 39.937605] niks3-server[1002]: 2026/09/23 05:12:12 INFO Completed upload id=3 worker1 # [ 39.959570] nix-grpc-daemon[863]: time=2026-09-23T05:12:13.004Z level=INFO msg="Upload complete. (183ms)" lb # [ 39.939837] niks3-server[1002]: 2026/09/23 05:12:12 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 39.962810] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 39.966397] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 39.973134] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 39.975527] nix-daemon[850]: reaped child process 904, status = succeeded worker1 # [ 39.980755] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 40.593387] nix-daemon[850]: reaped child process 913, status = succeeded worker1 # [ 40.670889] nix-daemon[850]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker1 # [ 40.688917] nix-daemon[850]: reaped child process 932, status = succeeded lb # [ 40.670663] niks3-server[1002]: 2026/09/23 05:12:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.706308] nix-grpc-daemon[863]: time=2026-09-23T05:12:13.749Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 40.707678] nix-grpc-daemon[863]: time=2026-09-23T05:12:13.749Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 40.708677] niks3-server[1002]: 2026/09/23 05:12:12 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 40.725343] niks3-server[1002]: 2026/09/23 05:12:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 40.731328] niks3-server[1002]: 2026/09/23 05:12:12 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 40.736594] niks3-server[1002]: 2026/09/23 05:12:12 INFO Signed narinfos id=4 count=1 worker1 # [ 40.761259] nix-grpc-daemon[863]: time=2026-09-23T05:12:13.805Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.740771] niks3-server[1002]: 2026/09/23 05:12:12 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 40.749814] niks3-server[1002]: 2026/09/23 05:12:12 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 40.757972] niks3-server[1002]: 2026/09/23 05:12:13 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo lb # [ 40.762282] niks3-server[1002]: 2026/09/23 05:12:13 INFO Completed upload id=4 worker1 # [ 40.784439] nix-grpc-daemon[863]: time=2026-09-23T05:12:13.828Z level=INFO msg="Upload complete. (196ms)" worker1 # [ 40.787197] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 40.794491] nix-daemon[850]: reaped child process 911, status = succeeded worker2 # [ 40.800958] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 40.806307] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 40.839409] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 40.848677] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 40.858131] nix-grpc-daemon[863]: time=2026-09-23T05:12:13.902Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 40.863989] nix-grpc-daemon[783]: ts=2026-09-23T05:12:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 40.879057] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 40.965463] nix-daemon[850]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker1 # [ 40.978776] nix-daemon[850]: reaped child process 940, status = succeeded lb # [ 40.963559] niks3-server[1002]: 2026/09/23 05:12:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.994984] nix-grpc-daemon[863]: time=2026-09-23T05:12:14.039Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.996509] nix-grpc-daemon[863]: time=2026-09-23T05:12:14.040Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 40.998161] niks3-server[1002]: 2026/09/23 05:12:13 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 41.006646] niks3-server[1002]: 2026/09/23 05:12:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 41.035944] nix-grpc-daemon[863]: time=2026-09-23T05:12:14.080Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.013951] niks3-server[1002]: 2026/09/23 05:12:13 INFO Signed narinfos id=5 count=1 lb # [ 41.019857] niks3-server[1002]: 2026/09/23 05:12:13 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 41.030755] niks3-server[1002]: 2026/09/23 05:12:13 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 41.034072] niks3-server[1002]: 2026/09/23 05:12:13 INFO Completed upload id=5 lb # [ 41.035872] niks3-server[1002]: 2026/09/23 05:12:13 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 41.057955] nix-grpc-daemon[863]: time=2026-09-23T05:12:14.102Z level=INFO msg="Upload complete. (172ms)" worker1 # [ 41.062179] nix-grpc-daemon[783]: ts=2026-09-23T05:12:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 41.067415] nix-grpc-daemon[783]: ts=2026-09-23T05:12:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 41.077195] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 41.085057] nix-daemon[850]: reaped child process 935, status = succeeded worker1 # [ 41.090046] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 42.129523] nix-daemon[850]: reaped child process 944, status = succeeded worker1 # [ 42.213391] nix-daemon[850]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker1 # [ 42.227313] nix-daemon[850]: reaped child process 963, status = succeeded lb # [ 42.212757] niks3-server[1002]: 2026/09/23 05:12:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.245150] nix-grpc-daemon[863]: time=2026-09-23T05:12:15.289Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 42.246867] nix-grpc-daemon[863]: time=2026-09-23T05:12:15.291Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 42.255678] niks3-server[1002]: 2026/09/23 05:12:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 42.263792] niks3-server[1002]: 2026/09/23 05:12:14 INFO Signed narinfos id=6 count=1 worker1 # [ 42.288935] nix-grpc-daemon[863]: time=2026-09-23T05:12:15.333Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.268931] niks3-server[1002]: 2026/09/23 05:12:14 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 42.274096] niks3-server[1002]: 2026/09/23 05:12:14 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 42.284117] niks3-server[1002]: 2026/09/23 05:12:14 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 42.289059] niks3-server[1002]: 2026/09/23 05:12:14 INFO Completed upload id=6 lb # [ 42.291307] niks3-server[1002]: 2026/09/23 05:12:14 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls worker1 # [ 42.312605] nix-grpc-daemon[863]: time=2026-09-23T05:12:15.356Z level=INFO msg="Upload complete. (214ms)" lb # [ 42.293361] niks3-server[1002]: 2026/09/23 05:12:14 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 42.318816] nix-grpc-daemon[783]: ts=2026-09-23T05:12:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 42.333079] nix-daemon[850]: reaped child process 942, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 4.55 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 4.89 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 43.172197] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52822 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 43.189990] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 43.198849] nix-grpc-daemon[863]: time=2026-09-23T05:12:16.243Z level=INFO msg="All 2 paths already cached" worker2 # [ 43.220210] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.20 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.80 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 43.749799] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53482 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 43.753784] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 43.759303] nix-grpc-daemon[863]: time=2026-09-23T05:12:16.803Z level=INFO msg="All 2 paths already cached" worker2 # [ 43.774146] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 43.778370] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 43.780260] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 43.788036] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 43.796121] nix-grpc-daemon[863]: time=2026-09-23T05:12:16.840Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 43.801326] nix-grpc-daemon[783]: ts=2026-09-23T05:12:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 43.807567] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 43.892279] nix-daemon[850]: accepted connection from pid 980, user nix-grpc-daemon (trusted) worker1 # [ 43.907844] nix-daemon[850]: reaped child process 983, status = succeeded lb # [ 43.890474] niks3-server[1002]: 2026/09/23 05:12:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.922829] nix-grpc-daemon[863]: time=2026-09-23T05:12:16.967Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.924428] nix-grpc-daemon[863]: time=2026-09-23T05:12:16.968Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 43.930117] niks3-server[1002]: 2026/09/23 05:12:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 43.934477] niks3-server[1002]: 2026/09/23 05:12:16 INFO Signed narinfos id=7 count=1 worker1 # [ 43.959258] nix-grpc-daemon[863]: time=2026-09-23T05:12:17.003Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.943566] niks3-server[1002]: 2026/09/23 05:12:16 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 43.956685] niks3-server[1002]: 2026/09/23 05:12:16 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 43.960332] niks3-server[1002]: 2026/09/23 05:12:16 INFO Completed upload id=7 worker1 # [ 43.982751] nix-grpc-daemon[863]: time=2026-09-23T05:12:17.027Z level=INFO msg="Upload complete. (170ms)" lb # [ 43.962782] niks3-server[1002]: 2026/09/23 05:12:16 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 43.965870] niks3-server[1002]: 2026/09/23 05:12:16 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 43.986686] nix-grpc-daemon[783]: ts=2026-09-23T05:12:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 43.992220] nix-grpc-daemon[783]: ts=2026-09-23T05:12:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 44.000418] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 44.006424] nix-daemon[850]: reaped child process 978, status = succeeded worker1 # [ 44.011256] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 45.226669] nix-daemon[850]: reaped child process 987, status = succeeded worker1 # [ 45.301314] nix-daemon[850]: accepted connection from pid 1003, user nix-grpc-daemon (trusted) worker1 # [ 45.314515] nix-daemon[850]: reaped child process 1006, status = succeeded lb # [ 45.300409] niks3-server[1002]: 2026/09/23 05:12:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.333749] nix-grpc-daemon[863]: time=2026-09-23T05:12:18.377Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.335271] nix-grpc-daemon[863]: time=2026-09-23T05:12:18.379Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 45.346728] niks3-server[1002]: 2026/09/23 05:12:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 45.354105] niks3-server[1002]: 2026/09/23 05:12:17 INFO Signed narinfos id=8 count=1 worker1 # [ 45.380709] nix-grpc-daemon[863]: time=2026-09-23T05:12:18.424Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.365096] niks3-server[1002]: 2026/09/23 05:12:17 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 45.369563] niks3-server[1002]: 2026/09/23 05:12:17 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 45.379522] niks3-server[1002]: 2026/09/23 05:12:17 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 45.383821] niks3-server[1002]: 2026/09/23 05:12:17 INFO Completed upload id=8 lb # [ 45.385720] niks3-server[1002]: 2026/09/23 05:12:17 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst worker1 # [ 45.407977] nix-grpc-daemon[863]: time=2026-09-23T05:12:18.452Z level=INFO msg="Upload complete. (189ms)" lb # [ 45.388821] niks3-server[1002]: 2026/09/23 05:12:17 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 45.414562] nix-grpc-daemon[783]: ts=2026-09-23T05:12:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 45.428779] nix-daemon[850]: reaped child process 985, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.84 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.17 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 lb # [ 45.695725] envoy[910]: conn peer=[2001:db8:1::1]:49900 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=383 ms=1782 lb # [ 45.699491] envoy[910]: conn peer=[2001:db8:1::1]:49906 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=74 lb # [ 45.703497] envoy[910]: conn peer=[2001:db8:1::1]:49920 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=19 lb # [ 45.706774] envoy[910]: conn peer=[2001:db8:1::1]:49934 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 lb # [ 45.710269] envoy[910]: conn peer=[2001:db8:1::1]:49940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9464 tx=4345 ms=4404 lb # [ 45.713777] envoy[910]: conn peer=[2001:db8:1::1]:55100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=56 lb # [ 45.717170] envoy[910]: conn peer=[2001:db8:1::1]:55104 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4135 tx=1856 ms=1679 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 45.818647] nix-grpc-daemon[783]: ts=2026-09-23T05:12:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 45.828720] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 45.851524] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 45.856980] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.862601] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 45.873651] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker2 # [ 45.884797] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 45.895969] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 45.914517] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=info event=niks3_push_started pid=925 worker2 # [ 46.033558] nix-grpc-daemon[925]: time=2026-09-23T05:12:19.223Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 46.124140] nix-daemon[873]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker2 # [ 46.137529] nix-daemon[873]: reaped child process 940, status = succeeded lb # [ 46.118165] niks3-server[1002]: 2026/09/23 05:12:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.154127] nix-grpc-daemon[925]: time=2026-09-23T05:12:19.344Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 46.155719] nix-grpc-daemon[925]: time=2026-09-23T05:12:19.345Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 46.155752] niks3-server[1002]: 2026/09/23 05:12:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 46.161361] niks3-server[1002]: 2026/09/23 05:12:18 INFO Signed narinfos id=9 count=1 worker2 # [ 46.192544] nix-grpc-daemon[925]: time=2026-09-23T05:12:19.381Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.170936] niks3-server[1002]: 2026/09/23 05:12:18 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 46.180319] niks3-server[1002]: 2026/09/23 05:12:18 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 46.187431] niks3-server[1002]: 2026/09/23 05:12:18 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker2 # [ 46.222465] nix-grpc-daemon[925]: time=2026-09-23T05:12:19.412Z level=INFO msg="Upload complete. (184ms)" lb # [ 46.195240] niks3-server[1002]: 2026/09/23 05:12:18 INFO Completed upload id=9 worker2 # [ 46.224358] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 46.202796] niks3-server[1002]: 2026/09/23 05:12:18 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker2 # [ 46.230568] nix-grpc-daemon[783]: ts=2026-09-23T05:12:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 46.235186] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 46.237853] nix-daemon[873]: reaped child process 923, status = succeeded worker2 # [ 46.243109] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker2 # [ 47.483924] nix-daemon[873]: reaped child process 944, status = succeeded worker2 # [ 47.548752] nix-daemon[873]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker2 # [ 47.560131] nix-daemon[873]: reaped child process 963, status = succeeded lb # [ 47.539960] niks3-server[1002]: 2026/09/23 05:12:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.576250] nix-grpc-daemon[925]: time=2026-09-23T05:12:20.766Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 47.579067] nix-grpc-daemon[925]: time=2026-09-23T05:12:20.767Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 47.577859] niks3-server[1002]: 2026/09/23 05:12:19 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 47.589683] niks3-server[1002]: 2026/09/23 05:12:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 47.598101] niks3-server[1002]: 2026/09/23 05:12:19 INFO Signed narinfos id=10 count=1 worker2 # [ 47.628568] nix-grpc-daemon[925]: time=2026-09-23T05:12:20.818Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.603447] niks3-server[1002]: 2026/09/23 05:12:19 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 47.608215] niks3-server[1002]: 2026/09/23 05:12:19 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 47.619428] niks3-server[1002]: 2026/09/23 05:12:19 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 47.622151] niks3-server[1002]: 2026/09/23 05:12:19 INFO Completed upload id=10 lb # [ 47.624631] niks3-server[1002]: 2026/09/23 05:12:19 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 47.649544] nix-grpc-daemon[925]: time=2026-09-23T05:12:20.839Z level=INFO msg="Upload complete. (199ms)" worker2 # [ 47.657164] nix-grpc-daemon[783]: ts=2026-09-23T05:12:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 47.668367] nix-grpc-daemon[783]: ts=2026-09-23T05:12:20Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker2 # [ 47.673098] nix-grpc-daemon[783]: ts=2026-09-23T05:12:20Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 47.682289] nix-daemon[873]: reaped child process 942, status = succeeded worker2 # [ 47.712418] nix-grpc-daemon[783]: ts=2026-09-23T05:12:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 47.724770] nix-grpc-daemon[783]: ts=2026-09-23T05:12:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 47.737407] nix-grpc-daemon[925]: time=2026-09-23T05:12:20.927Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker2 # [ 47.745541] nix-grpc-daemon[783]: ts=2026-09-23T05:12:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 47.753576] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 47.845258] nix-daemon[873]: accepted connection from pid 969, user nix-grpc-daemon (trusted) worker2 # [ 47.862060] nix-daemon[873]: reaped child process 972, status = succeeded lb # [ 47.834803] niks3-server[1002]: 2026/09/23 05:12:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.870271] nix-grpc-daemon[925]: time=2026-09-23T05:12:21.060Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 47.871726] nix-grpc-daemon[925]: time=2026-09-23T05:12:21.061Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 47.869815] niks3-server[1002]: 2026/09/23 05:12:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 47.876161] niks3-server[1002]: 2026/09/23 05:12:20 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 47.884531] niks3-server[1002]: 2026/09/23 05:12:20 INFO Signed narinfos id=11 count=1 worker2 # [ 47.916051] nix-grpc-daemon[925]: time=2026-09-23T05:12:21.106Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.893071] niks3-server[1002]: 2026/09/23 05:12:20 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 47.904991] niks3-server[1002]: 2026/09/23 05:12:20 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 47.914493] niks3-server[1002]: 2026/09/23 05:12:20 INFO Completed upload id=11 worker2 # [ 47.942058] nix-grpc-daemon[925]: time=2026-09-23T05:12:21.131Z level=INFO msg="Upload complete. (176ms)" lb # [ 47.917740] niks3-server[1002]: 2026/09/23 05:12:20 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 47.946790] nix-grpc-daemon[783]: ts=2026-09-23T05:12:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 47.953295] nix-grpc-daemon[783]: ts=2026-09-23T05:12:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 47.962130] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 47.973267] nix-daemon[873]: reaped child process 967, status = succeeded worker2 # [ 47.977681] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker2 # [ 48.794201] nix-daemon[873]: reaped child process 976, status = succeeded worker2 # [ 48.865782] nix-daemon[873]: accepted connection from pid 992, user nix-grpc-daemon (trusted) worker2 # [ 48.878744] nix-daemon[873]: reaped child process 995, status = succeeded lb # [ 48.859503] niks3-server[1002]: 2026/09/23 05:12:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.896163] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.085Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 48.898061] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.087Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 48.901561] niks3-server[1002]: 2026/09/23 05:12:21 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 48.910488] niks3-server[1002]: 2026/09/23 05:12:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 48.916249] niks3-server[1002]: 2026/09/23 05:12:21 INFO Signed narinfos id=12 count=1 worker2 # [ 48.946799] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.136Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.924946] niks3-server[1002]: 2026/09/23 05:12:21 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 48.934628] niks3-server[1002]: 2026/09/23 05:12:21 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 48.941804] niks3-server[1002]: 2026/09/23 05:12:21 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 48.945510] niks3-server[1002]: 2026/09/23 05:12:21 INFO Completed upload id=12 worker2 # [ 48.973060] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.162Z level=INFO msg="Upload complete. (189ms)" lb # [ 48.947993] niks3-server[1002]: 2026/09/23 05:12:21 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 48.983803] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 48.994141] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker2 # [ 48.998713] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 49.009550] nix-daemon[873]: reaped child process 974, status = succeeded worker2 # [ 49.038101] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 49.052408] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 49.066229] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.256Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker2 # [ 49.075157] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 49.083326] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 49.179274] nix-daemon[873]: accepted connection from pid 1001, user nix-grpc-daemon (trusted) worker2 # [ 49.192508] nix-daemon[873]: reaped child process 1004, status = succeeded lb # [ 49.172757] niks3-server[1002]: 2026/09/23 05:12:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.208700] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.398Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 49.210754] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.400Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 49.209122] niks3-server[1002]: 2026/09/23 05:12:21 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 49.221258] niks3-server[1002]: 2026/09/23 05:12:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker2 # [ 49.254437] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.444Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.226927] niks3-server[1002]: 2026/09/23 05:12:21 INFO Signed narinfos id=13 count=1 lb # [ 49.239060] niks3-server[1002]: 2026/09/23 05:12:21 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 49.267573] niks3-server[1002]: 2026/09/23 05:12:21 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 49.273183] niks3-server[1002]: 2026/09/23 05:12:21 INFO Completed upload id=13 worker2 # [ 49.300371] nix-grpc-daemon[925]: time=2026-09-23T05:12:22.490Z level=INFO msg="Upload complete. (204ms)" lb # [ 49.277681] niks3-server[1002]: 2026/09/23 05:12:21 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 49.305563] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 49.311919] nix-grpc-daemon[783]: ts=2026-09-23T05:12:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 49.325320] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 49.333646] nix-daemon[873]: reaped child process 999, status = succeeded client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... worker2 # [ 49.342594] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker2 # [ 50.359856] nix-daemon[873]: reaped child process 1008, status = succeeded worker2 # [ 50.435023] nix-daemon[873]: accepted connection from pid 1024, user nix-grpc-daemon (trusted) worker2 # [ 50.448253] nix-daemon[873]: reaped child process 1027, status = succeeded lb # [ 50.428068] niks3-server[1002]: 2026/09/23 05:12:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.462192] nix-grpc-daemon[925]: time=2026-09-23T05:12:23.650Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 50.463680] nix-grpc-daemon[925]: time=2026-09-23T05:12:23.650Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 50.448722] niks3-server[1002]: 2026/09/23 05:12:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker2 # [ 50.478690] nix-grpc-daemon[925]: time=2026-09-23T05:12:23.668Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.451923] niks3-server[1002]: 2026/09/23 05:12:22 INFO Signed narinfos id=14 count=1 lb # [ 50.459223] niks3-server[1002]: 2026/09/23 05:12:22 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 50.462071] niks3-server[1002]: 2026/09/23 05:12:22 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 50.466401] niks3-server[1002]: 2026/09/23 05:12:22 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 50.472941] niks3-server[1002]: 2026/09/23 05:12:22 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 50.477894] niks3-server[1002]: 2026/09/23 05:12:22 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 50.480382] niks3-server[1002]: 2026/09/23 05:12:22 INFO Completed upload id=14 worker2 # [ 50.507452] nix-grpc-daemon[925]: time=2026-09-23T05:12:23.697Z level=INFO msg="Upload complete. (153ms)" worker2 # [ 50.510050] nix-grpc-daemon[783]: ts=2026-09-23T05:12:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker2 # [ 50.517861] nix-daemon[873]: reaped child process 1006, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 4.90 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.13 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 50.834888] nix-grpc-daemon[783]: ts=2026-09-23T05:12:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:38822 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 50.853370] nix-grpc-daemon[783]: ts=2026-09-23T05:12:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:38822 worker1 # [ 50.859906] nix-grpc-daemon[783]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 50.870647] nix-grpc-daemon[783]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 50.879679] nix-grpc-daemon[783]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.19 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 51.034568] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:56248 worker2 # [ 51.039556] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:56248 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.18 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/802" client # removing stale temporary roots file "/nix/var/nix/temproots/873" client # removing stale temporary roots file "/nix/var/nix/temproots/881" client # removing stale temporary roots file "/nix/var/nix/temproots/840" client # removing stale temporary roots file "/nix/var/nix/temproots/819" client # removing stale temporary roots file "/nix/var/nix/temproots/896" client # removing stale temporary roots file "/nix/var/nix/temproots/860" client # removing stale temporary roots file "/nix/var/nix/temproots/852" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker1 # [ 51.340585] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 51.343547] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 51.348853] nix-grpc-daemon[863]: time=2026-09-23T05:12:24.393Z level=INFO msg="All 1 paths already cached" worker2 # [ 51.359243] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53482 worker1 # [ 51.360459] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52822 client # copying 3 paths... worker2 # [ 51.372865] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53482 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 51.382239] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 51.385213] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 51.394638] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 worker1 # [ 51.394304] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 51.397027] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 51.400350] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_out=176 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.39 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 5.79 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 51.516744] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: e9a83eb352e14927b05a0f8dc186acde client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 51.700706] nix[949]: don't know how to build these paths: client # [ 51.701703] nix[949]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 51.686268] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 51.695867] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 51.700152] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.734701] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 51.746767] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 client # [ 51.773476] nix[949]: copying 1 paths to 'lb:50051'... client # [ 51.776958] nix[949]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 51.758978] nix-grpc-daemon[783]: ts=2026-09-23T05:12:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 51.770932] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 51.881464] nix-daemon[850]: accepted connection from pid 1013, user nix-grpc-daemon (trusted) worker1 # [ 51.895859] nix-daemon[850]: reaped child process 1016, status = succeeded lb # [ 51.881576] niks3-server[1002]: 2026/09/23 05:12:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.912155] nix-grpc-daemon[863]: time=2026-09-23T05:12:24.956Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 51.913633] nix-grpc-daemon[863]: time=2026-09-23T05:12:24.956Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 51.912844] niks3-server[1002]: 2026/09/23 05:12:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker1 # [ 51.944489] nix-grpc-daemon[863]: time=2026-09-23T05:12:24.988Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.922227] niks3-server[1002]: 2026/09/23 05:12:24 INFO Signed narinfos id=15 count=1 lb # [ 51.935594] niks3-server[1002]: 2026/09/23 05:12:24 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 51.940391] niks3-server[1002]: 2026/09/23 05:12:24 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 51.950883] niks3-server[1002]: 2026/09/23 05:12:24 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 51.956724] niks3-server[1002]: 2026/09/23 05:12:24 INFO Completed upload id=15 worker1 # [ 51.978879] nix-grpc-daemon[863]: time=2026-09-23T05:12:25.023Z level=INFO msg="Upload complete. (195ms)" lb # [ 51.959324] niks3-server[1002]: 2026/09/23 05:12:24 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 51.984637] nix-grpc-daemon[783]: ts=2026-09-23T05:12:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 51.993505] nix-grpc-daemon[783]: ts=2026-09-23T05:12:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 52.005106] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 52.013265] nix-daemon[850]: reaped child process 1011, status = succeeded worker1 # [ 52.018385] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # [ 52.036973] nix[949]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 52.574902] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: ae920bf2437b44c4af20ef1be6eebde1 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds) worker2 # [ 52.723955] nix-grpc-daemon[783]: ts=2026-09-23T05:12:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53482 client # [ 52.744654] nix[965]: don't know how to build these paths: client # [ 52.745905] nix[965]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 52.737799] nix-grpc-daemon[783]: ts=2026-09-23T05:12:25Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 52.737950] nix-grpc-daemon[783]: ts=2026-09-23T05:12:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 client # [ 52.761705] nix[965]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 lb # [ 55.697156] envoy[910]: conn peer=[2001:db8:1::1]:55114 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=4358 ms=4742 lb # [ 55.700977] envoy[910]: conn peer=[2001:db8:1::1]:55124 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2890 ms=119 lb # [ 55.705242] envoy[910]: conn peer=[2001:db8:1::1]:55158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=65 lb # [ 55.709204] envoy[910]: conn peer=[2001:db8:1::1]:55142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=71 lb # [ 55.713223] envoy[910]: conn peer=[2001:db8:1::1]:55136 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=77 client: (finished: must succeed: sleep 2, in 2.04 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 56.063997] nix-daemon[850]: reaped child process 1020, status = succeeded worker1 # [ 56.143720] nix-daemon[850]: accepted connection from pid 1050, user nix-grpc-daemon (trusted) worker1 # [ 56.158457] nix-daemon[850]: reaped child process 1053, status = succeeded lb # [ 56.141665] niks3-server[1002]: 2026/09/23 05:12:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.173250] nix-grpc-daemon[863]: time=2026-09-23T05:12:29.217Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 56.176063] nix-grpc-daemon[863]: time=2026-09-23T05:12:29.219Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 56.192817] niks3-server[1002]: 2026/09/23 05:12:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 56.200542] niks3-server[1002]: 2026/09/23 05:12:28 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 56.204792] niks3-server[1002]: 2026/09/23 05:12:28 INFO Signed narinfos id=16 count=1 worker1 # [ 56.230090] nix-grpc-daemon[863]: time=2026-09-23T05:12:29.274Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.208214] niks3-server[1002]: 2026/09/23 05:12:28 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 56.215660] niks3-server[1002]: 2026/09/23 05:12:28 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 56.226155] niks3-server[1002]: 2026/09/23 05:12:28 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 56.229630] niks3-server[1002]: 2026/09/23 05:12:28 INFO Completed upload id=16 worker1 # [ 56.251862] nix-grpc-daemon[863]: time=2026-09-23T05:12:29.296Z level=INFO msg="Upload complete. (221ms)" lb # [ 56.232042] niks3-server[1002]: 2026/09/23 05:12:28 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker1 # [ 56.258696] nix-grpc-daemon[783]: ts=2026-09-23T05:12:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 56.266321] nix-grpc-daemon[783]: ts=2026-09-23T05:12:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 56.278661] nix-daemon[850]: reaped child process 1018, status = succeeded client # [ 56.323454] systemd[1]: dedup2.service: Deactivated successfully. client # [ 56.328200] systemd[1]: dedup2.service: Consumed 138ms CPU time over 3.752s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client # [ 56.334843] systemd[1]: dedup1.service: Deactivated successfully. client # [ 56.337214] systemd[1]: dedup1.service: Consumed 135ms CPU time over 4.817s wall clock time, 41.5M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.70 seconds) subtest: --timeout and --max-silent-time reach the builder worker1 # [ 57.328996] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 57.343081] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 57.346756] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.348945] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 57.353954] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 57.361836] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 57.368393] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 57.459943] nix-daemon[873]: accepted connection from pid 1058, user nix-grpc-daemon (trusted) worker2 # [ 57.475805] nix-daemon[873]: reaped child process 1061, status = succeeded lb # [ 57.453867] niks3-server[1002]: 2026/09/23 05:12:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 57.490047] nix-grpc-daemon[925]: time=2026-09-23T05:12:30.679Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.492139] nix-grpc-daemon[925]: time=2026-09-23T05:12:30.681Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 57.484717] niks3-server[1002]: 2026/09/23 05:12:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 57.493939] niks3-server[1002]: 2026/09/23 05:12:29 INFO Signed narinfos id=17 count=1 worker2 # [ 57.524864] nix-grpc-daemon[925]: time=2026-09-23T05:12:30.714Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.500360] niks3-server[1002]: 2026/09/23 05:12:29 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 57.508563] niks3-server[1002]: 2026/09/23 05:12:29 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 57.521888] niks3-server[1002]: 2026/09/23 05:12:29 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 57.528878] niks3-server[1002]: 2026/09/23 05:12:29 INFO Completed upload id=17 lb # [ 57.531155] niks3-server[1002]: 2026/09/23 05:12:29 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 57.556929] nix-grpc-daemon[925]: time=2026-09-23T05:12:30.746Z level=INFO msg="Upload complete. (181ms)" worker2 # [ 57.561455] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 57.567367] nix-grpc-daemon[783]: ts=2026-09-23T05:12:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 57.576828] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 57.586751] nix-daemon[873]: reaped child process 1056, status = succeeded worker2 # [ 57.591059] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 63.806497] nix-grpc-daemon[783]: ts=2026-09-23T05:12:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker2 # [ 63.831624] nix-daemon[873]: reaped child process 1063, status = succeeded worker2 # [ 63.833965] nix-daemon[873]: reaped child process 1065, status = succeeded worker2 # [ 63.969689] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 63.980925] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 63.985437] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 63.980260] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 63.992175] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 64.002837] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 64.014988] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 64.123801] nix-daemon[850]: accepted connection from pid 1066, user nix-grpc-daemon (trusted) worker1 # [ 64.138858] nix-daemon[850]: reaped child process 1069, status = succeeded lb # [ 64.123555] niks3-server[1002]: 2026/09/23 05:12:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.154476] nix-grpc-daemon[863]: time=2026-09-23T05:12:37.198Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 64.156097] nix-grpc-daemon[863]: time=2026-09-23T05:12:37.200Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 64.166892] niks3-server[1002]: 2026/09/23 05:12:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 64.173457] niks3-server[1002]: 2026/09/23 05:12:36 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls worker1 # [ 64.202555] nix-grpc-daemon[863]: time=2026-09-23T05:12:37.246Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.181132] niks3-server[1002]: 2026/09/23 05:12:36 INFO Signed narinfos id=18 count=1 lb # [ 64.193349] niks3-server[1002]: 2026/09/23 05:12:36 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 64.221610] niks3-server[1002]: 2026/09/23 05:12:36 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 64.229411] niks3-server[1002]: 2026/09/23 05:12:36 INFO Completed upload id=18 worker1 # [ 64.251470] nix-grpc-daemon[863]: time=2026-09-23T05:12:37.295Z level=INFO msg="Upload complete. (224ms)" lb # [ 64.233191] niks3-server[1002]: 2026/09/23 05:12:36 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 64.256723] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 64.262804] nix-grpc-daemon[783]: ts=2026-09-23T05:12:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 64.275160] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 64.288224] nix-daemon[850]: reaped child process 1064, status = succeeded worker1 # [ 64.293750] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) lb # [ 65.697629] envoy[910]: conn peer=[2001:db8:1::1]:55174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3037 tx=1536 ms=4633 lb # [ 65.701422] envoy[910]: conn peer=[2001:db8:1::1]:55184 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=3566 lb # [ 65.705159] envoy[910]: conn peer=[2001:db8:1::1]:36340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=935 ms=6490 worker1 # [ 70.711952] nix-grpc-daemon[783]: ts=2026-09-23T05:12:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker1 # [ 70.737606] nix-daemon[850]: reaped child process 1071, status = succeeded worker1 # [ 70.740258] nix-daemon[850]: reaped child process 1073, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.63 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 70.870526] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 87442d6c679845819b5fe4733c079209 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share worker1 # [ 70.993278] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52822 client # [ 71.018106] nix[1037]: don't know how to build these paths: client # [ 71.018986] nix[1037]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 71.014382] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 71.020231] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 71.024681] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 71.037513] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 client # [ 71.061085] nix[1037]: copying 1 paths to 'lb:50051'... client # [ 71.061851] nix[1037]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 71.048877] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 71.060090] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 71.159955] nix-daemon[873]: accepted connection from pid 1092, user nix-grpc-daemon (trusted) worker2 # [ 71.173034] nix-daemon[873]: reaped child process 1095, status = succeeded lb # [ 71.153264] niks3-server[1002]: 2026/09/23 05:12:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.189149] nix-grpc-daemon[925]: time=2026-09-23T05:12:44.378Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 71.191146] nix-grpc-daemon[925]: time=2026-09-23T05:12:44.380Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 71.186202] niks3-server[1002]: 2026/09/23 05:12:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign worker2 # [ 71.220472] nix-grpc-daemon[925]: time=2026-09-23T05:12:44.410Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.193089] niks3-server[1002]: 2026/09/23 05:12:43 INFO Signed narinfos id=19 count=1 lb # [ 71.208104] niks3-server[1002]: 2026/09/23 05:12:43 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 71.214192] niks3-server[1002]: 2026/09/23 05:12:43 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 71.226671] niks3-server[1002]: 2026/09/23 05:12:43 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 71.231187] niks3-server[1002]: 2026/09/23 05:12:43 INFO Completed upload id=19 worker2 # [ 71.258568] nix-grpc-daemon[925]: time=2026-09-23T05:12:44.448Z level=INFO msg="Upload complete. (187ms)" lb # [ 71.233734] niks3-server[1002]: 2026/09/23 05:12:43 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 71.263556] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 71.270147] nix-grpc-daemon[783]: ts=2026-09-23T05:12:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 71.279759] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 71.294456] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # [ 71.307773] nix[1037]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker2 # [ 71.296574] nix-daemon[873]: reaped child process 1090, status = succeeded client # [ 71.934558] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 329cad54885e4732b3ae78b8d85db765 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) client # [ 72.078570] nix[1053]: don't know how to build these paths: client # [ 72.079559] nix[1053]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 72.058474] nix-grpc-daemon[783]: ts=2026-09-23T05:12:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 72.073072] nix-grpc-daemon[783]: ts=2026-09-23T05:12:45Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 client # [ 72.092534] nix[1053]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker2 # [ 72.078836] nix-grpc-daemon[783]: ts=2026-09-23T05:12:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 75.196893] systemd[1]: share1.service: Sent signal SIGINT to main process 1037 (nix) on client request. client # [ 75.203564] nix[1037]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 75.210349] nix[1037]: error: interrupted by the user client # [ 75.251450] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 75.253121] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 75.255104] systemd[1]: share1.service: Consumed 116ms CPU time over 4.383s wall clock time, 41.5M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic. lb # [ 75.697933] envoy[910]: conn peer=[2001:db8:1::1]:44742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=957 ms=6760 lb # [ 75.701856] envoy[910]: conn peer=[2001:db8:1::1]:44744 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=795 ms=4213 client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 76.516522] nix-daemon[873]: reaped child process 1099, status = succeeded worker2 # [ 76.591816] nix-daemon[873]: accepted connection from pid 1135, user nix-grpc-daemon (trusted) worker2 # [ 76.605174] nix-daemon[873]: reaped child process 1138, status = succeeded lb # [ 76.586427] niks3-server[1002]: 2026/09/23 05:12:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 76.622452] nix-grpc-daemon[925]: time=2026-09-23T05:12:49.812Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 76.625350] nix-grpc-daemon[925]: time=2026-09-23T05:12:49.814Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 76.630476] niks3-server[1002]: 2026/09/23 05:12:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 76.667349] nix-grpc-daemon[925]: time=2026-09-23T05:12:49.857Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.640358] niks3-server[1002]: 2026/09/23 05:12:48 INFO Signed narinfos id=20 count=1 lb # [ 76.644762] niks3-server[1002]: 2026/09/23 05:12:48 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 76.651829] niks3-server[1002]: 2026/09/23 05:12:48 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 76.656098] niks3-server[1002]: 2026/09/23 05:12:48 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 76.667190] niks3-server[1002]: 2026/09/23 05:12:48 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 76.671473] niks3-server[1002]: 2026/09/23 05:12:48 INFO Completed upload id=20 worker2 # [ 76.698811] nix-grpc-daemon[925]: time=2026-09-23T05:12:49.888Z level=INFO msg="Upload complete. (192ms)" lb # [ 76.672724] niks3-server[1002]: 2026/09/23 05:12:48 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 76.705573] nix-grpc-daemon[783]: ts=2026-09-23T05:12:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 76.712653] nix-grpc-daemon[783]: ts=2026-09-23T05:12:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 76.725069] nix-daemon[873]: reaped child process 1097, status = succeeded client # [ 76.754868] systemd[1]: share2.service: Deactivated successfully. client # [ 76.758753] systemd[1]: share2.service: Consumed 118ms CPU time over 4.823s wall clock time, 35.4M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.76 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 77.676223] systemd[1]: Started Nix Daemon. client # [ 77.761450] nix-daemon[1104]: accepted connection from pid 1101, user root (trusted) worker1 # [ 77.857573] nix-grpc-daemon[783]: ts=2026-09-23T05:12:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 77.860238] nix-grpc-daemon[783]: ts=2026-09-23T05:12:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 77.879772] nix-grpc-daemon[783]: ts=2026-09-23T05:12:51Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 77.877079] nix-grpc-daemon[783]: ts=2026-09-23T05:12:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 77.883938] nix-grpc-daemon[783]: ts=2026-09-23T05:12:51Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 77.889800] nix-grpc-daemon[783]: ts=2026-09-23T05:12:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 77.901701] nix-grpc-daemon[783]: ts=2026-09-23T05:12:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 77.913298] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 78.017209] nix-daemon[850]: accepted connection from pid 1112, user nix-grpc-daemon (trusted) worker1 # [ 78.030953] nix-daemon[850]: reaped child process 1115, status = succeeded lb # [ 78.016537] niks3-server[1002]: 2026/09/23 05:12:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.046417] nix-grpc-daemon[863]: time=2026-09-23T05:12:51.090Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 78.047851] nix-grpc-daemon[863]: time=2026-09-23T05:12:51.090Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 78.052716] niks3-server[1002]: 2026/09/23 05:12:50 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 78.061706] niks3-server[1002]: 2026/09/23 05:12:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 78.070160] niks3-server[1002]: 2026/09/23 05:12:50 INFO Signed narinfos id=21 count=1 worker1 # [ 78.095856] nix-grpc-daemon[863]: time=2026-09-23T05:12:51.139Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.076440] niks3-server[1002]: 2026/09/23 05:12:50 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 78.087994] niks3-server[1002]: 2026/09/23 05:12:50 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 78.090774] niks3-server[1002]: 2026/09/23 05:12:50 INFO Completed upload id=21 worker1 # [ 78.112976] nix-grpc-daemon[863]: time=2026-09-23T05:12:51.157Z level=INFO msg="Upload complete. (186ms)" lb # [ 78.093283] niks3-server[1002]: 2026/09/23 05:12:50 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 78.117579] nix-grpc-daemon[783]: ts=2026-09-23T05:12:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 78.123480] nix-grpc-daemon[783]: ts=2026-09-23T05:12:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 78.135129] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 78.144128] nix-daemon[850]: reaped child process 1110, status = succeeded worker1 # [ 78.147115] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 79.181672] nix-daemon[850]: reaped child process 1119, status = succeeded worker1 # [ 79.261939] nix-daemon[850]: accepted connection from pid 1135, user nix-grpc-daemon (trusted) worker1 # [ 79.276443] nix-daemon[850]: reaped child process 1138, status = succeeded lb # [ 79.258891] niks3-server[1002]: 2026/09/23 05:12:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.290174] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.334Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 79.291907] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.336Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 79.303105] niks3-server[1002]: 2026/09/23 05:12:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 79.308658] niks3-server[1002]: 2026/09/23 05:12:51 INFO Signed narinfos id=22 count=1 worker1 # [ 79.333758] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.378Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.316127] niks3-server[1002]: 2026/09/23 05:12:51 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 79.320596] niks3-server[1002]: 2026/09/23 05:12:51 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 79.329157] niks3-server[1002]: 2026/09/23 05:12:51 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 79.336993] niks3-server[1002]: 2026/09/23 05:12:51 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 79.353966] niks3-server[1002]: 2026/09/23 05:12:51 INFO Completed upload id=22 worker1 # [ 79.376149] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.420Z level=INFO msg="Upload complete. (221ms)" lb # [ 79.356800] niks3-server[1002]: 2026/09/23 05:12:51 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 79.384346] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker1 # [ 79.390731] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 79.402809] nix-daemon[850]: reaped child process 1117, status = succeeded worker1 # [ 79.413886] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 79.418853] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 79.626899] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 79.637074] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 79.659575] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 79.657307] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 79.664410] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 79.668838] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 79.684246] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.728Z level=INFO msg="All 1 paths already cached" worker1 # [ 79.692620] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 79.701457] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 79.809944] nix-daemon[850]: accepted connection from pid 1142, user nix-grpc-daemon (trusted) worker1 # [ 79.824254] nix-daemon[850]: reaped child process 1145, status = succeeded lb # [ 79.807409] niks3-server[1002]: 2026/09/23 05:12:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.837942] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.882Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 79.839427] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.883Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 79.838262] niks3-server[1002]: 2026/09/23 05:12:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker1 # [ 79.868071] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.912Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.846249] niks3-server[1002]: 2026/09/23 05:12:52 INFO Signed narinfos id=23 count=1 lb # [ 79.855570] niks3-server[1002]: 2026/09/23 05:12:52 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 79.861385] niks3-server[1002]: 2026/09/23 05:12:52 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 79.874351] niks3-server[1002]: 2026/09/23 05:12:52 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 79.880772] niks3-server[1002]: 2026/09/23 05:12:52 INFO Completed upload id=23 worker1 # [ 79.902858] nix-grpc-daemon[863]: time=2026-09-23T05:12:52.947Z level=INFO msg="Upload complete. (185ms)" lb # [ 79.884104] niks3-server[1002]: 2026/09/23 05:12:52 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 79.907668] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 79.913322] nix-grpc-daemon[783]: ts=2026-09-23T05:12:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 79.925108] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 79.934974] nix-daemon[850]: reaped child process 1140, status = succeeded worker1 # [ 79.937878] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 80.774555] nix-daemon[850]: reaped child process 1149, status = succeeded worker1 # [ 80.859098] nix-daemon[850]: accepted connection from pid 1165, user nix-grpc-daemon (trusted) worker1 # [ 80.872174] nix-daemon[850]: reaped child process 1168, status = succeeded lb # [ 80.856939] niks3-server[1002]: 2026/09/23 05:12:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 80.888685] nix-grpc-daemon[863]: time=2026-09-23T05:12:53.932Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 80.892064] nix-grpc-daemon[863]: time=2026-09-23T05:12:53.934Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 80.905215] niks3-server[1002]: 2026/09/23 05:12:53 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 80.910134] niks3-server[1002]: 2026/09/23 05:12:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 80.916130] niks3-server[1002]: 2026/09/23 05:12:53 INFO Signed narinfos id=24 count=1 worker1 # [ 80.942067] nix-grpc-daemon[863]: time=2026-09-23T05:12:53.986Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.922342] niks3-server[1002]: 2026/09/23 05:12:53 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 80.934824] niks3-server[1002]: 2026/09/23 05:12:53 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 80.938658] niks3-server[1002]: 2026/09/23 05:12:53 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 80.941447] niks3-server[1002]: 2026/09/23 05:12:53 INFO Completed upload id=24 worker1 # [ 80.963920] nix-grpc-daemon[863]: time=2026-09-23T05:12:54.008Z level=INFO msg="Upload complete. (218ms)" lb # [ 80.943963] niks3-server[1002]: 2026/09/23 05:12:53 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 80.970071] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker2 # [ 80.980491] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53482 worker1 # [ 80.984427] nix-daemon[850]: reaped child process 1147, status = succeeded worker2 # [ 80.990393] nix-grpc-daemon[783]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 81.001695] nix-grpc-daemon[783]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 81.026648] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 81.031511] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 81.239696] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 81.246402] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 81.252097] nix-grpc-daemon[925]: time=2026-09-23T05:12:54.440Z level=INFO msg="All 2 paths already cached" worker2 # [ 81.261571] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 81.259425] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 81.266214] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 81.271396] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 81.283762] nix-grpc-daemon[863]: time=2026-09-23T05:12:54.328Z level=INFO msg="All 2 paths already cached" worker1 # [ 81.291140] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 81.300166] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 81.406861] nix-daemon[850]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker1 # [ 81.421334] nix-daemon[850]: reaped child process 1175, status = succeeded lb # [ 81.406737] niks3-server[1002]: 2026/09/23 05:12:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 81.436746] nix-grpc-daemon[863]: time=2026-09-23T05:12:54.481Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 81.438738] nix-grpc-daemon[863]: time=2026-09-23T05:12:54.482Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 81.437652] niks3-server[1002]: 2026/09/23 05:12:53 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 81.445827] niks3-server[1002]: 2026/09/23 05:12:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 81.451588] niks3-server[1002]: 2026/09/23 05:12:53 INFO Signed narinfos id=25 count=1 worker1 # [ 81.476883] nix-grpc-daemon[863]: time=2026-09-23T05:12:54.521Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.457673] niks3-server[1002]: 2026/09/23 05:12:53 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 81.472069] niks3-server[1002]: 2026/09/23 05:12:53 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 81.479967] niks3-server[1002]: 2026/09/23 05:12:53 INFO Completed upload id=25 worker1 # [ 81.501502] nix-grpc-daemon[863]: time=2026-09-23T05:12:54.545Z level=INFO msg="Upload complete. (188ms)" lb # [ 81.483642] niks3-server[1002]: 2026/09/23 05:12:53 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 81.505861] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 81.510725] nix-grpc-daemon[783]: ts=2026-09-23T05:12:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 81.520202] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 81.528163] nix-daemon[850]: reaped child process 1170, status = succeeded worker1 # [ 81.533150] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 82.376814] nix-daemon[850]: reaped child process 1179, status = succeeded worker1 # [ 82.446882] nix-daemon[850]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker1 # [ 82.460519] nix-daemon[850]: reaped child process 1198, status = succeeded lb # [ 82.445517] niks3-server[1002]: 2026/09/23 05:12:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.475605] nix-grpc-daemon[863]: time=2026-09-23T05:12:55.519Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 82.477190] nix-grpc-daemon[863]: time=2026-09-23T05:12:55.521Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 82.479690] niks3-server[1002]: 2026/09/23 05:12:54 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 82.493172] niks3-server[1002]: 2026/09/23 05:12:54 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 82.500914] niks3-server[1002]: 2026/09/23 05:12:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 82.508128] niks3-server[1002]: 2026/09/23 05:12:54 INFO Signed narinfos id=26 count=1 worker1 # [ 82.530770] nix-grpc-daemon[863]: time=2026-09-23T05:12:55.574Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.516264] niks3-server[1002]: 2026/09/23 05:12:54 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 82.523836] niks3-server[1002]: 2026/09/23 05:12:54 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 82.527855] niks3-server[1002]: 2026/09/23 05:12:54 INFO Completed upload id=26 lb # [ 82.529697] niks3-server[1002]: 2026/09/23 05:12:54 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 82.550251] nix-grpc-daemon[863]: time=2026-09-23T05:12:55.594Z level=INFO msg="Upload complete. (210ms)" worker1 # [ 82.556751] nix-grpc-daemon[783]: ts=2026-09-23T05:12:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker1 # [ 82.564388] nix-grpc-daemon[783]: ts=2026-09-23T05:12:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 82.575725] nix-daemon[850]: reaped child process 1177, status = succeeded worker2 # [ 82.582176] nix-grpc-daemon[783]: ts=2026-09-23T05:12:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 82.591465] nix-grpc-daemon[783]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 82.603293] nix-grpc-daemon[783]: ts=2026-09-23T05:12:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_out=232 client # [ 82.667119] nix-daemon[1104]: reaped child process 1106, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.09 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.01 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.14 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 83.314912] nix-daemon[1104]: accepted connection from pid 1187, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 83.418156] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53482 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 83.427428] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 client # copying 1 paths... client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 83.439655] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 83.450911] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 83.560901] nix-daemon[873]: accepted connection from pid 1154, user nix-grpc-daemon (trusted) worker2 # [ 83.575525] nix-daemon[873]: reaped child process 1157, status = succeeded lb # [ 83.557452] niks3-server[1002]: 2026/09/23 05:12:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 83.594042] nix-grpc-daemon[925]: time=2026-09-23T05:12:56.783Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 83.596098] nix-grpc-daemon[925]: time=2026-09-23T05:12:56.785Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 83.593510] niks3-server[1002]: 2026/09/23 05:12:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker2 # [ 83.627630] nix-grpc-daemon[925]: time=2026-09-23T05:12:56.817Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.600521] niks3-server[1002]: 2026/09/23 05:12:55 INFO Signed narinfos id=27 count=1 lb # [ 83.607979] niks3-server[1002]: 2026/09/23 05:12:55 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 83.615598] niks3-server[1002]: 2026/09/23 05:12:55 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 83.630069] niks3-server[1002]: 2026/09/23 05:12:55 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 83.635574] niks3-server[1002]: 2026/09/23 05:12:55 INFO Completed upload id=27 worker2 # [ 83.662738] nix-grpc-daemon[925]: time=2026-09-23T05:12:56.852Z level=INFO msg="Upload complete. (201ms)" lb # [ 83.642723] niks3-server[1002]: 2026/09/23 05:12:55 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 83.666965] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 83.681678] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 83.685314] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 83.692482] nix-daemon[873]: reaped child process 1152, status = succeeded worker2 # [ 83.725533] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 83.738586] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 83.754317] nix-grpc-daemon[783]: ts=2026-09-23T05:12:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 83.762566] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 83.864318] nix-daemon[873]: accepted connection from pid 1163, user nix-grpc-daemon (trusted) worker2 # [ 83.878351] nix-daemon[873]: reaped child process 1166, status = succeeded lb # [ 83.858893] niks3-server[1002]: 2026/09/23 05:12:56 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 83.957054] niks3-server[1002]: 2026/09/23 05:12:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 84.023063] nix-grpc-daemon[925]: time=2026-09-23T05:12:57.212Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 84.029361] nix-grpc-daemon[925]: time=2026-09-23T05:12:57.216Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker2 # [ 84.033343] nix-grpc-daemon[925]: time=2026-09-23T05:12:57.217Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 84.036821] niks3-server[1002]: 2026/09/23 05:12:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 84.039568] niks3-server[1002]: 2026/09/23 05:12:56 INFO Signed narinfos id=29 count=2 lb # [ 84.044156] niks3-server[1002]: 2026/09/23 05:12:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 84.047537] niks3-server[1002]: 2026/09/23 05:12:56 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 84.050035] niks3-server[1002]: 2026/09/23 05:12:56 INFO Signed narinfos id=28 count=1 lb # [ 84.053596] niks3-server[1002]: 2026/09/23 05:12:56 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst worker2 # [ 84.080136] nix-grpc-daemon[925]: time=2026-09-23T05:12:57.269Z level=INFO msg="Uploading 3 narinfos" lb # [ 84.055631] niks3-server[1002]: 2026/09/23 05:12:56 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 84.058629] niks3-server[1002]: 2026/09/23 05:12:56 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 84.070173] niks3-server[1002]: 2026/09/23 05:12:56 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 84.074133] niks3-server[1002]: 2026/09/23 05:12:56 INFO Completed upload id=28 lb # [ 84.076050] niks3-server[1002]: 2026/09/23 05:12:56 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 84.079362] niks3-server[1002]: 2026/09/23 05:12:56 INFO Completed upload id=29 worker2 # [ 84.106507] nix-grpc-daemon[925]: time=2026-09-23T05:12:57.296Z level=INFO msg="Upload complete. (329ms)" lb # [ 84.081391] niks3-server[1002]: 2026/09/23 05:12:56 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 84.084219] niks3-server[1002]: 2026/09/23 05:12:56 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 84.085826] niks3-server[1002]: 2026/09/23 05:12:56 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo worker2 # [ 84.112302] nix-grpc-daemon[783]: ts=2026-09-23T05:12:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 84.118770] nix-grpc-daemon[783]: ts=2026-09-23T05:12:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 84.132206] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 84.142281] nix-daemon[873]: reaped child process 1161, status = succeeded client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 84.150400] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 85.572064] nix-daemon[873]: reaped child process 1170, status = succeeded worker2 # [ 85.649323] nix-daemon[873]: accepted connection from pid 1186, user nix-grpc-daemon (trusted) worker2 # [ 85.663776] nix-daemon[873]: reaped child process 1189, status = succeeded lb # [ 85.643241] niks3-server[1002]: 2026/09/23 05:12:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.680583] nix-grpc-daemon[925]: time=2026-09-23T05:12:58.870Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 85.679624] niks3-server[1002]: 2026/09/23 05:12:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 85.688544] niks3-server[1002]: 2026/09/23 05:12:57 INFO Signed narinfos id=30 count=1 worker2 # [ 85.718667] nix-grpc-daemon[925]: time=2026-09-23T05:12:58.908Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.696080] niks3-server[1002]: 2026/09/23 05:12:57 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 85.700737] envoy[910]: conn peer=[2001:db8:1::1]:44756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=4659 lb # [ 85.706535] envoy[910]: conn peer=[2001:db8:1::1]:52986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3408 tx=1922 ms=1613 lb # [ 85.709529] envoy[910]: conn peer=[2001:db8:1::1]:52998 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=63 lb # [ 85.712817] envoy[910]: conn peer=[2001:db8:1::1]:53006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3876 tx=2164 ms=1452 lb # [ 85.716537] envoy[910]: conn peer=[2001:db8:1::1]:53012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=58 lb # [ 85.719268] envoy[910]: conn peer=[2001:db8:1::1]:53016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4323 tx=2367 ms=1373 lb # [ 85.722091] envoy[910]: conn peer=[2001:db8:1::1]:53030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=28 lb # [ 85.724872] niks3-server[1002]: 2026/09/23 05:12:57 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 85.730067] niks3-server[1002]: 2026/09/23 05:12:57 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 85.733606] niks3-server[1002]: 2026/09/23 05:12:57 INFO Completed upload id=30 worker2 # [ 85.761197] nix-grpc-daemon[925]: time=2026-09-23T05:12:58.951Z level=INFO msg="Upload complete. (198ms)" lb # [ 85.738237] niks3-server[1002]: 2026/09/23 05:12:57 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo client # copying 1 paths... worker2 # [ 85.769889] nix-grpc-daemon[783]: ts=2026-09-23T05:12:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 worker2 # [ 85.776595] nix-grpc-daemon[783]: ts=2026-09-23T05:12:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53482 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 85.788544] nix-daemon[873]: reaped child process 1168, status = succeeded worker1 # [ 85.791823] nix-grpc-daemon[783]: ts=2026-09-23T05:12:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 85.802578] nix-grpc-daemon[783]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... worker1 # [ 85.815622] nix-grpc-daemon[783]: ts=2026-09-23T05:12:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_out=120 client # [ 85.944502] nix-daemon[1104]: reaped child process 1190, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.75 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 86.043135] nix-daemon[1104]: accepted connection from pid 1209, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 86.144858] nix-grpc-daemon[783]: ts=2026-09-23T05:12:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53482 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 86.150624] nix-grpc-daemon[783]: ts=2026-09-23T05:12:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 86.155961] nix-grpc-daemon[925]: time=2026-09-23T05:12:59.344Z level=INFO msg="All 1 paths already cached" worker2 # [ 86.165567] nix-grpc-daemon[783]: ts=2026-09-23T05:12:59Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 86.163516] nix-grpc-daemon[783]: ts=2026-09-23T05:12:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker2 # [ 86.170293] nix-grpc-daemon[783]: ts=2026-09-23T05:12:59Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 86.175253] nix-grpc-daemon[783]: ts=2026-09-23T05:12:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52822 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 86.191441] nix-grpc-daemon[783]: ts=2026-09-23T05:12:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 86.202323] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 86.218126] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5) worker1 # [ 86.240767] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 2/5) worker1 # [ 86.442194] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 375 ms (attempt 3/5) worker1 # [ 86.819970] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 4/5) worker1 # [ 86.827661] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 86.830731] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 86.836777] nix-grpc-daemon[783]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 86.947477] nix-daemon[850]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 86.962843] nix-daemon[850]: reaped child process 1216, status = succeeded lb # [ 86.946268] niks3-server[1002]: 2026/09/23 05:12:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 86.977242] nix-grpc-daemon[863]: time=2026-09-23T05:13:00.021Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 86.978738] nix-grpc-daemon[863]: time=2026-09-23T05:13:00.023Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 86.978150] niks3-server[1002]: 2026/09/23 05:12:59 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 86.985368] niks3-server[1002]: 2026/09/23 05:12:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 86.990380] niks3-server[1002]: 2026/09/23 05:12:59 INFO Signed narinfos id=31 count=1 worker1 # [ 87.016327] nix-grpc-daemon[863]: time=2026-09-23T05:13:00.060Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.003098] niks3-server[1002]: 2026/09/23 05:12:59 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 87.012109] niks3-server[1002]: 2026/09/23 05:12:59 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 87.019756] niks3-server[1002]: 2026/09/23 05:12:59 INFO Completed upload id=31 worker1 # [ 87.044373] nix-grpc-daemon[863]: time=2026-09-23T05:13:00.088Z level=INFO msg="Upload complete. (188ms)" lb # [ 87.023248] niks3-server[1002]: 2026/09/23 05:12:59 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 87.049166] nix-grpc-daemon[783]: ts=2026-09-23T05:13:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 paths=1 nar_bytes_in=560 worker1 # [ 87.056394] nix-grpc-daemon[783]: ts=2026-09-23T05:13:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 worker1 # [ 87.067225] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 87.078656] nix-daemon[850]: reaped child process 1206, status = succeeded worker1 # [ 87.082906] nix-daemon[850]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 87.498518] nix-daemon[850]: reaped child process 1220, status = succeeded worker1 # [ 87.573578] nix-daemon[850]: accepted connection from pid 1236, user nix-grpc-daemon (trusted) worker1 # [ 87.586400] nix-daemon[850]: reaped child process 1239, status = succeeded lb # [ 87.571758] niks3-server[1002]: 2026/09/23 05:12:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 87.601730] nix-grpc-daemon[863]: time=2026-09-23T05:13:00.646Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 87.602583] niks3-server[1002]: 2026/09/23 05:12:59 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 87.612128] niks3-server[1002]: 2026/09/23 05:12:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 87.617446] niks3-server[1002]: 2026/09/23 05:12:59 INFO Signed narinfos id=32 count=1 worker1 # [ 87.642602] nix-grpc-daemon[863]: time=2026-09-23T05:13:00.687Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.624253] niks3-server[1002]: 2026/09/23 05:12:59 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 87.635562] niks3-server[1002]: 2026/09/23 05:12:59 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 87.644123] niks3-server[1002]: 2026/09/23 05:12:59 INFO Completed upload id=32 worker1 # [ 87.666133] nix-grpc-daemon[863]: time=2026-09-23T05:13:00.710Z level=INFO msg="Upload complete. (177ms)" lb # [ 87.646239] niks3-server[1002]: 2026/09/23 05:12:59 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo client # copying 1 paths... worker1 # [ 87.671174] nix-grpc-daemon[783]: ts=2026-09-23T05:13:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52822 duration_s=0 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 worker2 # [ 87.683556] nix-grpc-daemon[783]: ts=2026-09-23T05:13:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53482 worker1 # [ 87.683886] nix-daemon[850]: reaped child process 1218, status = succeeded worker2 # [ 87.693827] nix-grpc-daemon[783]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 87.720542] nix-grpc-daemon[783]: ts=2026-09-23T05:13:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 87.725759] nix-grpc-daemon[783]: ts=2026-09-23T05:13:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_out=120 client # [ 87.849382] nix-daemon[1104]: reaped child process 1212, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 1.91 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 87.950795] nix-daemon[1104]: accepted connection from pid 1231, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 88.049204] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53482 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 88.055342] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 88.061189] nix-grpc-daemon[925]: time=2026-09-23T05:13:01.249Z level=INFO msg="All 1 paths already cached" worker2 # [ 88.070153] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 88.075702] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 88.081522] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 88.092947] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 88.105303] nix-grpc-daemon[925]: time=2026-09-23T05:13:01.295Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 88.112605] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 88.123344] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 88.217450] nix-daemon[873]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker2 # [ 88.230279] nix-daemon[873]: reaped child process 1201, status = succeeded lb # [ 88.211557] niks3-server[1002]: 2026/09/23 05:13:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.247405] nix-grpc-daemon[925]: time=2026-09-23T05:13:01.437Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 88.248924] nix-grpc-daemon[925]: time=2026-09-23T05:13:01.439Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 88.243523] niks3-server[1002]: 2026/09/23 05:13:00 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 88.252543] niks3-server[1002]: 2026/09/23 05:13:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 88.258375] niks3-server[1002]: 2026/09/23 05:13:00 INFO Signed narinfos id=33 count=1 worker2 # [ 88.288878] nix-grpc-daemon[925]: time=2026-09-23T05:13:01.478Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.269473] niks3-server[1002]: 2026/09/23 05:13:00 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 88.277776] niks3-server[1002]: 2026/09/23 05:13:00 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 88.283199] niks3-server[1002]: 2026/09/23 05:13:00 INFO Completed upload id=33 worker2 # [ 88.310230] nix-grpc-daemon[925]: time=2026-09-23T05:13:01.500Z level=INFO msg="Upload complete. (177ms)" worker2 # [ 88.314187] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 88.289447] niks3-server[1002]: 2026/09/23 05:13:00 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 88.320415] nix-grpc-daemon[783]: ts=2026-09-23T05:13:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 88.332115] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 88.338266] nix-daemon[873]: reaped child process 1196, status = succeeded worker2 # [ 88.343155] nix-daemon[873]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 89.780679] nix-daemon[873]: reaped child process 1205, status = succeeded worker2 # [ 89.866462] nix-daemon[873]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 89.879680] nix-daemon[873]: reaped child process 1224, status = succeeded lb # [ 89.859629] niks3-server[1002]: 2026/09/23 05:13:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.896032] nix-grpc-daemon[925]: time=2026-09-23T05:13:03.085Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 89.892142] niks3-server[1002]: 2026/09/23 05:13:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 89.898500] niks3-server[1002]: 2026/09/23 05:13:02 INFO Signed narinfos id=34 count=1 worker2 # [ 89.928635] nix-grpc-daemon[925]: time=2026-09-23T05:13:03.118Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.908257] niks3-server[1002]: 2026/09/23 05:13:02 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 89.913745] niks3-server[1002]: 2026/09/23 05:13:02 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 89.924128] niks3-server[1002]: 2026/09/23 05:13:02 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 89.929397] niks3-server[1002]: 2026/09/23 05:13:02 INFO Completed upload id=34 worker2 # [ 89.956735] nix-grpc-daemon[925]: time=2026-09-23T05:13:03.146Z level=INFO msg="Upload complete. (205ms)" lb # [ 89.934281] niks3-server[1002]: 2026/09/23 05:13:02 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 89.962541] nix-grpc-daemon[783]: ts=2026-09-23T05:13:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker2 # [ 89.976782] nix-daemon[873]: reaped child process 1203, status = succeeded client # copying 1 paths... worker2 # [ 90.010572] nix-grpc-daemon[783]: ts=2026-09-23T05:13:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53482 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 90.032343] nix-grpc-daemon[783]: ts=2026-09-23T05:13:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 worker2 # [ 90.037143] nix-grpc-daemon[783]: ts=2026-09-23T05:13:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53482 duration_s=0 paths=1 nar_bytes_out=120 client # [ 90.157304] nix-daemon[1104]: reaped child process 1234, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.31 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.44 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds) worker2 # [ 90.889886] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 91.668971] nix-grpc-daemon[783]: ts=2026-09-23T05:13:04Z level=info event=signal_exit lb # [ 91.764785] niks3-server[1002]: 2026/09/23 05:13:04 INFO lead: released remote=192.168.1.4:36706 lb # [ 92.759640] niks3-server[1002]: 2026/09/23 05:13:05 INFO lead: acquired remote=192.168.1.3:36462 worker1 # [ 92.783111] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=scheduler_take_over worker1 # [ 92.790639] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 92.795401] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=scheduler_restarting worker2 # [ 92.801860] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 92.805414] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53478 worker2 # [ 92.809847] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 92.813126] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53478 worker2 # [ 92.816708] nix-grpc-daemon[783]: ts=2026-09-23T05:13:05Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 92.819997] nix-grpc-daemon[783]: E0000 00:00:1790140385.999482 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 92.824765] nix-grpc-daemon[783]: E0000 00:00:1790140385.999762 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker2 # [ 92.845172] nix-daemon[873]: reaped child process 875, status = succeeded worker1 # [ 92.991718] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.995668] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.008838] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 93.196506] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.207628] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:55726 worker1 # [ 93.211663] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 93.246574] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 93.250148] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 93.254064] systemd[1]: nix-grpc-daemon.service: Consumed 2.017s CPU time over 1min 16.732s wall clock time, 64M memory peak, 98K incoming IP traffic, 264.6K outgoing IP traffic. worker2 # [ 93.266405] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 93.270473] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 93.274485] systemd[1]: nix-grpc-daemon.socket: Consumed 310us CPU time over 1min 24.672s wall clock time, 256K memory peak, 109.7K incoming IP traffic, 92.3K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 93.462163] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52822 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 93.467529] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52822 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 93.551853] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 93.591608] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 93.925367] nix-grpc-daemon[783]: ts=2026-09-23T05:13:06Z level=info event=signal_exit worker2 # [ 94.241557] systemd[1]: Starting scheduler-token.service... worker2 # [ 94.303795] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 94.307811] systemd[1]: Finished scheduler-token.service. worker2 # [ 94.311421] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 64ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 94.317532] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 94.399375] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 94.401497] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 94.404770] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 94.409056] nix-grpc-daemon[1248]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 94.410516] nix-grpc-daemon[1248]: E0000 00:00:1790140387.599046 1248 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 94.416064] nix-grpc-daemon[1248]: E0000 00:00:1790140387.604661 1248 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 94.418279] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 94.423252] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 94.428951] nix-grpc-daemon[1248]: E0000 00:00:1790140387.618329 1290 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 94.442440] nix-grpc-daemon[1248]: E0000 00:00:1790140387.632448 1290 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 94.447054] nix-grpc-daemon[1248]: E0000 00:00:1790140387.634681 1290 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 94.456515] nix-grpc-daemon[1248]: E0000 00:00:1790140387.646528 1290 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 94.465896] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.467504] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.668718] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.672857] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 94.765557] niks3-server[1002]: 2026/09/23 05:13:07 INFO lead: released remote=192.168.1.3:36462 worker2 # [ 94.873942] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.877902] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.079241] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.083201] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.284597] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.288529] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.490572] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.494654] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.695696] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.699602] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 95.700244] envoy[910]: conn peer=[2001:db8:1::1]:42716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4207 tx=2054 ms=2455 lb # [ 95.703919] envoy[910]: conn peer=[2001:db8:1::1]:42732 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=77 lb # [ 95.707343] envoy[910]: conn peer=[2001:db8:1::1]:42738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=2084 ms=1633 lb # [ 95.710891] envoy[910]: conn peer=[2001:db8:1::1]:42754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=58 lb # [ 95.714497] envoy[910]: conn peer=[2001:db8:1::1]:42774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=57 lb # [ 95.718591] envoy[910]: conn peer=[2001:db8:1::1]:42768 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3740 tx=2083 ms=2041 lb # [ 95.722137] envoy[910]: conn peer=[2001:db8:1::4]:58208 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=71993 tx=3771 ms=76303 lb # [ 95.725738] envoy[910]: conn peer=[2001:db8:1::1]:54230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=15 worker1 # [ 95.792902] nix-grpc-daemon[783]: ts=2026-09-23T05:13:08Z level=info event=scheduler_restarting worker1 # [ 95.796746] nix-grpc-daemon[783]: ts=2026-09-23T05:13:08Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 95.800469] nix-grpc-daemon[783]: ts=2026-09-23T05:13:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55726 worker1 # [ 95.804243] nix-grpc-daemon[783]: ts=2026-09-23T05:13:08Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 95.828331] nix-daemon[850]: reaped child process 852, status = succeeded worker2 # [ 95.900731] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.904711] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.005651] nix-grpc-daemon[783]: ts=2026-09-23T05:13:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 96.074522] nix-grpc-daemon[783]: E0000 00:00:1790140389.118594 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 96.079645] nix-grpc-daemon[783]: E0000 00:00:1790140389.119184 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 96.105700] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.109593] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.310624] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.314572] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.516383] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.520100] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.718383] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.722481] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.923794] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.928097] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.129247] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.133208] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.215926] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 97.219870] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 97.223838] systemd[1]: nix-grpc-daemon.service: Consumed 2.431s CPU time over 1min 21.500s wall clock time, 65.9M memory peak, 105.6K incoming IP traffic, 197.3K outgoing IP traffic. worker1 # [ 97.236146] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 97.240598] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 97.243822] systemd[1]: nix-grpc-daemon.socket: Consumed 308us CPU time over 1min 29.551s wall clock time, 256K memory peak, 104.2K incoming IP traffic, 89.8K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 97.334288] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.338177] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.453261] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 97.465228] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 97.481469] nix-grpc-daemon[1248]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5) worker2 # [ 97.534820] nix-grpc-daemon[1248]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5) worker2 # [ 97.541371] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.545109] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.598441] nix-grpc-daemon[1248]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 3/5) worker2 # [ 97.631191] nix-grpc-daemon[1248]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 359 ms (attempt 4/5) worker2 # [ 97.746424] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.750312] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.951379] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.955353] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.998268] nix-grpc-daemon[1248]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 98.001875] nix-grpc-daemon[1248]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 98.023630] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 98.033757] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 98.054583] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=niks3_push_started pid=1309 worker2 # [ 98.155886] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.157855] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.163887] nix-grpc-daemon[1309]: time=2026-09-23T05:13:11.353Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 98.252462] nix-daemon[873]: accepted connection from pid 1322, user nix-grpc-daemon (trusted) worker2 # [ 98.264096] nix-daemon[873]: reaped child process 1325, status = succeeded lb # [ 98.249508] niks3-server[1002]: 2026/09/23 05:13:10 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 98.258788] niks3-server[1002]: 2026/09/23 05:13:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.293418] nix-grpc-daemon[1309]: time=2026-09-23T05:13:11.483Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 98.294972] nix-grpc-daemon[1309]: time=2026-09-23T05:13:11.485Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 98.296986] nix-grpc-daemon[1309]: time=2026-09-23T05:13:11.487Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 98.315909] niks3-server[1002]: 2026/09/23 05:13:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 98.320676] niks3-server[1002]: 2026/09/23 05:13:10 INFO Signed narinfos id=35 count=1 lb # [ 98.322246] niks3-server[1002]: 2026/09/23 05:13:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 98.323836] niks3-server[1002]: 2026/09/23 05:13:10 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 98.330642] niks3-server[1002]: 2026/09/23 05:13:10 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls worker2 # [ 98.358645] nix-grpc-daemon[1309]: time=2026-09-23T05:13:11.547Z level=INFO msg="Uploading 3 narinfos" lb # [ 98.332194] niks3-server[1002]: 2026/09/23 05:13:10 INFO Signed narinfos id=36 count=2 worker2 # [ 98.360546] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.362129] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 98.347378] niks3-server[1002]: 2026/09/23 05:13:10 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 98.350772] niks3-server[1002]: 2026/09/23 05:13:10 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 98.362073] niks3-server[1002]: 2026/09/23 05:13:10 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 98.370205] niks3-server[1002]: 2026/09/23 05:13:10 INFO Completed upload id=35 lb # [ 98.371681] niks3-server[1002]: 2026/09/23 05:13:10 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 98.374082] niks3-server[1002]: 2026/09/23 05:13:10 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 98.376579] niks3-server[1002]: 2026/09/23 05:13:10 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 98.378561] niks3-server[1002]: 2026/09/23 05:13:10 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 98.382124] niks3-server[1002]: 2026/09/23 05:13:10 INFO Completed upload id=36 worker2 # [ 98.409611] nix-grpc-daemon[1309]: time=2026-09-23T05:13:11.599Z level=INFO msg="Upload complete. (242ms)" worker2 # [ 98.414959] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 98.429403] nix-daemon[873]: reaped child process 1307, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.13 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 98.510821] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 98.519674] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 98.564092] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.567789] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.604708] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 98.606792] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 98.610511] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 98.615060] nix-grpc-daemon[1262]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 98.616395] nix-grpc-daemon[1262]: E0000 00:00:1790140391.658646 1262 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 98.621730] nix-grpc-daemon[1262]: E0000 00:00:1790140391.663864 1262 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 98.625884] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 98.628400] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 98.630736] nix-grpc-daemon[1262]: E0000 00:00:1790140391.675218 1305 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 98.610340] niks3-server[1002]: 2026/09/23 05:13:10 INFO lead: acquired remote=192.168.1.3:47350 worker1 # [ 98.636089] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=scheduler_take_over lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 98.647230] nix-grpc-daemon[1262]: E0000 00:00:1790140391.690469 1305 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 98.650107] nix-grpc-daemon[1262]: E0000 00:00:1790140391.690628 1305 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 98.660336] nix-grpc-daemon[1262]: E0000 00:00:1790140391.704757 1305 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 98.674133] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.675790] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 98.769054] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.773139] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.876827] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.880815] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.974467] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.978443] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.081605] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.085859] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 99.179723] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 99.183730] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.286780] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.294149] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:55772 worker1 # [ 99.297758] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 99.384969] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.388180] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 99.391875] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:55772 worker1 # [ 99.395815] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.59 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 99.790465] niks3-server[1002]: 2026/09/23 05:13:12 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 99.793511] systemd[1]: Stopping niks3 server... lb # [ 99.797056] niks3-server[1002]: 2026/09/23 05:13:12 INFO lead: released remote=192.168.1.3:47350 worker1 # [ 99.819984] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:12Z level=info event=scheduler_lock_lost status=200 worker2 # [ 99.825429] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:13Z level=info event=scheduler_lock_lost status=200 lb # [ 99.810858] systemd[1]: niks3.service: Deactivated successfully. lb # [ 99.813190] systemd[1]: Stopped niks3 server. lb # [ 99.813879] systemd[1]: niks3.service: Consumed 770ms CPU time over 1min 17.263s wall clock time, 28.7M memory peak, 93.8K incoming IP traffic, 136.6K outgoing IP traffic. lb # [ 99.820691] systemd[1]: Starting niks3 server... lb # [ 99.871265] niks3-server[1146]: 2026/09/23 05:13:12 goose: no migrations to run. current version: 20260920000000 lb # [ 99.875810] niks3-server[1146]: 2026/09/23 05:13:12 OK 1_commit_pending_closure.sql (5.75ms) lb # [ 99.879348] niks3-server[1146]: 2026/09/23 05:13:12 OK 2_object_stats_trigger.sql (3.15ms) lb # [ 99.880442] niks3-server[1146]: 2026/09/23 05:13:12 goose: up to current file version: 2 lb # [ 99.882042] niks3-server[1146]: 2026/09/23 05:13:12 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 99.893266] niks3-server[1146]: 2026/09/23 05:13:12 INFO Read proxy enabled — serving cache objects from S3 lb # [ 99.894741] niks3-server[1146]: 2026/09/23 05:13:12 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 99.896330] niks3-server[1146]: 2026/09/23 05:13:12 INFO systemd watchdog enabled interval=15s lb # [ 99.898059] systemd[1]: Started niks3 server. lb # [ 99.899510] niks3-server[1146]: 2026/09/23 05:13:12 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 100.247625] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 100.259469] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 100.281146] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45200 worker1 # [ 100.301622] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:13Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 100.306548] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:13Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 100.351340] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 100.363451] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker1 # [ 100.393747] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 2/5) worker1 # [ 100.524083] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 3/5) worker1 # [ 100.561799] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 110 ms (attempt 4/5) worker1 # [ 100.674610] nix-grpc-daemon[1262]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 100.678358] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 100.695454] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55778 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker1 # [ 100.709272] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 100.717686] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 100.741444] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:13Z level=info event=niks3_push_started pid=1333 lb # [ 100.804586] niks3-server[1146]: 2026/09/23 05:13:13 INFO lead: acquired remote=192.168.1.3:47370 worker1 # [ 100.844724] nix-grpc-daemon[1333]: time=2026-09-23T05:13:13.888Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 100.942096] nix-daemon[850]: accepted connection from pid 1348, user nix-grpc-daemon (trusted) worker1 # [ 100.953892] nix-daemon[850]: reaped child process 1351, status = succeeded lb # [ 100.940446] niks3-server[1146]: 2026/09/23 05:13:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 100.974559] nix-grpc-daemon[1333]: time=2026-09-23T05:13:14.019Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 100.976193] nix-grpc-daemon[1333]: time=2026-09-23T05:13:14.020Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 100.990820] niks3-server[1146]: 2026/09/23 05:13:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 100.997884] niks3-server[1146]: 2026/09/23 05:13:13 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 101.015039] niks3-server[1146]: 2026/09/23 05:13:13 INFO Signed narinfos id=37 count=1 worker1 # [ 101.038914] nix-grpc-daemon[1333]: time=2026-09-23T05:13:14.083Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.020884] niks3-server[1146]: 2026/09/23 05:13:13 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 101.026484] niks3-server[1146]: 2026/09/23 05:13:13 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 101.034407] niks3-server[1146]: 2026/09/23 05:13:13 INFO Completed upload id=37 worker1 # [ 101.056884] nix-grpc-daemon[1333]: time=2026-09-23T05:13:14.101Z level=INFO msg="Upload complete. (208ms)" lb # [ 101.037643] niks3-server[1146]: 2026/09/23 05:13:13 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker1 # [ 101.062644] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55778 duration_s=0 paths=1 nar_bytes_in=536 worker1 # [ 101.070258] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 101.078724] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 101.087864] nix-daemon[850]: reaped child process 1331, status = succeeded worker1 # [ 101.092040] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 101.915610] nix-daemon[850]: reaped child process 1355, status = succeeded worker1 # [ 101.993362] nix-daemon[850]: accepted connection from pid 1371, user nix-grpc-daemon (trusted) worker1 # [ 102.006728] nix-daemon[850]: reaped child process 1374, status = succeeded lb # [ 101.992975] niks3-server[1146]: 2026/09/23 05:13:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 102.027352] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.071Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 102.029055] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.073Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 102.041906] niks3-server[1146]: 2026/09/23 05:13:14 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 102.049267] niks3-server[1146]: 2026/09/23 05:13:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 102.081456] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.125Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.060313] niks3-server[1146]: 2026/09/23 05:13:14 INFO Signed narinfos id=38 count=1 lb # [ 102.064228] niks3-server[1146]: 2026/09/23 05:13:14 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 102.070146] niks3-server[1146]: 2026/09/23 05:13:14 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 102.078171] niks3-server[1146]: 2026/09/23 05:13:14 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 102.083692] niks3-server[1146]: 2026/09/23 05:13:14 INFO Completed upload id=38 lb # [ 102.086248] niks3-server[1146]: 2026/09/23 05:13:14 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker1 # [ 102.106173] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.150Z level=INFO msg="Upload complete. (207ms)" worker1 # [ 102.115698] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker1 # [ 102.128464] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 102.132457] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 102.142546] nix-daemon[850]: reaped child process 1353, status = succeeded worker1 # [ 102.171808] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 102.184467] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 102.198207] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.242Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker1 # [ 102.206888] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 102.215385] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 102.312813] nix-daemon[850]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker1 # [ 102.325952] nix-daemon[850]: reaped child process 1383, status = succeeded lb # [ 102.310614] niks3-server[1146]: 2026/09/23 05:13:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 102.343043] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.387Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 102.344950] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.389Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 102.344078] niks3-server[1146]: 2026/09/23 05:13:14 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 102.351103] niks3-server[1146]: 2026/09/23 05:13:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 102.355889] niks3-server[1146]: 2026/09/23 05:13:14 INFO Signed narinfos id=39 count=1 worker1 # [ 102.381182] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.425Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.369521] niks3-server[1146]: 2026/09/23 05:13:14 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 102.375628] niks3-server[1146]: 2026/09/23 05:13:14 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 102.383575] niks3-server[1146]: 2026/09/23 05:13:14 INFO Completed upload id=39 worker1 # [ 102.405399] nix-grpc-daemon[1333]: time=2026-09-23T05:13:15.449Z level=INFO msg="Upload complete. (177ms)" lb # [ 102.385742] niks3-server[1146]: 2026/09/23 05:13:14 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker1 # [ 102.409644] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55778 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 102.414231] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 102.423553] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 102.433160] nix-daemon[850]: reaped child process 1378, status = succeeded worker1 # [ 102.436605] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 103.877104] nix-daemon[850]: reaped child process 1387, status = succeeded worker1 # [ 103.957766] nix-daemon[850]: accepted connection from pid 1403, user nix-grpc-daemon (trusted) worker1 # [ 103.971246] nix-daemon[850]: reaped child process 1406, status = succeeded lb # [ 103.957466] niks3-server[1146]: 2026/09/23 05:13:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.987202] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.031Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 103.989119] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.033Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 103.998555] niks3-server[1146]: 2026/09/23 05:13:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker1 # [ 104.028424] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.072Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.006584] niks3-server[1146]: 2026/09/23 05:13:16 INFO Signed narinfos id=40 count=1 lb # [ 104.014842] niks3-server[1146]: 2026/09/23 05:13:16 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 104.019912] niks3-server[1146]: 2026/09/23 05:13:16 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 104.027470] niks3-server[1146]: 2026/09/23 05:13:16 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 104.038741] niks3-server[1146]: 2026/09/23 05:13:16 INFO Completed upload id=40 worker1 # [ 104.061262] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.105Z level=INFO msg="Upload complete. (215ms)" lb # [ 104.041385] niks3-server[1146]: 2026/09/23 05:13:16 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo lb # [ 104.045381] niks3-server[1146]: 2026/09/23 05:13:16 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst worker1 # [ 104.068524] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker1 # [ 104.079632] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 104.083762] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 104.094120] nix-daemon[850]: reaped child process 1385, status = succeeded worker1 # [ 104.124593] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 104.136867] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 104.150553] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.194Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker1 # [ 104.159748] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 104.170139] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 104.263557] nix-daemon[850]: accepted connection from pid 1412, user nix-grpc-daemon (trusted) worker1 # [ 104.277472] nix-daemon[850]: reaped child process 1415, status = succeeded lb # [ 104.261897] niks3-server[1146]: 2026/09/23 05:13:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 104.293396] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.337Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 104.294866] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.339Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 104.297147] niks3-server[1146]: 2026/09/23 05:13:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 104.325283] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.369Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.303114] niks3-server[1146]: 2026/09/23 05:13:16 INFO Signed narinfos id=41 count=1 lb # [ 104.311844] niks3-server[1146]: 2026/09/23 05:13:16 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 104.316686] niks3-server[1146]: 2026/09/23 05:13:16 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 104.324818] niks3-server[1146]: 2026/09/23 05:13:16 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 104.329555] niks3-server[1146]: 2026/09/23 05:13:16 INFO Completed upload id=41 worker1 # [ 104.351445] nix-grpc-daemon[1333]: time=2026-09-23T05:13:17.395Z level=INFO msg="Upload complete. (171ms)" lb # [ 104.333820] niks3-server[1146]: 2026/09/23 05:13:16 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker1 # [ 104.354251] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55778 duration_s=0 paths=1 nar_bytes_in=784 worker1 # [ 104.359514] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 worker1 # [ 104.369252] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) worker1 # [ 104.376193] nix-daemon[850]: reaped child process 1410, status = succeeded worker1 # [ 104.379278] nix-daemon[850]: accepted connection from pid 1262, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 105.617069] nix-daemon[850]: reaped child process 1419, status = succeeded worker1 # [ 105.700908] nix-daemon[850]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) worker1 # [ 105.712814] nix-daemon[850]: reaped child process 1438, status = succeeded lb # [ 105.698569] niks3-server[1146]: 2026/09/23 05:13:17 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 105.705619] envoy[910]: conn peer=[2001:db8:1::3]:53754 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=20326 tx=4174 ms=80044 lb # [ 105.709408] envoy[910]: conn peer=[2001:db8:1::1]:54244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=282 ms=976 worker1 # [ 105.737957] nix-grpc-daemon[1333]: time=2026-09-23T05:13:18.782Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 105.739496] nix-grpc-daemon[1333]: time=2026-09-23T05:13:18.783Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 105.748150] niks3-server[1146]: 2026/09/23 05:13:17 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 105.754152] niks3-server[1146]: 2026/09/23 05:13:18 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 105.757538] niks3-server[1146]: 2026/09/23 05:13:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 105.762672] niks3-server[1146]: 2026/09/23 05:13:18 INFO Signed narinfos id=42 count=1 worker1 # [ 105.787622] nix-grpc-daemon[1333]: time=2026-09-23T05:13:18.831Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.769414] niks3-server[1146]: 2026/09/23 05:13:18 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 105.776311] niks3-server[1146]: 2026/09/23 05:13:18 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 105.780725] niks3-server[1146]: 2026/09/23 05:13:18 INFO Completed upload id=42 lb # [ 105.782610] niks3-server[1146]: 2026/09/23 05:13:18 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker1 # [ 105.804454] nix-grpc-daemon[1333]: time=2026-09-23T05:13:18.848Z level=INFO msg="Upload complete. (215ms)" worker1 # [ 105.811858] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55778 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker1 # [ 105.826442] nix-daemon[850]: reaped child process 1417, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.75 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.11 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.22 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 106.119244] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 106.622652] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:19Z level=info event=signal_exit lb # [ 106.808812] niks3-server[1146]: 2026/09/23 05:13:19 INFO lead: released remote=192.168.1.3:47370 worker2 # [ 107.837776] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 107.836112] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:20Z level=info event=scheduler_restarting worker1 # [ 107.839496] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:20Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 107.843250] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55772 worker1 # [ 107.846884] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:20Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 107.850401] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55772 worker1 # [ 107.853995] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:20Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 107.870519] nix-daemon[850]: reaped child process 1323, status = succeeded worker2 # [ 108.038137] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.042388] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.044977] nix-grpc-daemon[1262]: ts=2026-09-23T05:13:21Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 108.243607] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.247578] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.245684] nix-grpc-daemon[1262]: E0000 00:00:1790140401.289793 1308 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker1 # [ 108.250695] nix-grpc-daemon[1262]: E0000 00:00:1790140401.290053 1308 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 108.448730] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.452652] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.653663] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.657653] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 108.859693] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.863609] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.064744] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.068827] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.269963] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.273903] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.474830] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.478726] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.679764] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.683770] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.885772] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.889738] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.043182] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 110.046269] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 110.049745] systemd[1]: nix-grpc-daemon.service: Consumed 810ms CPU time over 11.524s wall clock time, 37.4M memory peak, 36.2K incoming IP traffic, 60.7K outgoing IP traffic. worker1 # [ 110.060911] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 110.065446] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 110.069929] systemd[1]: nix-grpc-daemon.socket: Consumed 682us CPU time over 11.562s wall clock time, 256K memory peak, 33.1K incoming IP traffic, 24.1K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 110.091130] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.095358] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 110.296408] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.300296] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.501288] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.505321] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.706351] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.710275] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.834423] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_take_over lb # [ 110.807257] niks3-server[1146]: 2026/09/23 05:13:23 INFO lead: acquired remote=192.168.1.4:54786 worker2 # [ 110.911903] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.915802] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.116683] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.120632] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 111.321621] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.325636] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.526882] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.545148] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 111.548812] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:35560 worker2 # [ 111.552745] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker2 # [ 112.399650] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45200 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 112.408225] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 112.433111] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 112.438503] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 112.477088] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 112.490168] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45200 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 112.503355] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 112.514863] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 112.615823] nix-daemon[873]: accepted connection from pid 1351, user nix-grpc-daemon (trusted) worker2 # [ 112.630248] nix-daemon[873]: reaped child process 1354, status = succeeded lb # [ 112.608887] niks3-server[1146]: 2026/09/23 05:13:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 112.644200] nix-grpc-daemon[1309]: time=2026-09-23T05:13:25.834Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 112.646431] nix-grpc-daemon[1309]: time=2026-09-23T05:13:25.835Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 112.639868] niks3-server[1146]: 2026/09/23 05:13:24 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 112.646358] niks3-server[1146]: 2026/09/23 05:13:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 112.651241] niks3-server[1146]: 2026/09/23 05:13:24 INFO Signed narinfos id=43 count=1 worker2 # [ 112.681494] nix-grpc-daemon[1309]: time=2026-09-23T05:13:25.871Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.664604] niks3-server[1146]: 2026/09/23 05:13:24 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker2 # [ 112.704408] nix-grpc-daemon[1309]: time=2026-09-23T05:13:25.894Z level=INFO msg="Upload complete. (178ms)" lb # [ 112.677976] niks3-server[1146]: 2026/09/23 05:13:24 INFO Completed upload id=43 worker2 # [ 112.707532] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=0 paths=1 nar_bytes_in=520 lb # [ 112.684654] niks3-server[1146]: 2026/09/23 05:13:24 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker2 # [ 112.713216] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 lb # [ 112.690827] niks3-server[1146]: 2026/09/23 05:13:24 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst worker2 # [ 112.721179] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 112.726134] nix-daemon[873]: reaped child process 1349, status = succeeded worker2 # [ 112.730710] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 114.566243] nix-daemon[873]: reaped child process 1358, status = succeeded worker2 # [ 114.654457] nix-daemon[873]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 114.666132] nix-daemon[873]: reaped child process 1377, status = succeeded lb # [ 114.646545] niks3-server[1146]: 2026/09/23 05:13:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 114.686648] nix-grpc-daemon[1309]: time=2026-09-23T05:13:27.876Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 114.688289] nix-grpc-daemon[1309]: time=2026-09-23T05:13:27.878Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 114.688118] niks3-server[1146]: 2026/09/23 05:13:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker2 # [ 114.720902] nix-grpc-daemon[1309]: time=2026-09-23T05:13:27.910Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.693503] niks3-server[1146]: 2026/09/23 05:13:26 INFO Signed narinfos id=44 count=1 lb # [ 114.704945] niks3-server[1146]: 2026/09/23 05:13:26 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 114.707779] niks3-server[1146]: 2026/09/23 05:13:26 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 114.712595] niks3-server[1146]: 2026/09/23 05:13:26 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 114.717731] niks3-server[1146]: 2026/09/23 05:13:26 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 114.721489] niks3-server[1146]: 2026/09/23 05:13:26 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo lb # [ 114.724936] niks3-server[1146]: 2026/09/23 05:13:26 INFO Completed upload id=44 worker2 # [ 114.752384] nix-grpc-daemon[1309]: time=2026-09-23T05:13:27.942Z level=INFO msg="Upload complete. (211ms)" worker2 # [ 114.763917] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=2 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker2 # [ 114.770697] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:27Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 114.774184] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:27Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 114.782773] nix-daemon[873]: reaped child process 1356, status = succeeded worker2 # [ 114.815121] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 114.827806] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 114.843446] nix-grpc-daemon[1309]: time=2026-09-23T05:13:28.033Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 114.852445] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 114.862169] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 114.957444] nix-daemon[873]: accepted connection from pid 1383, user nix-grpc-daemon (trusted) worker2 # [ 114.970083] nix-daemon[873]: reaped child process 1386, status = succeeded lb # [ 114.950175] niks3-server[1146]: 2026/09/23 05:13:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 114.986900] nix-grpc-daemon[1309]: time=2026-09-23T05:13:28.176Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 114.988426] nix-grpc-daemon[1309]: time=2026-09-23T05:13:28.178Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 114.984631] niks3-server[1146]: 2026/09/23 05:13:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 114.992151] niks3-server[1146]: 2026/09/23 05:13:27 INFO Signed narinfos id=45 count=1 worker2 # [ 115.021669] nix-grpc-daemon[1309]: time=2026-09-23T05:13:28.211Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.997107] niks3-server[1146]: 2026/09/23 05:13:27 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 115.003578] niks3-server[1146]: 2026/09/23 05:13:27 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 115.011569] niks3-server[1146]: 2026/09/23 05:13:27 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 115.015956] niks3-server[1146]: 2026/09/23 05:13:27 INFO Completed upload id=45 worker2 # [ 115.043206] nix-grpc-daemon[1309]: time=2026-09-23T05:13:28.233Z level=INFO msg="Upload complete. (169ms)" lb # [ 115.018615] niks3-server[1146]: 2026/09/23 05:13:27 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 115.047467] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 115.051924] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 115.063988] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 115.066744] nix-daemon[873]: reaped child process 1381, status = succeeded worker2 # [ 115.070584] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 115.703992] envoy[910]: conn peer=[2001:db8:1::1]:54246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9726 tx=4438 ms=5586 lb # [ 115.708097] envoy[910]: conn peer=[2001:db8:1::3]:50464 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1726 tx=592 ms=9370 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 116.107877] nix-daemon[873]: reaped child process 1390, status = succeeded worker2 # [ 116.191589] nix-daemon[873]: accepted connection from pid 1406, user nix-grpc-daemon (trusted) worker2 # [ 116.204545] nix-daemon[873]: reaped child process 1409, status = succeeded lb # [ 116.186691] niks3-server[1146]: 2026/09/23 05:13:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 116.221062] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.410Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 116.222620] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.412Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 116.229225] niks3-server[1146]: 2026/09/23 05:13:28 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 116.239076] niks3-server[1146]: 2026/09/23 05:13:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker2 # [ 116.272821] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.462Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.245623] niks3-server[1146]: 2026/09/23 05:13:28 INFO Signed narinfos id=46 count=1 lb # [ 116.251112] niks3-server[1146]: 2026/09/23 05:13:28 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 116.255567] niks3-server[1146]: 2026/09/23 05:13:28 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 116.267150] niks3-server[1146]: 2026/09/23 05:13:28 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 116.270197] niks3-server[1146]: 2026/09/23 05:13:28 INFO Completed upload id=46 worker2 # [ 116.297473] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.487Z level=INFO msg="Upload complete. (219ms)" lb # [ 116.273635] niks3-server[1146]: 2026/09/23 05:13:28 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 116.305890] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker2 # [ 116.316876] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 116.320473] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 116.329859] nix-daemon[873]: reaped child process 1388, status = succeeded worker2 # [ 116.361934] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 116.374426] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 116.387776] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.577Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 116.396770] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 116.407134] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 116.502847] nix-daemon[873]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) worker2 # [ 116.516667] nix-daemon[873]: reaped child process 1418, status = succeeded lb # [ 116.495126] niks3-server[1146]: 2026/09/23 05:13:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 116.531057] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.721Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 116.532593] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.722Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 116.526657] niks3-server[1146]: 2026/09/23 05:13:28 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 116.537560] niks3-server[1146]: 2026/09/23 05:13:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker2 # [ 116.571739] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.761Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.544759] niks3-server[1146]: 2026/09/23 05:13:28 INFO Signed narinfos id=47 count=1 lb # [ 116.550111] niks3-server[1146]: 2026/09/23 05:13:28 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 116.563864] niks3-server[1146]: 2026/09/23 05:13:28 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 116.571251] niks3-server[1146]: 2026/09/23 05:13:28 INFO Completed upload id=47 lb # [ 116.572811] niks3-server[1146]: 2026/09/23 05:13:28 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 116.598711] nix-grpc-daemon[1309]: time=2026-09-23T05:13:29.788Z level=INFO msg="Upload complete. (180ms)" worker2 # [ 116.603359] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 116.609255] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 116.620200] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 116.629142] nix-daemon[873]: reaped child process 1413, status = succeeded worker2 # [ 116.634584] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 117.675130] nix-daemon[873]: reaped child process 1422, status = succeeded worker2 # [ 117.758691] nix-daemon[873]: accepted connection from pid 1438, user nix-grpc-daemon (trusted) worker2 # [ 117.770814] nix-daemon[873]: reaped child process 1441, status = succeeded lb # [ 117.751332] niks3-server[1146]: 2026/09/23 05:13:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 117.787335] nix-grpc-daemon[1309]: time=2026-09-23T05:13:30.977Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 117.789036] nix-grpc-daemon[1309]: time=2026-09-23T05:13:30.978Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 117.795589] niks3-server[1146]: 2026/09/23 05:13:30 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 117.800241] niks3-server[1146]: 2026/09/23 05:13:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker2 # [ 117.835294] nix-grpc-daemon[1309]: time=2026-09-23T05:13:31.025Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.808789] niks3-server[1146]: 2026/09/23 05:13:30 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 117.811833] niks3-server[1146]: 2026/09/23 05:13:30 INFO Signed narinfos id=48 count=1 lb # [ 117.819278] niks3-server[1146]: 2026/09/23 05:13:30 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 117.827190] niks3-server[1146]: 2026/09/23 05:13:30 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 117.830870] niks3-server[1146]: 2026/09/23 05:13:30 INFO Completed upload id=48 worker2 # [ 117.858386] nix-grpc-daemon[1309]: time=2026-09-23T05:13:31.048Z level=INFO msg="Upload complete. (215ms)" lb # [ 117.833806] niks3-server[1146]: 2026/09/23 05:13:30 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 117.864757] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker2 # [ 117.881056] nix-daemon[873]: reaped child process 1420, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.69 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds) worker1 # [ 118.102469] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 118.108726] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 118.197976] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:31Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 118.200162] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:31Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 118.204165] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:31Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 118.208077] nix-grpc-daemon[1456]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 118.209418] nix-grpc-daemon[1456]: E0000 00:00:1790140411.252438 1456 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 118.216074] nix-grpc-daemon[1456]: E0000 00:00:1790140411.257695 1456 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 118.219603] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:31Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 118.221258] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 118.226969] nix-grpc-daemon[1456]: E0000 00:00:1790140411.269594 1498 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 118.238641] nix-grpc-daemon[1456]: E0000 00:00:1790140411.283109 1498 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 118.242166] nix-grpc-daemon[1456]: E0000 00:00:1790140411.285331 1498 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 118.252893] nix-grpc-daemon[1456]: E0000 00:00:1790140411.297322 1498 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 118.265094] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.272061] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:35560 worker2 # [ 118.275879] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.47 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 118.500534] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 034c1763ddbd46f680ef3c361eac005d client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) client # [ 118.634714] nix[1358]: don't know how to build these paths: client # [ 118.635672] nix[1358]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 118.619642] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 118.630103] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 118.635748] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 118.674728] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 118.686935] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45200 client # [ 118.710193] nix[1358]: copying 1 paths to 'lb:50051'... worker2 # [ 118.698185] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 client # [ 118.713148] nix[1358]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 118.711112] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 118.808166] nix-daemon[873]: accepted connection from pid 1454, user nix-grpc-daemon (trusted) worker2 # [ 118.820731] nix-daemon[873]: reaped child process 1457, status = succeeded lb # [ 118.801852] niks3-server[1146]: 2026/09/23 05:13:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 118.838120] nix-grpc-daemon[1309]: time=2026-09-23T05:13:32.027Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 118.840073] nix-grpc-daemon[1309]: time=2026-09-23T05:13:32.029Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 118.833871] niks3-server[1146]: 2026/09/23 05:13:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker2 # [ 118.868964] nix-grpc-daemon[1309]: time=2026-09-23T05:13:32.058Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.841458] niks3-server[1146]: 2026/09/23 05:13:31 INFO Signed narinfos id=49 count=1 lb # [ 118.849764] niks3-server[1146]: 2026/09/23 05:13:31 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 118.856231] niks3-server[1146]: 2026/09/23 05:13:31 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 118.864468] niks3-server[1146]: 2026/09/23 05:13:31 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 118.873491] niks3-server[1146]: 2026/09/23 05:13:31 INFO Completed upload id=49 worker2 # [ 118.900773] nix-grpc-daemon[1309]: time=2026-09-23T05:13:32.090Z level=INFO msg="Upload complete. (178ms)" lb # [ 118.874764] niks3-server[1146]: 2026/09/23 05:13:31 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 118.905795] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 118.911304] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 worker2 # [ 118.919488] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) worker2 # [ 118.927904] nix-daemon[873]: reaped child process 1452, status = succeeded worker2 # [ 118.932186] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted) client # [ 118.945295] nix[1358]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 121.162477] systemd-journald[284]: Received client request to rotate journal, rotating. worker1 # [ 121.181351] systemd-journald[284]: Vacuuming done, freed 0B of archived journals from /var/log/journal/b241ce36aa3840dbb28cbd4d785d478e. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 121.097340] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker2 # [ 121.431216] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:34Z level=info event=draining lb # [ 125.704974] envoy[910]: conn peer=[2001:db8:1::1]:57504 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9599 tx=4345 ms=5524 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 126.353765] nix-daemon[873]: reaped child process 1461, status = succeeded worker2 # [ 126.428771] nix-daemon[873]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker2 # [ 126.442154] nix-daemon[873]: reaped child process 1506, status = succeeded lb # [ 126.422793] niks3-server[1146]: 2026/09/23 05:13:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.459309] nix-grpc-daemon[1309]: time=2026-09-23T05:13:39.649Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 126.462059] nix-grpc-daemon[1309]: time=2026-09-23T05:13:39.650Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" worker2 # [ 126.495109] nix-grpc-daemon[1309]: time=2026-09-23T05:13:39.685Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.467757] niks3-server[1146]: 2026/09/23 05:13:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 126.470813] niks3-server[1146]: 2026/09/23 05:13:38 INFO Signed narinfos id=50 count=1 lb # [ 126.476359] niks3-server[1146]: 2026/09/23 05:13:38 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 126.480557] niks3-server[1146]: 2026/09/23 05:13:38 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 126.488059] niks3-server[1146]: 2026/09/23 05:13:38 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 126.498442] niks3-server[1146]: 2026/09/23 05:13:38 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 126.502214] niks3-server[1146]: 2026/09/23 05:13:38 INFO Completed upload id=50 worker2 # [ 126.529564] nix-grpc-daemon[1309]: time=2026-09-23T05:13:39.719Z level=INFO msg="Upload complete. (184ms)" lb # [ 126.504076] niks3-server[1146]: 2026/09/23 05:13:38 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 126.536686] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45200 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 126.550766] nix-daemon[873]: reaped child process 1459, status = succeeded client # [ 126.576292] systemd[1]: rs.service: Deactivated successfully. client # [ 126.578277] systemd[1]: rs.service: Consumed 117ms CPU time over 8.077s wall clock time, 41.4M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 127.432607] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:40Z level=info event=signal_exit lb # [ 127.812925] niks3-server[1146]: 2026/09/23 05:13:40 INFO lead: released remote=192.168.1.4:54786 lb # [ 128.205844] niks3-server[1146]: 2026/09/23 05:13:40 INFO lead: acquired remote=192.168.1.3:50926 worker1 # [ 128.228989] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:41Z level=info event=scheduler_take_over worker1 # [ 128.835353] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:41Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 128.843997] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:42Z level=info event=scheduler_restarting worker2 # [ 128.847910] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:42Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 128.851515] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35560 worker2 # [ 128.854984] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:42Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 128.858448] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35560 worker2 # [ 128.862205] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:42Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 128.878925] nix-daemon[873]: reaped child process 1301, status = succeeded worker1 # [ 129.036308] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.040428] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.054442] nix-grpc-daemon[1248]: ts=2026-09-23T05:13:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 129.241696] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.248382] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:42Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:33038 worker1 # [ 129.253369] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.17 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 129.495925] nix-grpc-daemon[1248]: E0000 00:00:1790140422.685813 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker2 # [ 129.501439] nix-grpc-daemon[1248]: E0000 00:00:1790140422.691310 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 130.373492] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 130.376517] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 130.379309] systemd[1]: nix-grpc-daemon.service: Consumed 1.241s CPU time over 36.055s wall clock time, 41.5M memory peak, 64.3K incoming IP traffic, 167.9K outgoing IP traffic. worker2 # [ 130.395173] systemd[1]: Starting scheduler-token.service... worker2 # [ 130.442662] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 130.444270] systemd[1]: Finished scheduler-token.service. worker2 # [ 130.445415] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 50ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 130.450099] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 130.528309] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:43Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 130.532648] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 130.536186] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 130.538167] nix-grpc-daemon[1516]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 130.539522] nix-grpc-daemon[1516]: E0000 00:00:1790140423.725657 1516 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 130.546327] nix-grpc-daemon[1516]: E0000 00:00:1790140423.732772 1516 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.549550] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 130.553048] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 130.553906] nix-grpc-daemon[1516]: E0000 00:00:1790140423.741859 1557 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 130.564604] nix-grpc-daemon[1516]: E0000 00:00:1790140423.754623 1557 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.569053] nix-grpc-daemon[1516]: E0000 00:00:1790140423.756930 1557 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 130.578863] nix-grpc-daemon[1516]: E0000 00:00:1790140423.768891 1557 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.589312] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 130.592841] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:43Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 130.597157] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:43Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:33038 worker1 # [ 130.601089] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.32 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 130.824789] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 35a5fa302c8f4418a121dabd53d9fe6f client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker1 # [ 130.943776] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33048 worker1 # [ 130.955189] nix-daemon[850]: accepted connection from pid 1456, user nix-grpc-daemon (trusted) client # [ 130.986176] nix[1394]: don't know how to build these paths: client # [ 130.987094] nix[1394]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 130.974758] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 130.979198] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 131.028710] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33048 worker1 # [ 131.039887] nix-grpc-daemon[1456]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5) worker1 # [ 131.103443] nix-grpc-daemon[1456]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5) worker1 # [ 131.110531] nix-grpc-daemon[1456]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 3/5) worker1 # [ 131.258501] nix-grpc-daemon[1456]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 4/5) worker1 # [ 131.425275] nix-grpc-daemon[1456]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 131.428333] nix-grpc-daemon[1456]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 131.446101] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33048 client # [ 131.476197] nix[1394]: copying 1 paths to 'lb:50051'... worker1 # [ 131.458775] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33048 client # [ 131.478914] nix[1394]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 131.471111] nix-daemon[850]: accepted connection from pid 1456, user nix-grpc-daemon (trusted) worker1 # [ 131.490078] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=info event=niks3_push_started pid=1585 worker1 # [ 131.593578] nix-grpc-daemon[1585]: time=2026-09-23T05:13:44.637Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 131.683094] nix-daemon[850]: accepted connection from pid 1598, user nix-grpc-daemon (trusted) worker1 # [ 131.696156] nix-daemon[850]: reaped child process 1601, status = succeeded lb # [ 131.682296] niks3-server[1146]: 2026/09/23 05:13:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 131.713221] nix-grpc-daemon[1585]: time=2026-09-23T05:13:44.757Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 131.714779] nix-grpc-daemon[1585]: time=2026-09-23T05:13:44.759Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 131.720422] niks3-server[1146]: 2026/09/23 05:13:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 131.753781] nix-grpc-daemon[1585]: time=2026-09-23T05:13:44.797Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.731253] niks3-server[1146]: 2026/09/23 05:13:43 INFO Signed narinfos id=51 count=1 lb # [ 131.736416] niks3-server[1146]: 2026/09/23 05:13:43 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 131.741787] niks3-server[1146]: 2026/09/23 05:13:43 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 131.753716] niks3-server[1146]: 2026/09/23 05:13:44 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 131.758722] niks3-server[1146]: 2026/09/23 05:13:44 INFO Completed upload id=51 worker1 # [ 131.782739] nix-grpc-daemon[1585]: time=2026-09-23T05:13:44.827Z level=INFO msg="Upload complete. (185ms)" lb # [ 131.762446] niks3-server[1146]: 2026/09/23 05:13:44 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 131.786267] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33048 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 131.792303] nix-grpc-daemon[1456]: ts=2026-09-23T05:13:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33048 worker1 # [ 131.800483] nix-daemon[850]: accepted connection from pid 1456, user nix-grpc-daemon (trusted) worker1 # [ 131.807144] nix-daemon[850]: reaped child process 1583, status = succeeded worker1 # [ 131.810868] nix-daemon[850]: accepted connection from pid 1456, user nix-grpc-daemon (trusted) client # [ 131.829094] nix[1394]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 133.302701] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1456 (nix-grpc-daemon) on client request. worker1 # [ 133.307335] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 133.292422] niks3-server[1146]: 2026/09/23 05:13:45 INFO lead: released remote=192.168.1.3:50926 worker1 # [ 133.321598] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 133.325382] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. client # [ 133.341872] nix[1394]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 133.326619] systemd[1]: nix-grpc-daemon.service: Consumed 374ms CPU time over 15.211s wall clock time, 35.6M memory peak, 15.4K incoming IP traffic, 27.4K outgoing IP traffic. worker2 # [ 133.328581] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 133.346542] nix[1394]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 133.339030] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 133.340590] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 133.372622] nix-daemon[850]: reaped child process 1575, status = succeeded worker1 # [ 133.374458] nix-daemon[850]: reaped child process 1603, status = succeeded worker1 # [ 133.382220] nix-daemon[1605]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 133.392713] nix-daemon[850]: reaped child process 1605, status = failed with exit code 1 worker1 # [ 133.433672] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 133.438085] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 133.441452] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 133.448601] nix-grpc-daemon[1642]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 133.451577] nix-grpc-daemon[1642]: E0000 00:00:1790140426.485152 1642 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 133.432163] niks3-server[1146]: 2026/09/23 05:13:45 INFO lead: acquired remote=192.168.1.3:50660 worker1 # [ 133.454751] nix-grpc-daemon[1642]: E0000 00:00:1790140426.489232 1642 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 133.457576] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 133.461036] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 133.461893] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=scheduler_take_over worker1 # [ 133.462990] nix-grpc-daemon[1642]: E0000 00:00:1790140426.503993 1684 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.20 seconds) client: must succeed: sleep 5.0 worker1 # [ 133.474548] nix-grpc-daemon[1642]: E0000 00:00:1790140426.518956 1684 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 133.478150] nix-grpc-daemon[1642]: E0000 00:00:1790140426.521263 1684 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 133.488730] nix-grpc-daemon[1642]: E0000 00:00:1790140426.533156 1684 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 133.498392] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 133.504875] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57922 worker1 # [ 133.506444] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 133.529569] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 133.529068] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 133.530708] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57922 worker1 # [ 133.532355] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 133.837714] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 133.842812] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.891147] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57926 worker1 # [ 133.901163] nix-daemon[850]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) worker1 # [ 133.915245] nix-daemon[850]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) client # [ 133.947139] nix[1394]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 133.930099] nix-daemon[850]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) lb # [ 135.705418] envoy[910]: conn peer=[2001:db8:1::1]:41638 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=1523 ms=7933 lb # [ 135.709345] envoy[910]: conn peer=[2001:db8:1::4]:47952 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=36793 tx=2105 ms=34582 lb # [ 135.713111] envoy[910]: conn peer=[2001:db8:1::3]:57988 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1010 tx=393 ms=15064 client: (finished: must succeed: sleep 5.0, in 5.04 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 138.755424] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:51Z level=info event=niks3_push_started pid=1726 worker1 # [ 138.784253] nix-daemon[850]: reaped child process 1701, status = succeeded worker1 # [ 138.862611] nix-grpc-daemon[1726]: time=2026-09-23T05:13:51.906Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 138.952448] nix-daemon[850]: accepted connection from pid 1739, user nix-grpc-daemon (trusted) worker1 # [ 138.963804] nix-daemon[850]: reaped child process 1742, status = succeeded lb # [ 138.951972] niks3-server[1146]: 2026/09/23 05:13:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.984675] nix-grpc-daemon[1726]: time=2026-09-23T05:13:52.029Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.986317] nix-grpc-daemon[1726]: time=2026-09-23T05:13:52.030Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 138.998567] niks3-server[1146]: 2026/09/23 05:13:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 139.037212] nix-grpc-daemon[1726]: time=2026-09-23T05:13:52.081Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.015216] niks3-server[1146]: 2026/09/23 05:13:51 INFO Signed narinfos id=52 count=1 lb # [ 139.025114] niks3-server[1146]: 2026/09/23 05:13:51 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 139.039056] niks3-server[1146]: 2026/09/23 05:13:51 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 139.049253] niks3-server[1146]: 2026/09/23 05:13:51 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 139.053470] niks3-server[1146]: 2026/09/23 05:13:51 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 139.056406] niks3-server[1146]: 2026/09/23 05:13:51 INFO Completed upload id=52 worker1 # [ 139.078612] nix-grpc-daemon[1726]: time=2026-09-23T05:13:52.122Z level=INFO msg="Upload complete. (212ms)" lb # [ 139.058853] niks3-server[1146]: 2026/09/23 05:13:51 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 139.086156] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57926 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 139.103163] nix-daemon[850]: reaped child process 1699, status = succeeded client # [ 139.143577] systemd[1]: mid.service: Deactivated successfully. client # [ 139.147311] systemd[1]: mid.service: Consumed 140ms CPU time over 8.322s wall clock time, 41.4M memory peak, 8.7K incoming IP traffic, 10.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.04 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 139.838762] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 776fdbba88fb40d6b5f17bfe32dc99c7 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) client # [ 139.958990] nix[1430]: don't know how to build these paths: client # [ 139.960440] nix[1430]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 139.939404] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57926 worker1 # [ 139.952694] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:52Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 139.957078] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:52Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 140.010839] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 140.022494] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 140.039231] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 1/5) worker2 # [ 140.095673] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 200 ms (attempt 2/5) worker2 # [ 140.297879] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 3/5) worker2 # [ 140.405764] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 4/5) worker2 # [ 140.430198] nix-grpc-daemon[1516]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 140.433141] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 140.450715] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 client # [ 140.475229] nix[1430]: copying 1 paths to 'lb:50051'... client # [ 140.479141] nix[1430]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 140.465980] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 140.474547] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 140.498430] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:53Z level=info event=niks3_push_started pid=1605 worker2 # [ 140.603692] nix-grpc-daemon[1605]: time=2026-09-23T05:13:53.793Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 140.697395] nix-daemon[873]: accepted connection from pid 1618, user nix-grpc-daemon (trusted) worker2 # [ 140.710201] nix-daemon[873]: reaped child process 1621, status = succeeded lb # [ 140.691663] niks3-server[1146]: 2026/09/23 05:13:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 140.729765] nix-grpc-daemon[1605]: time=2026-09-23T05:13:53.919Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 140.731262] nix-grpc-daemon[1605]: time=2026-09-23T05:13:53.921Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 140.737942] niks3-server[1146]: 2026/09/23 05:13:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker2 # [ 140.770234] nix-grpc-daemon[1605]: time=2026-09-23T05:13:53.960Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.743181] niks3-server[1146]: 2026/09/23 05:13:52 INFO Signed narinfos id=53 count=1 lb # [ 140.748667] niks3-server[1146]: 2026/09/23 05:13:52 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 140.755323] niks3-server[1146]: 2026/09/23 05:13:53 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 140.766268] niks3-server[1146]: 2026/09/23 05:13:53 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 140.774668] niks3-server[1146]: 2026/09/23 05:13:53 INFO Completed upload id=53 worker2 # [ 140.802134] nix-grpc-daemon[1605]: time=2026-09-23T05:13:53.992Z level=INFO msg="Upload complete. (195ms)" lb # [ 140.777032] niks3-server[1146]: 2026/09/23 05:13:53 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 140.806276] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 140.811989] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 140.823147] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 140.830131] nix-daemon[873]: reaped child process 1603, status = succeeded worker2 # [ 140.832896] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # [ 140.846571] nix[1430]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 142.169185] systemd[1]: intr.service: Sent signal SIGINT to main process 1430 (nix) on client request. worker2 # [ 142.162246] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:55Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 142.176270] nix[1430]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 142.182131] nix[1430]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 142.209773] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 142.212667] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 142.216120] systemd[1]: intr.service: Consumed 116ms CPU time over 2.373s wall clock time, 41.5M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 142.261357] nix-daemon[873]: reaped child process 1623, status = succeeded worker2 # [ 142.262604] nix-daemon[1625]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 142.267419] nix-daemon[873]: reaped child process 1625, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 2.46 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 142.324950] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: f524d68738104cf59e9090da6b151b1b client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds) client # [ 142.452838] nix[1451]: don't know how to build these paths: client # [ 142.453795] nix[1451]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 142.433697] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57926 worker1 # [ 142.444480] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:55Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 142.450166] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:55Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 142.488973] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57926 worker1 # [ 142.500556] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5) worker1 # [ 142.518807] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5) worker1 # [ 142.666640] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 3/5) worker1 # [ 142.844760] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 4/5) worker1 # [ 142.892245] nix-grpc-daemon[1642]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 142.895748] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 142.914519] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57926 client # [ 142.942960] nix[1451]: copying 1 paths to 'lb:50051'... worker1 # [ 142.926830] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57926 client # [ 142.946686] nix[1451]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 142.937815] nix-daemon[850]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) worker1 # [ 143.043854] nix-daemon[850]: accepted connection from pid 1774, user nix-grpc-daemon (trusted) worker1 # [ 143.056508] nix-daemon[850]: reaped child process 1777, status = succeeded lb # [ 143.043253] niks3-server[1146]: 2026/09/23 05:13:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.073841] nix-grpc-daemon[1726]: time=2026-09-23T05:13:56.118Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 143.076698] nix-grpc-daemon[1726]: time=2026-09-23T05:13:56.120Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 143.072648] niks3-server[1146]: 2026/09/23 05:13:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 143.080452] niks3-server[1146]: 2026/09/23 05:13:55 INFO Signed narinfos id=54 count=1 worker1 # [ 143.107222] nix-grpc-daemon[1726]: time=2026-09-23T05:13:56.151Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.090683] niks3-server[1146]: 2026/09/23 05:13:55 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 143.103092] niks3-server[1146]: 2026/09/23 05:13:55 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 143.108136] niks3-server[1146]: 2026/09/23 05:13:55 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 143.116148] niks3-server[1146]: 2026/09/23 05:13:55 INFO Completed upload id=54 worker1 # [ 143.140566] nix-grpc-daemon[1726]: time=2026-09-23T05:13:56.184Z level=INFO msg="Upload complete. (188ms)" lb # [ 143.121540] niks3-server[1146]: 2026/09/23 05:13:55 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 143.144939] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57926 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 143.150901] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57926 worker1 # [ 143.160119] nix-daemon[850]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) worker1 # [ 143.170732] nix-daemon[850]: reaped child process 1772, status = succeeded worker1 # [ 143.174346] nix-daemon[850]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) client # [ 143.192102] nix[1451]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 144.739719] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 144.766535] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker2 # [ 144.954873] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60276 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 144.963862] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker1 # [ 144.980858] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:58Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 144.984229] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:58Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 145.035949] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 145.048887] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 client # copying 1 paths to 'lb:50051'... worker2 # [ 145.062631] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 145.082888] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 145.195592] nix-daemon[873]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 145.209759] nix-daemon[873]: reaped child process 1675, status = succeeded lb # [ 145.190214] niks3-server[1146]: 2026/09/23 05:13:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 145.224800] nix-grpc-daemon[1605]: time=2026-09-23T05:13:58.414Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 145.226296] nix-grpc-daemon[1605]: time=2026-09-23T05:13:58.416Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 145.221083] niks3-server[1146]: 2026/09/23 05:13:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker2 # [ 145.255904] nix-grpc-daemon[1605]: time=2026-09-23T05:13:58.445Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.228642] niks3-server[1146]: 2026/09/23 05:13:57 INFO Signed narinfos id=55 count=1 lb # [ 145.236067] niks3-server[1146]: 2026/09/23 05:13:57 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 145.246892] niks3-server[1146]: 2026/09/23 05:13:57 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete worker2 # [ 145.281747] nix-grpc-daemon[1605]: time=2026-09-23T05:13:58.471Z level=INFO msg="Upload complete. (181ms)" lb # [ 145.255065] niks3-server[1146]: 2026/09/23 05:13:57 INFO Completed upload id=55 worker2 # [ 145.284348] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=528 lb # [ 145.259145] niks3-server[1146]: 2026/09/23 05:13:57 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls worker2 # [ 145.290813] nix-grpc-daemon[1516]: ts=2026-09-23T05:13:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 lb # [ 145.267364] niks3-server[1146]: 2026/09/23 05:13:57 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 145.300170] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 145.305104] nix-daemon[873]: reaped child process 1670, status = succeeded worker2 # [ 145.309880] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 145.455429] nix-grpc-daemon[1642]: ts=2026-09-23T05:13:58Z level=info event=draining lb # [ 145.706636] envoy[910]: conn peer=[2001:db8:1::1]:54804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3921 tx=1915 ms=8165 lb # [ 145.710660] envoy[910]: conn peer=[2001:db8:1::1]:44830 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2980 tx=805 ms=2240 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 146.949728] nix-daemon[873]: reaped child process 1679, status = succeeded worker2 # [ 147.031248] nix-daemon[873]: accepted connection from pid 1695, user nix-grpc-daemon (trusted) worker2 # [ 147.044631] nix-daemon[873]: reaped child process 1698, status = succeeded lb # [ 147.025982] niks3-server[1146]: 2026/09/23 05:13:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 147.063373] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.253Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 147.064953] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.255Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 147.074897] niks3-server[1146]: 2026/09/23 05:13:59 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 147.087117] niks3-server[1146]: 2026/09/23 05:13:59 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 147.094059] niks3-server[1146]: 2026/09/23 05:13:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 147.097496] niks3-server[1146]: 2026/09/23 05:13:59 INFO Signed narinfos id=56 count=1 worker2 # [ 147.128293] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.318Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.104245] niks3-server[1146]: 2026/09/23 05:13:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 147.112089] niks3-server[1146]: 2026/09/23 05:13:59 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 147.115053] niks3-server[1146]: 2026/09/23 05:13:59 INFO Completed upload id=56 worker2 # [ 147.142459] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.332Z level=INFO msg="Upload complete. (224ms)" lb # [ 147.117407] niks3-server[1146]: 2026/09/23 05:13:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker1 # [ 147.148468] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:00Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 147.149848] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker1 # [ 147.150334] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:00Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 147.164322] nix-daemon[873]: reaped child process 1677, status = succeeded worker2 # [ 147.198692] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 147.210712] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 147.224479] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.414Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 147.232858] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 147.252183] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 147.355383] nix-daemon[873]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker2 # [ 147.368459] nix-daemon[873]: reaped child process 1705, status = succeeded lb # [ 147.349707] niks3-server[1146]: 2026/09/23 05:13:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 147.385530] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.575Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 147.387154] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.577Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 147.386199] niks3-server[1146]: 2026/09/23 05:13:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 147.393455] niks3-server[1146]: 2026/09/23 05:13:59 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 147.398904] niks3-server[1146]: 2026/09/23 05:13:59 INFO Signed narinfos id=57 count=1 worker2 # [ 147.428940] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.618Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.405500] niks3-server[1146]: 2026/09/23 05:13:59 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 147.415651] niks3-server[1146]: 2026/09/23 05:13:59 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 147.422481] niks3-server[1146]: 2026/09/23 05:13:59 INFO Completed upload id=57 lb # [ 147.424379] niks3-server[1146]: 2026/09/23 05:13:59 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 147.450225] nix-grpc-daemon[1605]: time=2026-09-23T05:14:00.639Z level=INFO msg="Upload complete. (184ms)" worker2 # [ 147.455170] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 147.461797] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 147.473234] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 147.481182] nix-daemon[873]: reaped child process 1700, status = succeeded worker2 # [ 147.485296] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 148.300585] nix-daemon[873]: reaped child process 1709, status = succeeded worker2 # [ 148.376558] nix-daemon[873]: accepted connection from pid 1725, user nix-grpc-daemon (trusted) worker2 # [ 148.389729] nix-daemon[873]: reaped child process 1728, status = succeeded lb # [ 148.371132] niks3-server[1146]: 2026/09/23 05:14:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.410419] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.600Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 148.412030] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.601Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 148.406151] niks3-server[1146]: 2026/09/23 05:14:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 148.409051] niks3-server[1146]: 2026/09/23 05:14:00 INFO Signed narinfos id=58 count=1 worker2 # [ 148.436357] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.626Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.413045] niks3-server[1146]: 2026/09/23 05:14:00 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 148.415687] niks3-server[1146]: 2026/09/23 05:14:00 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 148.420810] niks3-server[1146]: 2026/09/23 05:14:00 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 148.426333] niks3-server[1146]: 2026/09/23 05:14:00 INFO Completed upload id=58 worker2 # [ 148.453560] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.643Z level=INFO msg="Upload complete. (162ms)" lb # [ 148.428190] niks3-server[1146]: 2026/09/23 05:14:00 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst worker2 # [ 148.456430] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 lb # [ 148.431653] niks3-server[1146]: 2026/09/23 05:14:00 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 148.463561] nix-daemon[873]: reaped child process 1707, status = succeeded worker1 # [ 148.460192] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:01Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 148.463237] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:01Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 148.512143] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 148.525153] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 148.538249] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.728Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 148.547538] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 148.567130] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 148.664737] nix-daemon[873]: accepted connection from pid 1732, user nix-grpc-daemon (trusted) worker2 # [ 148.677794] nix-daemon[873]: reaped child process 1735, status = succeeded lb # [ 148.658323] niks3-server[1146]: 2026/09/23 05:14:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.693327] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.883Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 148.694821] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.884Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 148.689386] niks3-server[1146]: 2026/09/23 05:14:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 148.697561] niks3-server[1146]: 2026/09/23 05:14:00 INFO Signed narinfos id=59 count=1 worker2 # [ 148.727685] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.917Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.704109] niks3-server[1146]: 2026/09/23 05:14:00 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 148.708741] niks3-server[1146]: 2026/09/23 05:14:00 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 148.721158] niks3-server[1146]: 2026/09/23 05:14:00 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 148.725476] niks3-server[1146]: 2026/09/23 05:14:00 INFO Completed upload id=59 worker2 # [ 148.755545] nix-grpc-daemon[1605]: time=2026-09-23T05:14:01.945Z level=INFO msg="Upload complete. (176ms)" lb # [ 148.732374] niks3-server[1146]: 2026/09/23 05:14:00 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 148.759714] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 148.766373] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 148.778545] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 148.781052] nix-daemon[873]: reaped child process 1730, status = succeeded worker2 # [ 148.786557] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 150.001951] nix-daemon[873]: reaped child process 1739, status = succeeded worker2 # [ 150.077933] nix-daemon[873]: accepted connection from pid 1755, user nix-grpc-daemon (trusted) worker2 # [ 150.091221] nix-daemon[873]: reaped child process 1758, status = succeeded lb # [ 150.071743] niks3-server[1146]: 2026/09/23 05:14:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 150.107385] nix-grpc-daemon[1605]: time=2026-09-23T05:14:03.297Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 150.110234] nix-grpc-daemon[1605]: time=2026-09-23T05:14:03.298Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 150.114435] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 150.119652] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 150.126291] niks3-server[1146]: 2026/09/23 05:14:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 150.131111] niks3-server[1146]: 2026/09/23 05:14:02 INFO Signed narinfos id=60 count=1 worker2 # [ 150.161387] nix-grpc-daemon[1605]: time=2026-09-23T05:14:03.351Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.134913] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 150.145333] niks3-server[1146]: 2026/09/23 05:14:02 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 150.149046] niks3-server[1146]: 2026/09/23 05:14:02 INFO Completed upload id=60 worker2 # [ 150.176416] nix-grpc-daemon[1605]: time=2026-09-23T05:14:03.366Z level=INFO msg="Upload complete. (182ms)" lb # [ 150.151299] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 150.182706] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 150.195714] nix-daemon[873]: reaped child process 1737, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 5.41 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 150.394643] nix-daemon[850]: reaped child process 1781, status = succeeded worker1 # [ 150.470329] nix-daemon[850]: accepted connection from pid 1828, user nix-grpc-daemon (trusted) worker1 # [ 150.482774] nix-daemon[850]: reaped child process 1831, status = succeeded lb # [ 150.469130] niks3-server[1146]: 2026/09/23 05:14:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.499174] nix-grpc-daemon[1726]: time=2026-09-23T05:14:03.543Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.500782] nix-grpc-daemon[1726]: time=2026-09-23T05:14:03.545Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 150.506662] niks3-server[1146]: 2026/09/23 05:14:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 150.511248] niks3-server[1146]: 2026/09/23 05:14:02 INFO Signed narinfos id=61 count=1 worker1 # [ 150.536793] nix-grpc-daemon[1726]: time=2026-09-23T05:14:03.581Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.523062] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 150.528652] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 150.538119] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 150.545113] niks3-server[1146]: 2026/09/23 05:14:02 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 150.550375] niks3-server[1146]: 2026/09/23 05:14:02 INFO Completed upload id=61 worker1 # [ 150.574321] nix-grpc-daemon[1726]: time=2026-09-23T05:14:03.618Z level=INFO msg="Upload complete. (189ms)" lb # [ 150.555728] niks3-server[1146]: 2026/09/23 05:14:02 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 150.582946] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57926 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 150.596342] nix-daemon[850]: reaped child process 1779, status = succeeded client # [ 150.631533] systemd[1]: sw.service: Deactivated successfully. client # [ 150.635545] systemd[1]: sw.service: Consumed 129ms CPU time over 8.309s wall clock time, 41.4M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1 # [ 151.459536] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:04Z level=info event=signal_exit lb # [ 152.440667] niks3-server[1146]: 2026/09/23 05:14:04 INFO lead: released remote=192.168.1.3:50660 worker2 # [ 153.468762] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:06Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 153.461821] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:06Z level=info event=scheduler_restarting worker1 # [ 153.471311] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57922 worker1 # [ 153.475159] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:06Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 153.478921] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:06Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 153.482178] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57922 worker1 # [ 153.485610] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:06Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 153.501709] nix-daemon[850]: reaped child process 1697, status = succeeded worker2 # [ 153.669847] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 153.673837] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 153.679748] nix-grpc-daemon[1642]: ts=2026-09-23T05:14:06Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 153.875057] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 153.878932] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 154.079811] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.083690] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 154.145660] nix-grpc-daemon[1642]: E0000 00:00:1790140447.189963 1688 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 20, started true, shutdown true worker1 # [ 154.150910] nix-grpc-daemon[1642]: E0000 00:00:1790140447.195300 1688 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 154.284821] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.288720] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 154.490514] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.494288] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 154.695518] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.699460] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 154.900632] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 154.904628] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.105661] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.109661] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.310725] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.314650] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 155.488335] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 155.492376] systemd[1]: nix-grpc-daemon.service: Consumed 583ms CPU time over 22.170s wall clock time, 36M memory peak, 25K incoming IP traffic, 32.6K outgoing IP traffic. worker1 # [ 155.508378] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 155.516566] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.520362] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.553363] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_take_over lb # [ 155.526634] niks3-server[1146]: 2026/09/23 05:14:07 INFO lead: acquired remote=192.168.1.4:49076 worker1 # [ 155.601203] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 155.603194] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 155.606458] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 155.610753] nix-grpc-daemon[1845]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 155.612131] nix-grpc-daemon[1845]: E0000 00:00:1790140448.655018 1845 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.617609] nix-grpc-daemon[1845]: E0000 00:00:1790140448.660329 1845 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.623163] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 155.626064] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 155.631096] nix-grpc-daemon[1845]: E0000 00:00:1790140448.672001 1887 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.642117] nix-grpc-daemon[1845]: E0000 00:00:1790140448.685828 1887 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.644249] nix-grpc-daemon[1845]: E0000 00:00:1790140448.685956 1887 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 4.19 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 155.656388] nix-grpc-daemon[1845]: E0000 00:00:1790140448.700803 1887 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.668088] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 155.669729] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 155.721400] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.725261] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 155.706459] envoy[910]: conn peer=[2001:db8:1::1]:44622 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=4350 ms=5245 lb # [ 155.710174] envoy[910]: conn peer=[2001:db8:1::1]:44846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=1539 ms=8164 lb # [ 155.713705] envoy[910]: conn peer=[2001:db8:1::3]:50910 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=975 tx=361 ms=20176 worker1 # [ 155.870776] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 155.874686] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.926264] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.930269] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.075496] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.079532] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 156.131482] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.135349] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.280613] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.284595] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 156.336438] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.340300] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.486483] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.498951] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48406 worker2 # [ 156.503735] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 156.543410] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.550134] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 156.553963] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48406 worker2 # [ 156.558563] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.53 seconds) subtest: queue gauges show a burst while every build blocks lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]' client # [ 156.938577] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # Running as unit: burst.service; invocation ID: 2d91f39f784b4c699d312835155856ed client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 157.061646] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 157.072960] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) client # [ 157.103334] nix[1507]: don't know how to build these paths: client # [ 157.104213] nix[1507]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv client # [ 157.105176] nix[1507]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv client # [ 157.106093] nix[1507]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv client # [ 157.107722] nix[1507]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker2 # [ 157.101995] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=want client=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=0 worker2 # [ 157.106643] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 157.110982] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=want client=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=0 worker2 # [ 157.114948] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 157.119394] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=want client=1 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=0 worker2 # [ 157.123424] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=want client=1 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=0 worker2 # [ 157.145800] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker1 # [ 157.140813] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker2 # [ 157.157114] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker1 # [ 157.151813] nix-grpc-daemon[1845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5) client # [ 157.180205] nix[1507]: copying 1 paths to 'lb:50051'... worker2 # [ 157.168209] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 client # [ 157.183145] nix[1507]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'... worker2 # [ 157.178815] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker1 # [ 157.215255] nix-grpc-daemon[1845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 2/5) worker1 # [ 157.232710] nix-grpc-daemon[1845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 265 ms (attempt 3/5) worker2 # [ 157.278117] nix-daemon[873]: accepted connection from pid 1773, user nix-grpc-daemon (trusted) worker2 # [ 157.290499] nix-daemon[873]: reaped child process 1776, status = succeeded lb # [ 157.272777] niks3-server[1146]: 2026/09/23 05:14:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 157.309690] nix-grpc-daemon[1605]: time=2026-09-23T05:14:10.499Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 157.311647] nix-grpc-daemon[1605]: time=2026-09-23T05:14:10.501Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)" lb # [ 157.313914] niks3-server[1146]: 2026/09/23 05:14:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 157.320247] niks3-server[1146]: 2026/09/23 05:14:09 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst lb # [ 157.341382] niks3-server[1146]: 2026/09/23 05:14:09 INFO Signed narinfos id=62 count=1 worker2 # [ 157.368470] nix-grpc-daemon[1605]: time=2026-09-23T05:14:10.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.344155] niks3-server[1146]: 2026/09/23 05:14:09 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls lb # [ 157.349349] niks3-server[1146]: 2026/09/23 05:14:09 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 157.354080] niks3-server[1146]: 2026/09/23 05:14:09 INFO Completed upload id=62 worker2 # [ 157.381224] nix-grpc-daemon[1605]: time=2026-09-23T05:14:10.571Z level=INFO msg="Upload complete. (189ms)" lb # [ 157.359405] niks3-server[1146]: 2026/09/23 05:14:09 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo worker2 # [ 157.386080] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 157.392278] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 157.404108] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 157.412287] nix-daemon[873]: reaped child process 1771, status = succeeded worker2 # [ 157.420210] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # [ 157.433079] nix[1507]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051... worker1 # [ 157.505184] nix-grpc-daemon[1845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 571 ms (attempt 4/5) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 158.079848] nix-grpc-daemon[1845]: disabling binary cache 'https://cache.nixos.org' for 60 seconds lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 158.083532] nix-grpc-daemon[1845]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 158.097515] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 client # [ 158.126904] nix[1507]: copying 1 paths to 'lb:50051'... lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 158.108251] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 client # [ 158.128896] nix[1507]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'... worker1 # [ 158.121181] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 158.141993] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:11Z level=info event=niks3_push_started pid=1906 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 158.259531] nix-grpc-daemon[1906]: time=2026-09-23T05:14:11.303Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 158.349464] nix-daemon[850]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker1 # [ 158.363219] nix-daemon[850]: reaped child process 1926, status = succeeded lb # [ 158.348240] niks3-server[1146]: 2026/09/23 05:14:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.381708] nix-grpc-daemon[1906]: time=2026-09-23T05:14:11.426Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.383249] nix-grpc-daemon[1906]: time=2026-09-23T05:14:11.427Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)" lb # [ 158.388401] niks3-server[1146]: 2026/09/23 05:14:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 158.416484] nix-grpc-daemon[1906]: time=2026-09-23T05:14:11.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.394458] niks3-server[1146]: 2026/09/23 05:14:10 INFO Signed narinfos id=63 count=1 lb # [ 158.399383] niks3-server[1146]: 2026/09/23 05:14:10 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls lb # [ 158.412690] niks3-server[1146]: 2026/09/23 05:14:10 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst lb # [ 158.414356] niks3-server[1146]: 2026/09/23 05:14:10 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 158.422143] niks3-server[1146]: 2026/09/23 05:14:10 INFO Completed upload id=63 worker1 # [ 158.444316] nix-grpc-daemon[1906]: time=2026-09-23T05:14:11.488Z level=INFO msg="Upload complete. (181ms)" lb # [ 158.424061] niks3-server[1146]: 2026/09/23 05:14:10 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo worker1 # [ 158.447420] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 158.452205] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 158.460250] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 158.465281] nix-daemon[850]: reaped child process 1904, status = succeeded worker1 # [ 158.470191] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) client # [ 158.488411] nix[1507]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051... worker2 # [ 159.435686] nix-daemon[873]: reaped child process 1780, status = succeeded worker2 # [ 159.513903] nix-daemon[873]: accepted connection from pid 1808, user nix-grpc-daemon (trusted) worker2 # [ 159.525663] nix-daemon[873]: reaped child process 1811, status = succeeded lb # [ 159.506504] niks3-server[1146]: 2026/09/23 05:14:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 159.542459] nix-grpc-daemon[1605]: time=2026-09-23T05:14:12.732Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 159.544070] nix-grpc-daemon[1605]: time=2026-09-23T05:14:12.733Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)" lb # [ 159.551179] niks3-server[1146]: 2026/09/23 05:14:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 159.558071] niks3-server[1146]: 2026/09/23 05:14:11 INFO Signed narinfos id=64 count=1 worker2 # [ 159.589403] nix-grpc-daemon[1605]: time=2026-09-23T05:14:12.779Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.566983] niks3-server[1146]: 2026/09/23 05:14:11 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls lb # [ 159.571512] niks3-server[1146]: 2026/09/23 05:14:11 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst lb # [ 159.575440] niks3-server[1146]: 2026/09/23 05:14:11 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv lb # [ 159.585062] niks3-server[1146]: 2026/09/23 05:14:11 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 159.588740] niks3-server[1146]: 2026/09/23 05:14:11 INFO Completed upload id=64 worker2 # [ 159.615932] nix-grpc-daemon[1605]: time=2026-09-23T05:14:12.805Z level=INFO msg="Upload complete. (188ms)" lb # [ 159.591161] niks3-server[1146]: 2026/09/23 05:14:11 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo worker2 # [ 159.622184] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=2 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=2 outputs=1 worker2 # [ 159.632164] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:12Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 159.642489] nix-daemon[873]: reaped child process 1778, status = succeeded worker2 # [ 159.675802] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 159.687928] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 client # [ 159.712937] nix[1507]: copying 1 paths to 'lb:50051'... worker2 # [ 159.699722] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 client # [ 159.715263] nix[1507]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'... worker2 # [ 159.712159] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 159.810114] nix-daemon[873]: accepted connection from pid 1815, user nix-grpc-daemon (trusted) worker2 # [ 159.823173] nix-daemon[873]: reaped child process 1818, status = succeeded lb # [ 159.803383] niks3-server[1146]: 2026/09/23 05:14:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 159.839054] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.029Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 159.840583] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.030Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)" lb # [ 159.835524] niks3-server[1146]: 2026/09/23 05:14:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 159.867339] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.057Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.840202] niks3-server[1146]: 2026/09/23 05:14:12 INFO Signed narinfos id=65 count=1 lb # [ 159.849438] niks3-server[1146]: 2026/09/23 05:14:12 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls lb # [ 159.857096] niks3-server[1146]: 2026/09/23 05:14:12 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst lb # [ 159.867978] niks3-server[1146]: 2026/09/23 05:14:12 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 159.875200] niks3-server[1146]: 2026/09/23 05:14:12 INFO Completed upload id=65 worker2 # [ 159.902395] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.092Z level=INFO msg="Upload complete. (178ms)" lb # [ 159.880553] niks3-server[1146]: 2026/09/23 05:14:12 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo worker2 # [ 159.906653] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 159.912564] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 159.923493] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 159.933300] nix-daemon[873]: reaped child process 1813, status = succeeded worker2 # [ 159.938409] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # [ 159.950709] nix[1507]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051... worker2 # [ 160.551844] nix-daemon[873]: reaped child process 1822, status = succeeded worker2 # [ 160.628086] nix-daemon[873]: accepted connection from pid 1843, user nix-grpc-daemon (trusted) worker2 # [ 160.639931] nix-daemon[873]: reaped child process 1846, status = succeeded lb # [ 160.620553] niks3-server[1146]: 2026/09/23 05:14:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 160.656498] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.846Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 160.659059] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.848Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)" lb # [ 160.665693] niks3-server[1146]: 2026/09/23 05:14:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 160.698746] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.888Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.671381] niks3-server[1146]: 2026/09/23 05:14:12 INFO Signed narinfos id=66 count=1 lb # [ 160.680396] niks3-server[1146]: 2026/09/23 05:14:12 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst lb # [ 160.686373] niks3-server[1146]: 2026/09/23 05:14:12 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker1 # [ 160.711165] nix-daemon[850]: reaped child process 1930, status = succeeded lb # [ 160.695432] niks3-server[1146]: 2026/09/23 05:14:12 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls lb # [ 160.701203] niks3-server[1146]: 2026/09/23 05:14:12 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 160.705985] niks3-server[1146]: 2026/09/23 05:14:12 INFO Completed upload id=66 worker2 # [ 160.733533] nix-grpc-daemon[1605]: time=2026-09-23T05:14:13.923Z level=INFO msg="Upload complete. (190ms)" lb # [ 160.708357] niks3-server[1146]: 2026/09/23 05:14:12 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo worker2 # [ 160.739742] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=3 outputs=1 worker2 # [ 160.747356] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:13Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 160.758075] nix-daemon[873]: reaped child process 1820, status = succeeded worker2 # [ 160.783072] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 160.795208] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker1 # [ 160.794474] nix-daemon[850]: accepted connection from pid 1955, user nix-grpc-daemon (trusted) client # [ 160.818811] nix[1507]: copying 1 paths to 'lb:50051'... worker2 # [ 160.806320] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 client # [ 160.821530] nix[1507]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'... worker1 # [ 160.808484] nix-daemon[850]: reaped child process 1958, status = succeeded worker2 # [ 160.818169] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) lb # [ 160.792802] niks3-server[1146]: 2026/09/23 05:14:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.823263] nix-grpc-daemon[1906]: time=2026-09-23T05:14:13.867Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.824859] nix-grpc-daemon[1906]: time=2026-09-23T05:14:13.869Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)" lb # [ 160.830461] niks3-server[1146]: 2026/09/23 05:14:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 160.832732] niks3-server[1146]: 2026/09/23 05:14:13 INFO Signed narinfos id=67 count=1 worker1 # [ 160.856365] nix-grpc-daemon[1906]: time=2026-09-23T05:14:13.900Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.837360] niks3-server[1146]: 2026/09/23 05:14:13 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls lb # [ 160.839380] niks3-server[1146]: 2026/09/23 05:14:13 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst lb # [ 160.846156] niks3-server[1146]: 2026/09/23 05:14:13 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 160.849192] niks3-server[1146]: 2026/09/23 05:14:13 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv lb # [ 160.853850] niks3-server[1146]: 2026/09/23 05:14:13 INFO Completed upload id=67 worker1 # [ 160.877495] nix-grpc-daemon[1906]: time=2026-09-23T05:14:13.921Z level=INFO msg="Upload complete. (198ms)" lb # [ 160.855831] niks3-server[1146]: 2026/09/23 05:14:13 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo worker1 # [ 160.881237] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=2 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=1 outputs=1 worker1 # [ 160.888238] nix-daemon[850]: reaped child process 1928, status = succeeded worker2 # [ 160.913459] nix-daemon[873]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker2 # [ 160.926128] nix-daemon[873]: reaped child process 1853, status = succeeded lb # [ 160.907293] niks3-server[1146]: 2026/09/23 05:14:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 160.942218] nix-grpc-daemon[1605]: time=2026-09-23T05:14:14.132Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 160.943844] nix-grpc-daemon[1605]: time=2026-09-23T05:14:14.133Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)" lb # [ 160.936607] niks3-server[1146]: 2026/09/23 05:14:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 160.939239] niks3-server[1146]: 2026/09/23 05:14:13 INFO Signed narinfos id=68 count=1 worker2 # [ 160.966661] nix-grpc-daemon[1605]: time=2026-09-23T05:14:14.156Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.943881] niks3-server[1146]: 2026/09/23 05:14:13 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls lb # [ 160.946882] niks3-server[1146]: 2026/09/23 05:14:13 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst lb # [ 160.949868] niks3-server[1146]: 2026/09/23 05:14:13 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 160.953685] niks3-server[1146]: 2026/09/23 05:14:13 INFO Completed upload id=68 worker2 # [ 160.980968] nix-grpc-daemon[1605]: time=2026-09-23T05:14:14.171Z level=INFO msg="Upload complete. (152ms)" lb # [ 160.955929] niks3-server[1146]: 2026/09/23 05:14:13 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo worker2 # [ 160.982955] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 160.987672] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 160.993308] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 160.995532] nix-daemon[873]: reaped child process 1848, status = succeeded worker2 # [ 161.000602] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # [ 161.013689] nix[1507]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051... worker2 # [ 162.815622] nix-daemon[873]: reaped child process 1857, status = succeeded worker2 # [ 162.893088] nix-daemon[873]: accepted connection from pid 1882, user nix-grpc-daemon (trusted) worker2 # [ 162.904462] nix-daemon[873]: reaped child process 1885, status = succeeded lb # [ 162.886436] niks3-server[1146]: 2026/09/23 05:14:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 162.922221] nix-grpc-daemon[1605]: time=2026-09-23T05:14:16.112Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 162.923824] nix-grpc-daemon[1605]: time=2026-09-23T05:14:16.113Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)" lb # [ 162.926181] niks3-server[1146]: 2026/09/23 05:14:15 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls lb # [ 162.936182] niks3-server[1146]: 2026/09/23 05:14:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 162.944477] niks3-server[1146]: 2026/09/23 05:14:15 INFO Signed narinfos id=69 count=1 worker2 # [ 162.974795] nix-grpc-daemon[1605]: time=2026-09-23T05:14:16.164Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.949422] niks3-server[1146]: 2026/09/23 05:14:15 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 162.961611] niks3-server[1146]: 2026/09/23 05:14:15 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 162.966459] niks3-server[1146]: 2026/09/23 05:14:15 INFO Completed upload id=69 lb # [ 162.968633] niks3-server[1146]: 2026/09/23 05:14:15 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker2 # [ 162.995073] nix-grpc-daemon[1605]: time=2026-09-23T05:14:16.185Z level=INFO msg="Upload complete. (187ms)" lb # [ 162.971040] niks3-server[1146]: 2026/09/23 05:14:15 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo worker2 # [ 163.002551] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=4 outputs=1 worker2 # [ 163.015270] nix-daemon[873]: reaped child process 1855, status = succeeded client # [ 163.052177] systemd[1]: burst.service: Deactivated successfully. client # [ 163.056146] systemd[1]: burst.service: Consumed 166ms CPU time over 6.117s wall clock time, 55.9M memory peak, 14.3K incoming IP traffic, 19.2K outgoing IP traffic. client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; } client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: queue gauges show a burst while every build blocks, in 7.35 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 164.281241] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36948 worker2 # [ 164.295479] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 164.337173] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:17Z level=debug event=want client=2 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 164.341307] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:17Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 164.345538] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:17Z level=debug event=want client=2 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 164.349750] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:17Z level=debug event=want client=2 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 164.378073] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 164.391600] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 164.403087] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 164.414506] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 164.517222] nix-daemon[850]: accepted connection from pid 1974, user nix-grpc-daemon (trusted) worker1 # [ 164.530164] nix-daemon[850]: reaped child process 1977, status = succeeded lb # [ 164.517611] niks3-server[1146]: 2026/09/23 05:14:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.547401] nix-grpc-daemon[1906]: time=2026-09-23T05:14:17.591Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 164.549459] nix-grpc-daemon[1906]: time=2026-09-23T05:14:17.593Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 164.548929] niks3-server[1146]: 2026/09/23 05:14:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 164.553431] niks3-server[1146]: 2026/09/23 05:14:16 INFO Signed narinfos id=70 count=1 worker1 # [ 164.578147] nix-grpc-daemon[1906]: time=2026-09-23T05:14:17.622Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.560145] niks3-server[1146]: 2026/09/23 05:14:16 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 164.564604] niks3-server[1146]: 2026/09/23 05:14:16 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 164.574729] niks3-server[1146]: 2026/09/23 05:14:16 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 164.578099] niks3-server[1146]: 2026/09/23 05:14:16 INFO Completed upload id=70 worker1 # [ 164.600271] nix-grpc-daemon[1906]: time=2026-09-23T05:14:17.644Z level=INFO msg="Upload complete. (174ms)" lb # [ 164.580087] niks3-server[1146]: 2026/09/23 05:14:16 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 164.604309] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 164.609048] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 164.618470] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 164.623120] nix-daemon[850]: reaped child process 1972, status = succeeded worker1 # [ 164.628261] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 165.264823] nix-daemon[850]: reaped child process 1981, status = succeeded worker1 # [ 165.341848] nix-daemon[850]: accepted connection from pid 1997, user nix-grpc-daemon (trusted) worker1 # [ 165.354353] nix-daemon[850]: reaped child process 2000, status = succeeded lb # [ 165.339466] niks3-server[1146]: 2026/09/23 05:14:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.370455] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.414Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 165.371971] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.414Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 165.377164] niks3-server[1146]: 2026/09/23 05:14:17 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 165.385142] niks3-server[1146]: 2026/09/23 05:14:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 165.391147] niks3-server[1146]: 2026/09/23 05:14:17 INFO Signed narinfos id=71 count=1 worker1 # [ 165.416779] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.399135] niks3-server[1146]: 2026/09/23 05:14:17 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 165.406406] niks3-server[1146]: 2026/09/23 05:14:17 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 165.414993] niks3-server[1146]: 2026/09/23 05:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 165.418183] niks3-server[1146]: 2026/09/23 05:14:17 INFO Completed upload id=71 worker1 # [ 165.440387] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.484Z level=INFO msg="Upload complete. (205ms)" lb # [ 165.420874] niks3-server[1146]: 2026/09/23 05:14:17 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 165.446476] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=5 outputs=1 worker2 # [ 165.452931] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:18Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 165.454975] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker2 # [ 165.462715] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:18Z level=debug event=want client=2 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 165.465828] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 165.474849] nix-daemon[850]: reaped child process 1979, status = succeeded worker1 # [ 165.478413] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 165.482753] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 165.565762] nix-daemon[850]: accepted connection from pid 2004, user nix-grpc-daemon (trusted) worker1 # [ 165.579241] nix-daemon[850]: reaped child process 2007, status = succeeded lb # [ 165.563373] niks3-server[1146]: 2026/09/23 05:14:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.594348] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.638Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 165.596354] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.640Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 165.592363] niks3-server[1146]: 2026/09/23 05:14:17 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 165.603576] niks3-server[1146]: 2026/09/23 05:14:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 165.609776] niks3-server[1146]: 2026/09/23 05:14:17 INFO Signed narinfos id=72 count=1 worker1 # [ 165.634700] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.615713] niks3-server[1146]: 2026/09/23 05:14:17 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 165.627355] niks3-server[1146]: 2026/09/23 05:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 165.631455] niks3-server[1146]: 2026/09/23 05:14:17 INFO Completed upload id=72 worker1 # [ 165.653669] nix-grpc-daemon[1906]: time=2026-09-23T05:14:18.698Z level=INFO msg="Upload complete. (166ms)" lb # [ 165.633812] niks3-server[1146]: 2026/09/23 05:14:17 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 165.656900] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 165.661726] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 165.670786] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 165.679215] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 165.681488] nix-daemon[850]: reaped child process 2002, status = succeeded lb # [ 165.707842] envoy[910]: conn peer=[2001:db8:1::1]:32808 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9690 tx=5227 ms=5953 worker1 # [ 166.495346] nix-daemon[850]: reaped child process 2011, status = succeeded worker1 # [ 166.569872] nix-daemon[850]: accepted connection from pid 2027, user nix-grpc-daemon (trusted) worker1 # [ 166.583908] nix-daemon[850]: reaped child process 2030, status = succeeded lb # [ 166.567085] niks3-server[1146]: 2026/09/23 05:14:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.599506] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.643Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.601500] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.645Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 166.608174] niks3-server[1146]: 2026/09/23 05:14:18 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 166.614950] niks3-server[1146]: 2026/09/23 05:14:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign worker1 # [ 166.647894] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.692Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.625722] niks3-server[1146]: 2026/09/23 05:14:18 INFO Signed narinfos id=73 count=1 lb # [ 166.629840] niks3-server[1146]: 2026/09/23 05:14:18 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 166.634229] niks3-server[1146]: 2026/09/23 05:14:18 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 166.647082] niks3-server[1146]: 2026/09/23 05:14:18 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 166.651206] niks3-server[1146]: 2026/09/23 05:14:18 INFO Completed upload id=73 worker1 # [ 166.673465] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.717Z level=INFO msg="Upload complete. (186ms)" lb # [ 166.652931] niks3-server[1146]: 2026/09/23 05:14:18 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 166.679800] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=6 outputs=1 worker2 # [ 166.688124] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:19Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 166.695886] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:19Z level=debug event=want client=2 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 166.694867] nix-daemon[850]: reaped child process 2009, status = succeeded worker1 # [ 166.726816] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 166.739266] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 166.751721] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 166.761173] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 166.857961] nix-daemon[850]: accepted connection from pid 2034, user nix-grpc-daemon (trusted) worker1 # [ 166.871170] nix-daemon[850]: reaped child process 2037, status = succeeded lb # [ 166.856110] niks3-server[1146]: 2026/09/23 05:14:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.886100] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.930Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.887618] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.932Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 166.888845] niks3-server[1146]: 2026/09/23 05:14:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker1 # [ 166.920142] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.964Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.897546] niks3-server[1146]: 2026/09/23 05:14:19 INFO Signed narinfos id=74 count=1 lb # [ 166.903346] niks3-server[1146]: 2026/09/23 05:14:19 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 166.910230] niks3-server[1146]: 2026/09/23 05:14:19 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 166.921558] niks3-server[1146]: 2026/09/23 05:14:19 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 166.928198] niks3-server[1146]: 2026/09/23 05:14:19 INFO Completed upload id=74 worker1 # [ 166.950499] nix-grpc-daemon[1906]: time=2026-09-23T05:14:19.994Z level=INFO msg="Upload complete. (177ms)" lb # [ 166.932433] niks3-server[1146]: 2026/09/23 05:14:19 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 166.954773] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 166.961263] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 166.973112] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 166.981298] nix-daemon[850]: reaped child process 2032, status = succeeded worker1 # [ 166.985776] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 167.810114] nix-daemon[850]: reaped child process 2041, status = succeeded worker1 # [ 167.880080] nix-daemon[850]: accepted connection from pid 2057, user nix-grpc-daemon (trusted) worker1 # [ 167.893380] nix-daemon[850]: reaped child process 2060, status = succeeded lb # [ 167.877744] niks3-server[1146]: 2026/09/23 05:14:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.909293] nix-grpc-daemon[1906]: time=2026-09-23T05:14:20.952Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 167.910703] nix-grpc-daemon[1906]: time=2026-09-23T05:14:20.952Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 167.918968] niks3-server[1146]: 2026/09/23 05:14:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 167.925459] niks3-server[1146]: 2026/09/23 05:14:20 INFO Signed narinfos id=75 count=1 worker1 # [ 167.950620] nix-grpc-daemon[1906]: time=2026-09-23T05:14:20.994Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.935872] niks3-server[1146]: 2026/09/23 05:14:20 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 167.941804] niks3-server[1146]: 2026/09/23 05:14:20 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 167.947179] niks3-server[1146]: 2026/09/23 05:14:20 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 167.956744] niks3-server[1146]: 2026/09/23 05:14:20 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 167.960223] niks3-server[1146]: 2026/09/23 05:14:20 INFO Completed upload id=75 worker1 # [ 167.982561] nix-grpc-daemon[1906]: time=2026-09-23T05:14:21.026Z level=INFO msg="Upload complete. (190ms)" lb # [ 167.962948] niks3-server[1146]: 2026/09/23 05:14:20 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 167.988670] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=7 outputs=1 worker2 # [ 167.995513] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:21Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 167.997306] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker2 # [ 168.004817] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:21Z level=debug event=want client=2 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 168.009530] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 168.017156] nix-daemon[850]: reaped child process 2039, status = succeeded worker1 # [ 168.018920] nix-grpc-daemon[1906]: time=2026-09-23T05:14:21.063Z level=INFO msg="All 1 paths already cached" worker1 # [ 168.022924] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 168.027856] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 168.109180] nix-daemon[850]: accepted connection from pid 2064, user nix-grpc-daemon (trusted) worker1 # [ 168.121979] nix-daemon[850]: reaped child process 2067, status = succeeded lb # [ 168.106907] niks3-server[1146]: 2026/09/23 05:14:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.136803] nix-grpc-daemon[1906]: time=2026-09-23T05:14:21.181Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 168.138440] nix-grpc-daemon[1906]: time=2026-09-23T05:14:21.182Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 168.140238] niks3-server[1146]: 2026/09/23 05:14:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 168.169483] nix-grpc-daemon[1906]: time=2026-09-23T05:14:21.213Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.147299] niks3-server[1146]: 2026/09/23 05:14:20 INFO Signed narinfos id=76 count=1 lb # [ 168.154629] niks3-server[1146]: 2026/09/23 05:14:20 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 168.158850] niks3-server[1146]: 2026/09/23 05:14:20 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 168.172115] niks3-server[1146]: 2026/09/23 05:14:20 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete worker1 # [ 168.198880] nix-grpc-daemon[1906]: time=2026-09-23T05:14:21.243Z level=INFO msg="Upload complete. (166ms)" lb # [ 168.177274] niks3-server[1146]: 2026/09/23 05:14:20 INFO Completed upload id=76 worker1 # [ 168.201402] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 168.183055] niks3-server[1146]: 2026/09/23 05:14:20 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 168.206604] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 168.218138] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 168.222352] nix-daemon[850]: reaped child process 2062, status = succeeded worker1 # [ 168.226981] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 169.042172] nix-daemon[850]: reaped child process 2071, status = succeeded worker1 # [ 169.115298] nix-daemon[850]: accepted connection from pid 2087, user nix-grpc-daemon (trusted) worker1 # [ 169.128495] nix-daemon[850]: reaped child process 2090, status = succeeded lb # [ 169.113886] niks3-server[1146]: 2026/09/23 05:14:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.144983] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.189Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 169.148060] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.190Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 169.160134] niks3-server[1146]: 2026/09/23 05:14:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 169.166369] niks3-server[1146]: 2026/09/23 05:14:21 INFO Signed narinfos id=77 count=1 worker1 # [ 169.191724] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.236Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.171759] niks3-server[1146]: 2026/09/23 05:14:21 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 169.176351] niks3-server[1146]: 2026/09/23 05:14:21 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 169.180908] niks3-server[1146]: 2026/09/23 05:14:21 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 169.190780] niks3-server[1146]: 2026/09/23 05:14:21 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 169.194533] niks3-server[1146]: 2026/09/23 05:14:21 INFO Completed upload id=77 worker1 # [ 169.216812] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.261Z level=INFO msg="Upload complete. (183ms)" lb # [ 169.196298] niks3-server[1146]: 2026/09/23 05:14:21 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 169.222499] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=8 outputs=1 worker2 # [ 169.229466] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:22Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 169.230974] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker2 # [ 169.239365] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:22Z level=debug event=want client=2 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 169.241477] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 169.249650] nix-daemon[850]: reaped child process 2069, status = succeeded worker1 # [ 169.251748] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.296Z level=INFO msg="All 1 paths already cached" worker1 # [ 169.255958] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 169.260867] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 169.345240] nix-daemon[850]: accepted connection from pid 2094, user nix-grpc-daemon (trusted) worker1 # [ 169.358319] nix-daemon[850]: reaped child process 2097, status = succeeded lb # [ 169.343061] niks3-server[1146]: 2026/09/23 05:14:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.373804] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.418Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 169.375746] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.419Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 169.373294] niks3-server[1146]: 2026/09/23 05:14:21 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 169.383542] niks3-server[1146]: 2026/09/23 05:14:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign worker1 # [ 169.411119] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.455Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.389320] niks3-server[1146]: 2026/09/23 05:14:21 INFO Signed narinfos id=78 count=1 lb # [ 169.395889] niks3-server[1146]: 2026/09/23 05:14:21 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 169.405115] niks3-server[1146]: 2026/09/23 05:14:21 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete lb # [ 169.411206] niks3-server[1146]: 2026/09/23 05:14:21 INFO Completed upload id=78 worker1 # [ 169.433387] nix-grpc-daemon[1906]: time=2026-09-23T05:14:22.477Z level=INFO msg="Upload complete. (167ms)" lb # [ 169.415728] niks3-server[1146]: 2026/09/23 05:14:21 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 169.437333] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 169.442686] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 169.455256] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 169.458329] nix-daemon[850]: reaped child process 2092, status = succeeded worker1 # [ 169.462377] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 170.699879] nix-daemon[850]: reaped child process 2101, status = succeeded worker1 # [ 170.783094] nix-daemon[850]: accepted connection from pid 2117, user nix-grpc-daemon (trusted) worker1 # [ 170.795374] nix-daemon[850]: reaped child process 2120, status = succeeded lb # [ 170.780446] niks3-server[1146]: 2026/09/23 05:14:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.811093] nix-grpc-daemon[1906]: time=2026-09-23T05:14:23.855Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 170.813758] nix-grpc-daemon[1906]: time=2026-09-23T05:14:23.857Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 170.818932] niks3-server[1146]: 2026/09/23 05:14:23 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 170.826244] niks3-server[1146]: 2026/09/23 05:14:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign worker1 # [ 170.856131] nix-grpc-daemon[1906]: time=2026-09-23T05:14:23.900Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.833711] niks3-server[1146]: 2026/09/23 05:14:23 INFO Signed narinfos id=79 count=1 lb # [ 170.838804] niks3-server[1146]: 2026/09/23 05:14:23 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 170.846444] niks3-server[1146]: 2026/09/23 05:14:23 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 170.852150] niks3-server[1146]: 2026/09/23 05:14:23 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 170.857462] niks3-server[1146]: 2026/09/23 05:14:23 INFO Completed upload id=79 worker1 # [ 170.879764] nix-grpc-daemon[1906]: time=2026-09-23T05:14:23.924Z level=INFO msg="Upload complete. (208ms)" lb # [ 170.859377] niks3-server[1146]: 2026/09/23 05:14:23 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 170.885873] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=9 outputs=1 worker2 # [ 170.894523] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:24Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 170.902540] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:24Z level=debug event=want client=2 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 170.900819] nix-daemon[850]: reaped child process 2099, status = succeeded worker1 # [ 170.933215] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 170.945709] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 170.959100] nix-grpc-daemon[1906]: time=2026-09-23T05:14:24.003Z level=INFO msg="All 1 paths already cached" worker1 # [ 170.966643] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 170.974696] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 171.069601] nix-daemon[850]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker1 # [ 171.083251] nix-daemon[850]: reaped child process 2127, status = succeeded lb # [ 171.067348] niks3-server[1146]: 2026/09/23 05:14:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.097202] nix-grpc-daemon[1906]: time=2026-09-23T05:14:24.141Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 171.098653] nix-grpc-daemon[1906]: time=2026-09-23T05:14:24.143Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 171.097387] niks3-server[1146]: 2026/09/23 05:14:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign lb # [ 171.106635] niks3-server[1146]: 2026/09/23 05:14:23 INFO Signed narinfos id=80 count=1 worker1 # [ 171.131763] nix-grpc-daemon[1906]: time=2026-09-23T05:14:24.176Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.110450] niks3-server[1146]: 2026/09/23 05:14:23 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 171.117813] niks3-server[1146]: 2026/09/23 05:14:23 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 171.129781] niks3-server[1146]: 2026/09/23 05:14:23 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete worker1 # [ 171.158148] nix-grpc-daemon[1906]: time=2026-09-23T05:14:24.202Z level=INFO msg="Upload complete. (171ms)" lb # [ 171.135980] niks3-server[1146]: 2026/09/23 05:14:23 INFO Completed upload id=80 worker1 # [ 171.160707] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 171.143229] niks3-server[1146]: 2026/09/23 05:14:23 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 171.166059] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 171.176113] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 171.183179] nix-daemon[850]: reaped child process 2122, status = succeeded worker1 # [ 171.186274] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 172.227243] nix-daemon[850]: reaped child process 2131, status = succeeded worker1 # [ 172.307729] nix-daemon[850]: accepted connection from pid 2147, user nix-grpc-daemon (trusted) worker1 # [ 172.319242] nix-daemon[850]: reaped child process 2150, status = succeeded lb # [ 172.306510] niks3-server[1146]: 2026/09/23 05:14:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.338374] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.382Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 172.339978] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.384Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 172.353267] niks3-server[1146]: 2026/09/23 05:14:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign worker1 # [ 172.381572] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.425Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.359157] niks3-server[1146]: 2026/09/23 05:14:24 INFO Signed narinfos id=81 count=1 lb # [ 172.368115] niks3-server[1146]: 2026/09/23 05:14:24 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 172.376112] niks3-server[1146]: 2026/09/23 05:14:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 172.380742] niks3-server[1146]: 2026/09/23 05:14:24 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 172.390127] niks3-server[1146]: 2026/09/23 05:14:24 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 172.394490] niks3-server[1146]: 2026/09/23 05:14:24 INFO Completed upload id=81 worker1 # [ 172.416902] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.461Z level=INFO msg="Upload complete. (222ms)" lb # [ 172.398672] niks3-server[1146]: 2026/09/23 05:14:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 172.422350] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=10 outputs=1 worker2 # [ 172.429709] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:25Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 172.436787] nix-daemon[850]: reaped child process 2129, status = succeeded worker2 # [ 172.440310] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:25Z level=debug event=want client=2 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 172.474806] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 172.487953] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 172.501622] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.545Z level=INFO msg="All 2 paths already cached" worker1 # [ 172.509774] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 172.520183] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 172.616389] nix-daemon[850]: accepted connection from pid 2154, user nix-grpc-daemon (trusted) worker1 # [ 172.631429] nix-daemon[850]: reaped child process 2157, status = succeeded lb # [ 172.614682] niks3-server[1146]: 2026/09/23 05:14:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.645693] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.690Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 172.647243] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.691Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 172.649454] niks3-server[1146]: 2026/09/23 05:14:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 172.658560] niks3-server[1146]: 2026/09/23 05:14:24 INFO Signed narinfos id=82 count=1 worker1 # [ 172.683626] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.728Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.662264] niks3-server[1146]: 2026/09/23 05:14:24 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 172.667694] niks3-server[1146]: 2026/09/23 05:14:24 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 172.680542] niks3-server[1146]: 2026/09/23 05:14:24 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 172.686628] niks3-server[1146]: 2026/09/23 05:14:24 INFO Completed upload id=82 worker1 # [ 172.708749] nix-grpc-daemon[1906]: time=2026-09-23T05:14:25.753Z level=INFO msg="Upload complete. (175ms)" worker1 # [ 172.712901] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 172.692823] niks3-server[1146]: 2026/09/23 05:14:24 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 172.719683] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 172.729306] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 172.737761] nix-daemon[850]: reaped child process 2152, status = succeeded worker1 # [ 172.742442] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 173.979390] nix-daemon[850]: reaped child process 2161, status = succeeded worker1 # [ 174.062475] nix-daemon[850]: accepted connection from pid 2177, user nix-grpc-daemon (trusted) worker1 # [ 174.076043] nix-daemon[850]: reaped child process 2180, status = succeeded lb # [ 174.060786] niks3-server[1146]: 2026/09/23 05:14:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.091336] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.135Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 174.092833] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.137Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 174.100187] niks3-server[1146]: 2026/09/23 05:14:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign worker1 # [ 174.131964] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.176Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.110149] niks3-server[1146]: 2026/09/23 05:14:26 INFO Signed narinfos id=83 count=1 lb # [ 174.116565] niks3-server[1146]: 2026/09/23 05:14:26 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 174.122922] niks3-server[1146]: 2026/09/23 05:14:26 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 174.128552] niks3-server[1146]: 2026/09/23 05:14:26 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 174.137524] niks3-server[1146]: 2026/09/23 05:14:26 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 174.143153] niks3-server[1146]: 2026/09/23 05:14:26 INFO Completed upload id=83 worker1 # [ 174.165563] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.209Z level=INFO msg="Upload complete. (213ms)" lb # [ 174.145445] niks3-server[1146]: 2026/09/23 05:14:26 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 174.171771] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=11 outputs=1 worker2 # [ 174.178850] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:27Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 174.187437] nix-daemon[850]: reaped child process 2159, status = succeeded worker1 # [ 174.216892] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 174.229266] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 174.242283] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.286Z level=INFO msg="All 2 paths already cached" worker1 # [ 174.251222] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 174.258744] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 174.355123] nix-daemon[850]: accepted connection from pid 2184, user nix-grpc-daemon (trusted) worker1 # [ 174.367894] nix-daemon[850]: reaped child process 2187, status = succeeded lb # [ 174.353270] niks3-server[1146]: 2026/09/23 05:14:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.383511] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.427Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 174.385041] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.429Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 174.387156] niks3-server[1146]: 2026/09/23 05:14:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign lb # [ 174.394724] niks3-server[1146]: 2026/09/23 05:14:26 INFO Signed narinfos id=84 count=1 worker1 # [ 174.420796] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.465Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.401140] niks3-server[1146]: 2026/09/23 05:14:26 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 174.406454] niks3-server[1146]: 2026/09/23 05:14:26 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 174.418800] niks3-server[1146]: 2026/09/23 05:14:26 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 174.422635] niks3-server[1146]: 2026/09/23 05:14:26 INFO Completed upload id=84 worker1 # [ 174.446946] nix-grpc-daemon[1906]: time=2026-09-23T05:14:27.491Z level=INFO msg="Upload complete. (175ms)" worker1 # [ 174.451354] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 174.456508] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 174.468102] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 174.476534] nix-daemon[850]: reaped child process 2182, status = succeeded worker1 # [ 174.479943] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 175.517995] nix-daemon[850]: reaped child process 2191, status = succeeded worker1 # [ 175.597363] nix-daemon[850]: accepted connection from pid 2207, user nix-grpc-daemon (trusted) worker1 # [ 175.609210] nix-daemon[850]: reaped child process 2210, status = succeeded lb # [ 175.594944] niks3-server[1146]: 2026/09/23 05:14:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 175.626432] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.670Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 175.628398] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.672Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 175.635882] niks3-server[1146]: 2026/09/23 05:14:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign worker1 # [ 175.663041] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.640619] niks3-server[1146]: 2026/09/23 05:14:27 INFO Signed narinfos id=85 count=1 lb # [ 175.648737] niks3-server[1146]: 2026/09/23 05:14:27 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 175.653185] niks3-server[1146]: 2026/09/23 05:14:27 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 175.660333] niks3-server[1146]: 2026/09/23 05:14:27 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 175.664859] niks3-server[1146]: 2026/09/23 05:14:27 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 175.667629] niks3-server[1146]: 2026/09/23 05:14:27 INFO Completed upload id=85 worker1 # [ 175.689912] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.734Z level=INFO msg="Upload complete. (202ms)" lb # [ 175.670787] niks3-server[1146]: 2026/09/23 05:14:27 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 175.694516] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=12 outputs=1 worker2 # [ 175.702502] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:28Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 175.708296] nix-daemon[850]: reaped child process 2189, status = succeeded worker1 # [ 175.740706] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 175.752709] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 175.764376] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.808Z level=INFO msg="All 2 paths already cached" worker1 # [ 175.772551] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 175.783159] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 175.876848] nix-daemon[850]: accepted connection from pid 2214, user nix-grpc-daemon (trusted) worker1 # [ 175.890107] nix-daemon[850]: reaped child process 2217, status = succeeded lb # [ 175.874697] niks3-server[1146]: 2026/09/23 05:14:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 175.905280] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.949Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 175.906843] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.951Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 175.902601] niks3-server[1146]: 2026/09/23 05:14:28 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 175.913150] niks3-server[1146]: 2026/09/23 05:14:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/86/sign lb # [ 175.918787] niks3-server[1146]: 2026/09/23 05:14:28 INFO Signed narinfos id=86 count=1 worker1 # [ 175.943588] nix-grpc-daemon[1906]: time=2026-09-23T05:14:28.988Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.930570] niks3-server[1146]: 2026/09/23 05:14:28 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 175.937227] niks3-server[1146]: 2026/09/23 05:14:28 INFO Received complete upload request method=POST path=/api/pending_closures/86/complete lb # [ 175.941258] niks3-server[1146]: 2026/09/23 05:14:28 INFO Completed upload id=86 worker1 # [ 175.964543] nix-grpc-daemon[1906]: time=2026-09-23T05:14:29.009Z level=INFO msg="Upload complete. (171ms)" lb # [ 175.944393] niks3-server[1146]: 2026/09/23 05:14:28 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 175.967979] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 175.972953] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 worker1 # [ 175.982478] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 175.990577] nix-daemon[850]: reaped child process 2212, status = succeeded worker1 # [ 175.994857] nix-daemon[850]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 176.834940] nix-daemon[850]: reaped child process 2221, status = succeeded worker1 # [ 176.914676] nix-daemon[850]: accepted connection from pid 2237, user nix-grpc-daemon (trusted) worker1 # [ 176.927564] nix-daemon[850]: reaped child process 2240, status = succeeded lb # [ 176.913796] niks3-server[1146]: 2026/09/23 05:14:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.945113] nix-grpc-daemon[1906]: time=2026-09-23T05:14:29.989Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 176.946772] nix-grpc-daemon[1906]: time=2026-09-23T05:14:29.991Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 176.956119] niks3-server[1146]: 2026/09/23 05:14:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/87/sign worker1 # [ 176.986175] nix-grpc-daemon[1906]: time=2026-09-23T05:14:30.030Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.963714] niks3-server[1146]: 2026/09/23 05:14:29 INFO Signed narinfos id=87 count=1 lb # [ 176.968262] niks3-server[1146]: 2026/09/23 05:14:29 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 176.973279] niks3-server[1146]: 2026/09/23 05:14:29 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 176.978879] niks3-server[1146]: 2026/09/23 05:14:29 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 176.986166] niks3-server[1146]: 2026/09/23 05:14:29 INFO Received complete upload request method=POST path=/api/pending_closures/87/complete lb # [ 176.989277] niks3-server[1146]: 2026/09/23 05:14:29 INFO Completed upload id=87 worker1 # [ 177.012805] nix-grpc-daemon[1906]: time=2026-09-23T05:14:30.057Z level=INFO msg="Upload complete. (210ms)" lb # [ 176.992604] niks3-server[1146]: 2026/09/23 05:14:29 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 177.018869] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36948 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=13 outputs=1 worker1 # [ 177.033221] nix-daemon[850]: reaped child process 2219, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 12.93 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 177.166521] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 10a2252b04c34af69b7a57333e218aff client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 177.273530] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36948 client # [ 177.298263] nix[1581]: don't know how to build these paths: client # [ 177.299176] nix[1581]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 177.280694] nix-grpc-daemon[1845]: ts=2026-09-23T05:14:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36948 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client # [ 177.319100] nix[1581]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker worker2 # [ 177.305760] nix-grpc-daemon[1516]: ts=2026-09-23T05:14:30Z level=debug event=want client=3 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 185.707879] envoy[910]: conn peer=[2001:db8:1::1]:44766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27137 tx=12315 ms=12756 client # [ 207.319792] nix[1581]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 207.326132] nix[1581]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 207.342599] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 207.344053] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 207.346056] systemd[1]: gpu.service: Consumed 125ms CPU time over 30.179s wall clock time, 37.6M memory peak, 5.6K incoming IP traffic, 5.3K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.43 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 43.85 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.00 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 209.635907] nix-grpc-daemon[1845]: ts=2026-09-23T05:15:02Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 worker1 # [ 210.204198] nix-grpc-daemon[1845]: ts=2026-09-23T05:15:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36948 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 210.219885] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 210.242736] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=debug event=want client=4 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 210.247880] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 210.287136] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 210.299922] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 210.312690] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 210.321825] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 210.426437] nix-daemon[873]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker2 # [ 210.439858] nix-daemon[873]: reaped child process 1926, status = succeeded lb # [ 210.421178] niks3-server[1146]: 2026/09/23 05:15:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 210.458337] nix-grpc-daemon[1605]: time=2026-09-23T05:15:03.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 210.460360] nix-grpc-daemon[1605]: time=2026-09-23T05:15:03.649Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 210.455591] niks3-server[1146]: 2026/09/23 05:15:02 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 210.469799] niks3-server[1146]: 2026/09/23 05:15:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/88/sign lb # [ 210.478510] niks3-server[1146]: 2026/09/23 05:15:02 INFO Signed narinfos id=88 count=1 worker2 # [ 210.505710] nix-grpc-daemon[1605]: time=2026-09-23T05:15:03.695Z level=INFO msg="Uploading 1 narinfos" lb # [ 210.497123] niks3-server[1146]: 2026/09/23 05:15:02 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 210.503246] niks3-server[1146]: 2026/09/23 05:15:02 INFO Received complete upload request method=POST path=/api/pending_closures/88/complete lb # [ 210.505786] niks3-server[1146]: 2026/09/23 05:15:02 INFO Completed upload id=88 worker2 # [ 210.534425] nix-grpc-daemon[1605]: time=2026-09-23T05:15:03.724Z level=INFO msg="Upload complete. (198ms)" lb # [ 210.508829] niks3-server[1146]: 2026/09/23 05:15:02 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 210.539574] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 210.547458] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 210.558190] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 210.568245] nix-daemon[873]: reaped child process 1921, status = succeeded client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... worker2 # [ 210.577252] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 211.810290] nix-daemon[873]: reaped child process 1930, status = succeeded worker2 # [ 211.902453] nix-daemon[873]: accepted connection from pid 1946, user nix-grpc-daemon (trusted) worker2 # [ 211.915090] nix-daemon[873]: reaped child process 1949, status = succeeded lb # [ 211.894836] niks3-server[1146]: 2026/09/23 05:15:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 211.933467] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.123Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 211.934943] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.125Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 211.942472] niks3-server[1146]: 2026/09/23 05:15:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/89/sign lb # [ 211.946223] niks3-server[1146]: 2026/09/23 05:15:04 INFO Signed narinfos id=89 count=1 worker2 # [ 211.973233] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.163Z level=INFO msg="Uploading 1 narinfos" lb # [ 211.947286] niks3-server[1146]: 2026/09/23 05:15:04 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 211.952500] niks3-server[1146]: 2026/09/23 05:15:04 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 211.955571] niks3-server[1146]: 2026/09/23 05:15:04 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 211.958765] niks3-server[1146]: 2026/09/23 05:15:04 INFO Received complete upload request method=POST path=/api/pending_closures/89/complete lb # [ 211.964057] niks3-server[1146]: 2026/09/23 05:15:04 INFO Completed upload id=89 worker2 # [ 211.991325] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.181Z level=INFO msg="Upload complete. (206ms)" lb # [ 211.965795] niks3-server[1146]: 2026/09/23 05:15:04 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 211.996652] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=14 outputs=1 worker2 # [ 212.008308] nix-daemon[873]: reaped child process 1928, status = succeeded worker2 # [ 212.044723] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=debug event=want client=4 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 212.049893] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 212.089400] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 212.102154] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 212.117131] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.307Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 212.126655] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 212.137134] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 212.238373] nix-daemon[873]: accepted connection from pid 1955, user nix-grpc-daemon (trusted) worker2 # [ 212.251641] nix-daemon[873]: reaped child process 1958, status = succeeded lb # [ 212.231944] niks3-server[1146]: 2026/09/23 05:15:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 212.268942] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.459Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 212.270476] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.460Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 212.266124] niks3-server[1146]: 2026/09/23 05:15:04 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 212.272764] niks3-server[1146]: 2026/09/23 05:15:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/90/sign lb # [ 212.278469] niks3-server[1146]: 2026/09/23 05:15:04 INFO Signed narinfos id=90 count=1 worker2 # [ 212.308225] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.498Z level=INFO msg="Uploading 1 narinfos" lb # [ 212.286153] niks3-server[1146]: 2026/09/23 05:15:04 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 212.297552] niks3-server[1146]: 2026/09/23 05:15:04 INFO Received complete upload request method=POST path=/api/pending_closures/90/complete lb # [ 212.301762] niks3-server[1146]: 2026/09/23 05:15:04 INFO Completed upload id=90 worker2 # [ 212.329212] nix-grpc-daemon[1605]: time=2026-09-23T05:15:05.519Z level=INFO msg="Upload complete. (179ms)" lb # [ 212.303957] niks3-server[1146]: 2026/09/23 05:15:04 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 212.333326] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 212.338489] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 212.347583] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 212.354902] nix-daemon[873]: reaped child process 1953, status = succeeded worker2 # [ 212.360163] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 213.397758] nix-daemon[873]: reaped child process 1962, status = succeeded worker2 # [ 213.485093] nix-daemon[873]: accepted connection from pid 1978, user nix-grpc-daemon (trusted) worker2 # [ 213.496597] nix-daemon[873]: reaped child process 1981, status = succeeded lb # [ 213.479171] niks3-server[1146]: 2026/09/23 05:15:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 213.515711] nix-grpc-daemon[1605]: time=2026-09-23T05:15:06.705Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 213.518393] nix-grpc-daemon[1605]: time=2026-09-23T05:15:06.707Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 213.514283] niks3-server[1146]: 2026/09/23 05:15:05 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 213.528648] niks3-server[1146]: 2026/09/23 05:15:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/91/sign lb # [ 213.533317] niks3-server[1146]: 2026/09/23 05:15:05 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 213.541519] niks3-server[1146]: 2026/09/23 05:15:05 INFO Signed narinfos id=91 count=1 worker2 # [ 213.568650] nix-grpc-daemon[1605]: time=2026-09-23T05:15:06.758Z level=INFO msg="Uploading 1 narinfos" lb # [ 213.546479] niks3-server[1146]: 2026/09/23 05:15:05 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 213.558968] niks3-server[1146]: 2026/09/23 05:15:05 INFO Received complete upload request method=POST path=/api/pending_closures/91/complete lb # [ 213.563870] niks3-server[1146]: 2026/09/23 05:15:05 INFO Completed upload id=91 worker2 # [ 213.591269] nix-grpc-daemon[1605]: time=2026-09-23T05:15:06.781Z level=INFO msg="Upload complete. (223ms)" lb # [ 213.566649] niks3-server[1146]: 2026/09/23 05:15:05 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 213.597744] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=15 outputs=1 worker2 # [ 213.609383] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:06Z level=debug event=want client=4 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 213.613287] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:06Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 213.623365] nix-daemon[873]: reaped child process 1960, status = succeeded worker2 # [ 213.654073] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 213.666529] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 213.679391] nix-grpc-daemon[1605]: time=2026-09-23T05:15:06.869Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 213.688639] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 213.697146] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 213.797504] nix-daemon[873]: accepted connection from pid 1987, user nix-grpc-daemon (trusted) worker2 # [ 213.810946] nix-daemon[873]: reaped child process 1990, status = succeeded lb # [ 213.791931] niks3-server[1146]: 2026/09/23 05:15:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 213.827082] nix-grpc-daemon[1605]: time=2026-09-23T05:15:07.017Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 213.828612] nix-grpc-daemon[1605]: time=2026-09-23T05:15:07.018Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 213.821237] niks3-server[1146]: 2026/09/23 05:15:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/92/sign lb # [ 213.827078] niks3-server[1146]: 2026/09/23 05:15:06 INFO Signed narinfos id=92 count=1 worker2 # [ 213.858693] nix-grpc-daemon[1605]: time=2026-09-23T05:15:07.048Z level=INFO msg="Uploading 1 narinfos" lb # [ 213.835732] niks3-server[1146]: 2026/09/23 05:15:06 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 213.841984] niks3-server[1146]: 2026/09/23 05:15:06 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 213.854848] niks3-server[1146]: 2026/09/23 05:15:06 INFO Received complete upload request method=POST path=/api/pending_closures/92/complete lb # [ 213.860108] niks3-server[1146]: 2026/09/23 05:15:06 INFO Completed upload id=92 worker2 # [ 213.886975] nix-grpc-daemon[1605]: time=2026-09-23T05:15:07.077Z level=INFO msg="Upload complete. (176ms)" worker2 # [ 213.891165] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 213.865687] niks3-server[1146]: 2026/09/23 05:15:06 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 213.898314] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 worker2 # [ 213.906347] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 213.911069] nix-daemon[873]: reaped child process 1985, status = succeeded worker2 # [ 213.916268] nix-daemon[873]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 214.930808] nix-daemon[873]: reaped child process 1994, status = succeeded worker2 # [ 215.007211] nix-daemon[873]: accepted connection from pid 2010, user nix-grpc-daemon (trusted) worker2 # [ 215.020131] nix-daemon[873]: reaped child process 2013, status = succeeded lb # [ 215.002206] niks3-server[1146]: 2026/09/23 05:15:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 215.038031] nix-grpc-daemon[1605]: time=2026-09-23T05:15:08.227Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 215.039829] nix-grpc-daemon[1605]: time=2026-09-23T05:15:08.229Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 215.047847] niks3-server[1146]: 2026/09/23 05:15:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/93/sign lb # [ 215.052587] niks3-server[1146]: 2026/09/23 05:15:07 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 215.086611] nix-grpc-daemon[1605]: time=2026-09-23T05:15:08.276Z level=INFO msg="Uploading 1 narinfos" lb # [ 215.059126] niks3-server[1146]: 2026/09/23 05:15:07 INFO Signed narinfos id=93 count=1 lb # [ 215.063844] niks3-server[1146]: 2026/09/23 05:15:07 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 215.075142] niks3-server[1146]: 2026/09/23 05:15:07 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 215.081335] niks3-server[1146]: 2026/09/23 05:15:07 INFO Received complete upload request method=POST path=/api/pending_closures/93/complete lb # [ 215.088699] niks3-server[1146]: 2026/09/23 05:15:07 INFO Completed upload id=93 worker2 # [ 215.116066] nix-grpc-daemon[1605]: time=2026-09-23T05:15:08.306Z level=INFO msg="Upload complete. (193ms)" lb # [ 215.090797] niks3-server[1146]: 2026/09/23 05:15:07 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 215.122829] nix-grpc-daemon[1516]: ts=2026-09-23T05:15:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60276 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=16 outputs=1 worker2 # [ 215.137350] nix-daemon[873]: reaped child process 1992, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.08 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 215.637815] nix-grpc-daemon[1845]: ts=2026-09-23T05:15:08Z level=info event=healthy reason=min_free lb # [ 215.709726] envoy[910]: conn peer=[2001:db8:1::1]:34026 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=929 tx=596 ms=30043 lb # [ 215.713614] envoy[910]: conn peer=[2001:db8:1::1]:56444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9469 tx=4344 ms=4924 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.52 seconds) (finished: run the VM test script, in 217.51 seconds) test script finished in 217.69s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T05:15:10Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-23T05:15:11Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T05:15:11Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T05:15:11Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.14 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh