tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1: QEMU running (pid 52) worker1 # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.Nbr6SOfDu0', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 7d823774-0814-4db3-bca3-e30f19ea8fc0 worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. worker1 # Starting virtiofs daemons... worker1 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Disk image does not exist, creating the virtualisation disk image... worker1 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Formatting '/build/vm-state-worker2/tmp.OSiLaam6a0', fmt=raw size=1073741824 worker1 # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # mke2fs 1.47.4 (6-Mar-2025) client: QEMU running (pid 49) worker2: QEMU running (pid 51) worker2 # Discarding device blocks: 0/262144 done client # Disk image does not exist, creating the virtualisation disk image... worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Formatting '/build/vm-state-client/tmp.w5YXlg8wic', fmt=raw size=1073741824 worker2 # Filesystem UUID: 39edbccd-c281-4673-885f-74cac8e156c6 client # mke2fs 1.47.4 (6-Mar-2025) worker2 # Superblock backups stored on blocks: client # Discarding device blocks: 0/262144 done worker2 # 32768, 98304, 163840, 229376 client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # client # Filesystem UUID: 8c7b3614-db1c-412b-887e-f6c723c095b2 worker2 # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) client # Superblock backups stored on blocks: worker1 # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests client # 32768, 98304, 163840, 229376 worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests client # client # Allocating group tables: 0/8 done worker2 # (finished: start all VMs, in 0.25 seconds) lb # Formatting '/build/vm-state-lb/tmp.nHTMfWawhd', fmt=raw size=1073741824 client # Writing inode tables: 0/8 done worker2 # Virtualisation disk image created. worker2 # Starting virtiofs daemons... client: waiting for unit network-addresses-eth1.service lb # mke2fs 1.47.4 (6-Mar-2025) client # Creating journal (8192 blocks): done worker2 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client: waiting for the VM to finish booting lb # Discarding device blocks: 0/262144 done client # Writing superblocks and filesystem accounting information: 0/8 done client # lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Virtualisation disk image created. client # Starting virtiofs daemons... lb # Filesystem UUID: 1cb8b1e1-3655-44cd-a136-c6cc505c2048 client # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Superblock backups stored on blocks: worker2 # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests lb # 32768, 98304, 163840, 229376 lb # lb # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T15:03:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T15:03:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T15:03:11Z INFO virtiofsd] Client connected, servicing requests client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # client # worker2 # worker2 # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # client # Booting from ROM... worker2 # Booting from ROM... worker1 # Booting from ROM... lb # Booting from ROM... client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test/init regInfo=/nix/store/2jmcw81c7phijdhwbkm9pn7gpcs89hq7-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] SMBIOS 2.8 present. worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] kvm-clock: using sched offset of 476344059 cycles worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gcqx0ly4a11w34z8kprj4p7mv3aciczk-nixos-system-worker2-test/init regInfo=/nix/store/744ap97ay03z4ngf1q9ax96r0w4xa55l-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qdm894g7fk24niwl4p4m0ddcdy1ggpcl-nixos-system-worker1-test/init regInfo=/nix/store/ydgn654pqammmz3kxba0bglp9b3f3vq8-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.002736] Using GB pages for direct mapping worker1 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002804] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.002812] ACPI: Early table checksum verification disabled lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.002815] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.002819] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.002824] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.002831] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002833] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.002835] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002836] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.002838] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] kvm-clock: using sched offset of 482679587 cycles client # [ 0.002840] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.002841] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002842] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002842] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002843] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002843] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.002772] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000001] kvm-clock: using sched offset of 495723932 cycles lb # [ 0.000000] Hypervisor detected: KVM client # [ 0.002844] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.002783] Using GB pages for direct mapping lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002942] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.002844] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.003073] No NUMA configuration found worker2 # [ 0.002951] ACPI: Early table checksum verification disabled worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor lb # [ 0.000000] kvm-clock: using sched offset of 466086719 cycles worker2 # [ 0.002953] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.003074] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.003077] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.002957] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.005372] Zone ranges: lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.005373] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002961] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.005374] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.005375] Normal empty worker2 # [ 0.002968] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002737] Using GB pages for direct mapping lb # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.005376] Device empty worker2 # [ 0.002970] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002853] RAMDISK: [mem 0x5e370000-0x5ffcffff] client # [ 0.005377] Movable zone start for each node lb # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.005377] Early memory node ranges worker1 # [ 0.002862] ACPI: Early table checksum verification disabled worker2 # [ 0.002972] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.005378] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.002867] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.002738] Using GB pages for direct mapping client # [ 0.005379] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.002822] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker2 # [ 0.002973] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002871] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002830] ACPI: Early table checksum verification disabled client # [ 0.005380] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.002975] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002876] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002833] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.005399] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.002976] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005666] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.002883] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002837] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002978] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.032687] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.002886] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.033147] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.002842] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002979] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.002887] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.033158] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.002849] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002979] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.033182] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.002889] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002851] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.002980] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.033185] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.002890] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002852] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002980] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.033186] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.002892] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002981] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.002854] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.033187] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.002981] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.002893] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.033189] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.002855] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003215] No NUMA configuration found worker1 # [ 0.002894] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.033189] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.002857] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003216] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.002895] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.033192] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002858] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.003219] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.005622] Zone ranges: client # [ 0.033193] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.002895] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.033196] TSC deadline timer available lb # [ 0.002859] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.005622] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.033200] CPU topo: Max. logical packages: 1 worker1 # [ 0.002896] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.002860] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.005624] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.033201] CPU topo: Max. logical dies: 1 worker2 # [ 0.005625] Normal empty worker1 # [ 0.002896] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.005626] Device empty client # [ 0.033202] CPU topo: Max. dies per package: 1 lb # [ 0.002860] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.005627] Movable zone start for each node client # [ 0.033205] CPU topo: Max. threads per core: 1 worker1 # [ 0.002897] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.005628] Early memory node ranges lb # [ 0.002861] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.003134] No NUMA configuration found client # [ 0.033205] CPU topo: Num. cores per package: 1 worker2 # [ 0.005628] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.033206] CPU topo: Num. threads per package: 1 lb # [ 0.002861] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.003134] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.033206] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.005629] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.003137] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.002862] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.005529] Zone ranges: lb # [ 0.003083] No NUMA configuration found worker2 # [ 0.005630] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.033225] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.005530] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.005650] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.003084] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.033254] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.005531] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.003086] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005533] Normal empty worker2 # [ 0.005929] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.006374] Zone ranges: worker1 # [ 0.005534] Device empty client # [ 0.033255] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.038385] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.005534] Movable zone start for each node lb # [ 0.006375] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.033257] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.038862] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.005535] Early memory node ranges lb # [ 0.006377] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.033258] Booting paravirtualized kernel on KVM worker2 # [ 0.038875] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.005535] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.006378] Normal empty lb # [ 0.006379] Device empty worker2 # [ 0.038905] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.005536] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.033261] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.006380] Movable zone start for each node lb # [ 0.006380] Early memory node ranges worker2 # [ 0.038908] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.005538] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.037735] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.006381] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.038910] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.005561] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.039937] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.006382] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.038911] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.005843] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.039986] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.006383] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.035562] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.038912] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.036047] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.006410] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.038913] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.036062] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.006769] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.038915] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.036094] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.038465] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.038917] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.038935] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.036097] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.038920] TSC deadline timer available client # [ 0.039988] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test/init regInfo=/nix/store/2jmcw81c7phijdhwbkm9pn7gpcs89hq7-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.038948] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.038924] CPU topo: Max. logical packages: 1 worker1 # [ 0.036099] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.038925] CPU topo: Max. logical dies: 1 lb # [ 0.038973] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.036100] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.038926] CPU topo: Max. dies per package: 1 client # [ 0.040080] Unknown kernel command line parameters "regInfo=/nix/store/2jmcw81c7phijdhwbkm9pn7gpcs89hq7-closure-info/registration", will be passed to user space. lb # [ 0.038977] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.038929] CPU topo: Max. threads per core: 1 worker1 # [ 0.036101] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.040093] random: crng init done worker2 # [ 0.038929] CPU topo: Num. cores per package: 1 lb # [ 0.038978] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.036102] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.040093] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.038930] CPU topo: Num. threads per package: 1 lb # [ 0.038979] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.036104] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.038930] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.042253] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.038981] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.036105] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.038950] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.036110] TSC deadline timer available lb # [ 0.038981] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.043332] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.036114] CPU topo: Max. logical packages: 1 client # [ 0.043363] Fallback order for Node 0: 0 worker2 # [ 0.038986] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.038984] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.036114] CPU topo: Max. logical dies: 1 client # [ 0.043365] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.038985] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.036115] CPU topo: Max. dies per package: 1 worker2 # [ 0.038987] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.043367] Policy zone: DMA32 lb # [ 0.038989] TSC deadline timer available worker1 # [ 0.036118] CPU topo: Max. threads per core: 1 worker2 # [ 0.038989] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.038994] CPU topo: Max. logical packages: 1 client # [ 0.046172] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.036119] CPU topo: Num. cores per package: 1 worker2 # [ 0.038990] Booting paravirtualized kernel on KVM lb # [ 0.038994] CPU topo: Max. logical dies: 1 client # [ 0.049270] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.036119] CPU topo: Num. threads per package: 1 lb # [ 0.038995] CPU topo: Max. dies per package: 1 client # [ 0.052642] allocated 3145728 bytes of page_ext worker1 # [ 0.036119] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.038998] CPU topo: Max. threads per core: 1 worker2 # [ 0.038993] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.062416] ftrace: allocating 48787 entries in 192 pages lb # [ 0.038999] CPU topo: Num. cores per package: 1 worker1 # [ 0.036143] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.062418] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.043504] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.038999] CPU topo: Num. threads per package: 1 client # [ 0.063252] Dynamic Preempt: lazy worker1 # [ 0.036179] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.045811] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.038999] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.063412] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.036180] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.045856] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.063413] rcu: RCU event tracing is enabled. lb # [ 0.039022] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.036182] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.063413] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.039058] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.036183] Booting paravirtualized kernel on KVM client # [ 0.063415] Trampoline variant of Tasks RCU enabled. client # [ 0.063415] Rude variant of Tasks RCU enabled. lb # [ 0.039060] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.063415] Tracing variant of Tasks RCU enabled. worker1 # [ 0.036187] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.039061] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.039063] Booting paravirtualized kernel on KVM worker1 # [ 0.040682] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.063416] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.045857] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gcqx0ly4a11w34z8kprj4p7mv3aciczk-nixos-system-worker2-test/init regInfo=/nix/store/744ap97ay03z4ngf1q9ax96r0w4xa55l-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.042987] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.063417] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.039067] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.043034] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.063432] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.045955] Unknown kernel command line parameters "regInfo=/nix/store/744ap97ay03z4ngf1q9ax96r0w4xa55l-closure-info/registration", will be passed to user space. lb # [ 0.043544] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.045967] random: crng init done lb # [ 0.045831] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.063433] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.045968] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.045873] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.063434] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.048231] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.067816] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.049660] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.043036] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qdm894g7fk24niwl4p4m0ddcdy1ggpcl-nixos-system-worker1-test/init regInfo=/nix/store/ydgn654pqammmz3kxba0bglp9b3f3vq8-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.068094] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.049697] Fallback order for Node 0: 0 worker2 # [ 0.049701] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.068100] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.049702] Policy zone: DMA32 worker1 # [ 0.043137] Unknown kernel command line parameters "regInfo=/nix/store/ydgn654pqammmz3kxba0bglp9b3f3vq8-closure-info/registration", will be passed to user space. lb # [ 0.045874] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.043149] random: crng init done worker2 # [ 0.052340] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.068202] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.043150] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.071729] Console: colour VGA+ 80x25 worker2 # [ 0.055808] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.059340] allocated 3145728 bytes of page_ext lb # [ 0.045973] Unknown kernel command line parameters "regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration", will be passed to user space. client # [ 0.071732] printk: legacy console [tty0] enabled worker1 # [ 0.045395] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.045986] random: crng init done client # [ 0.101249] printk: legacy console [ttyS0] enabled worker2 # [ 0.069766] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.046801] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.069768] ftrace: allocated 192 pages with 2 groups lb # [ 0.045987] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.196601] ACPI: Core revision 20250807 worker1 # [ 0.046835] Fallback order for Node 0: 0 worker2 # [ 0.070615] Dynamic Preempt: lazy lb # [ 0.048223] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.070757] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.046838] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.046840] Policy zone: DMA32 worker2 # [ 0.070758] rcu: RCU event tracing is enabled. client # [ 0.197409] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.049345] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.049458] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.070759] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.049377] Fallback order for Node 0: 0 client # [ 0.198876] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.070760] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.053037] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.049381] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.199802] x2apic enabled worker2 # [ 0.070761] Rude variant of Tasks RCU enabled. worker1 # [ 0.056611] allocated 3145728 bytes of page_ext lb # [ 0.049382] Policy zone: DMA32 worker2 # [ 0.070761] Tracing variant of Tasks RCU enabled. worker1 # [ 0.067004] ftrace: allocating 48787 entries in 192 pages client # [ 0.200530] APIC: Switched APIC routing to: physical x2apic lb # [ 0.052338] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.067007] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.070762] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.055933] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.067911] Dynamic Preempt: lazy lb # [ 0.059431] allocated 3145728 bytes of page_ext worker2 # [ 0.070763] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.068095] rcu: Preemptible hierarchical RCU implementation. client # [ 0.202289] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.069347] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.068096] rcu: RCU event tracing is enabled. lb # [ 0.069349] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.070784] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.068097] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.070215] Dynamic Preempt: lazy worker1 # [ 0.068098] Trampoline variant of Tasks RCU enabled. client # [ 0.203229] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.070786] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.070384] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.068099] Rude variant of Tasks RCU enabled. lb # [ 0.070385] rcu: RCU event tracing is enabled. worker1 # [ 0.068099] Tracing variant of Tasks RCU enabled. worker2 # [ 0.070787] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.204796] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.070386] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.075601] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.068100] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.070387] Trampoline variant of Tasks RCU enabled. client # [ 0.206879] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.070388] Rude variant of Tasks RCU enabled. worker2 # [ 0.075890] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.068101] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.070388] Tracing variant of Tasks RCU enabled. client # [ 0.207970] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.068123] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.075897] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.070389] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.208793] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.070389] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.068124] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.076004] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.079576] Console: colour VGA+ 80x25 lb # [ 0.070406] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.068125] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.079579] printk: legacy console [tty0] enabled client # [ 0.209797] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.109244] printk: legacy console [ttyS0] enabled worker1 # [ 0.072861] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.070408] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.205034] ACPI: Core revision 20250807 client # [ 0.210793] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.073155] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.070409] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.212793] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.073164] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.074924] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.205892] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.213793] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.075216] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.073279] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.207381] APIC: Switch to symmetric I/O mode setup client # [ 0.214793] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.076849] Console: colour VGA+ 80x25 worker2 # [ 0.208319] x2apic enabled lb # [ 0.075221] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.076852] printk: legacy console [tty0] enabled worker1 # [ 0.106352] printk: legacy console [ttyS0] enabled worker2 # [ 0.209059] APIC: Switched APIC routing to: physical x2apic lb # [ 0.075336] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.201961] ACPI: Core revision 20250807 lb # [ 0.078852] Console: colour VGA+ 80x25 lb # [ 0.078855] printk: legacy console [tty0] enabled worker2 # [ 0.210848] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.108309] printk: legacy console [ttyS0] enabled worker1 # [ 0.202890] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.215793] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.204024] ACPI: Core revision 20250807 worker1 # [ 0.204386] APIC: Switch to symmetric I/O mode setup client # [ 0.217800] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.211808] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.205369] x2apic enabled lb # [ 0.204863] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.219306] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.213415] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.206154] APIC: Switched APIC routing to: physical x2apic client # [ 0.219794] active return thunk: srso_alias_return_thunk lb # [ 0.206400] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.214502] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.207391] x2apic enabled client # [ 0.221417] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.207955] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.215562] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.208174] APIC: Switched APIC routing to: physical x2apic client # [ 0.222660] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.216412] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.223505] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.208936] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.209974] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.224519] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.217417] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.210613] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.225524] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.210978] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.211699] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.218412] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.225793] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.212663] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.212743] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.219412] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.226793] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.220412] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.214292] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.213745] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.228672] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.221412] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.214828] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.229487] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.214614] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.216336] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.230492] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.216610] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.230793] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.216664] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.217610] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.231793] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.219330] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.222412] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.218660] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.232793] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.224420] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.219610] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.219660] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.225413] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.221393] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.226413] active return thunk: srso_alias_return_thunk lb # [ 0.222401] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.227432] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.220610] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.228412] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.222618] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.229412] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.223611] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.223451] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.231185] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.224611] active return thunk: srso_alias_return_thunk lb # [ 0.224667] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.232176] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.225630] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.226189] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.233187] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.226610] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.226660] active return thunk: srso_alias_return_thunk worker2 # [ 0.234205] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.228346] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.228307] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.235412] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.229350] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.228659] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.236412] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.230361] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.237412] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.229659] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.231351] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.238412] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.230660] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.232387] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.239412] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.231659] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.233610] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.232660] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.240358] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.234610] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.233660] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.235610] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.234660] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.236610] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.235660] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.237610] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.236659] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.238562] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.237659] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.238659] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.239659] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.266871] Freeing SMP alternatives memory: 44K client # [ 0.267638] pid_max: default: 32768 minimum: 301 client # [ 0.268518] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.269684] landlock: Up and running. client # [ 0.270220] Yama: becoming mindful. client # [ 0.271009] LSM support for eBPF active client # [ 0.271959] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.273190] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.276053] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.277398] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.277803] ... version: 2 client # [ 0.278566] ... bit width: 48 client # [ 0.278796] ... generic counters: 6 client # [ 0.279520] ... generic bitmap: 000000000000003f client # [ 0.279795] ... fixed-purpose counters: 0 client # [ 0.280556] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.275198] Freeing SMP alternatives memory: 44K worker2 # [ 0.275974] pid_max: default: 32768 minimum: 301 client # [ 0.280796] ... value mask: 0000ffffffffffff client # [ 0.281713] ... max period: 00007fffffffffff worker2 # [ 0.276509] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.277520] landlock: Up and running. client # [ 0.282505] ... global_ctrl mask: 000000000000003f worker2 # [ 0.278413] Yama: becoming mindful. client # [ 0.282893] signal: max sigframe size: 3376 worker2 # [ 0.279484] LSM support for eBPF active client # [ 0.283731] rcu: Hierarchical SRCU implementation. worker1 # [ 0.273572] Freeing SMP alternatives memory: 44K client # [ 0.284389] rcu: Max phase no-delay instances is 400. worker2 # [ 0.280248] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.274183] pid_max: default: 32768 minimum: 301 worker2 # [ 0.281450] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.275260] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.274658] Freeing SMP alternatives memory: 44K worker1 # [ 0.275733] landlock: Up and running. lb # [ 0.275231] pid_max: default: 32768 minimum: 301 worker1 # [ 0.277052] Yama: becoming mindful. lb # [ 0.276320] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.277823] LSM support for eBPF active worker2 # [ 0.283873] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.276766] landlock: Up and running. lb # [ 0.277660] Yama: becoming mindful. worker1 # [ 0.278666] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.289357] smp: Bringing up secondary CPUs ... worker2 # [ 0.284987] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.278874] LSM support for eBPF active client # [ 0.289810] smp: Brought up 1 node, 1 CPU worker2 # [ 0.285421] ... version: 2 worker1 # [ 0.279651] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.290444] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.286129] ... bit width: 48 lb # [ 0.279695] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.286414] ... generic counters: 6 lb # [ 0.280699] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.287145] ... generic bitmap: 000000000000003f worker1 # [ 0.282264] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.291004] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.287415] ... fixed-purpose counters: 0 client # [ 0.292051] devtmpfs: initialized worker2 # [ 0.288117] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.283204] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.292779] x86/mm: Memory block size: 128MB worker2 # [ 0.288415] ... value mask: 0000ffffffffffff lb # [ 0.283517] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.283615] ... version: 2 worker2 # [ 0.289270] ... max period: 00007fffffffffff worker1 # [ 0.284329] ... bit width: 48 worker1 # [ 0.284613] ... generic counters: 6 worker2 # [ 0.290087] ... global_ctrl mask: 000000000000003f lb # [ 0.284203] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.294332] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.284664] ... version: 2 worker1 # [ 0.285291] ... generic bitmap: 000000000000003f worker2 # [ 0.290528] signal: max sigframe size: 3376 lb # [ 0.285339] ... bit width: 48 worker1 # [ 0.285623] ... fixed-purpose counters: 0 worker2 # [ 0.291336] rcu: Hierarchical SRCU implementation. client # [ 0.294821] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.285662] ... generic counters: 6 worker1 # [ 0.286329] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.292001] rcu: Max phase no-delay instances is 400. client # [ 0.295886] pinctrl core: initialized pinctrl subsystem lb # [ 0.286337] ... generic bitmap: 000000000000003f worker1 # [ 0.286613] ... value mask: 0000ffffffffffff lb # [ 0.286720] ... fixed-purpose counters: 0 client # [ 0.297002] PM: RTC time: 15:03:11, date: 2026-09-22 worker1 # [ 0.287521] ... max period: 00007fffffffffff lb # [ 0.287438] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.288293] ... global_ctrl mask: 000000000000003f lb # [ 0.287663] ... value mask: 0000ffffffffffff worker1 # [ 0.288737] signal: max sigframe size: 3376 lb # [ 0.288544] ... max period: 00007fffffffffff worker1 # [ 0.289503] rcu: Hierarchical SRCU implementation. lb # [ 0.289333] ... global_ctrl mask: 000000000000003f client # [ 0.300568] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.290192] rcu: Max phase no-delay instances is 400. lb # [ 0.289778] signal: max sigframe size: 3376 worker2 # [ 0.297188] smp: Bringing up secondary CPUs ... worker2 # [ 0.297428] smp: Brought up 1 node, 1 CPU lb # [ 0.290532] rcu: Hierarchical SRCU implementation. client # [ 0.302036] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.291218] rcu: Max phase no-delay instances is 400. worker2 # [ 0.298096] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.302818] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.304078] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.298636] Memory: 1454580K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) client # [ 0.304806] audit: initializing netlink subsys (disabled) worker2 # [ 0.299736] devtmpfs: initialized worker1 # [ 0.295243] smp: Bringing up secondary CPUs ... worker1 # [ 0.295626] smp: Brought up 1 node, 1 CPU worker2 # [ 0.300541] x86/mm: Memory block size: 128MB client # [ 0.305916] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.296276] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.296262] smp: Bringing up secondary CPUs ... client # [ 0.305918] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.296676] smp: Brought up 1 node, 1 CPU client # [ 0.306797] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.302335] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.297324] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.307745] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.296836] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.303272] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.297945] devtmpfs: initialized client # [ 0.308512] audit: type=2000 audit(1790089392.028:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.304503] pinctrl core: initialized pinctrl subsystem lb # [ 0.297872] Memory: 1454616K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) worker1 # [ 0.298778] x86/mm: Memory block size: 128MB client # [ 0.309799] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.305591] PM: RTC time: 15:03:11, date: 2026-09-22 lb # [ 0.298933] devtmpfs: initialized client # [ 0.309813] cpuidle: using governor menu lb # [ 0.299759] x86/mm: Memory block size: 128MB worker1 # [ 0.300518] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.312023] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.301517] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.301522] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.313042] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.309362] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.302698] pinctrl core: initialized pinctrl subsystem client # [ 0.313799] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.302546] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.303791] PM: RTC time: 15:03:11, date: 2026-09-22 client # [ 0.314808] PCI: Using configuration type 1 for base access worker2 # [ 0.310658] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.303746] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.311439] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.304859] PM: RTC time: 15:03:11, date: 2026-09-22 client # [ 0.315899] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.312701] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.307537] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.313426] audit: initializing netlink subsys (disabled) worker2 # [ 0.314602] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.308873] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.308550] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.314604] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.309640] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.309935] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.321037] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.315415] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.316378] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.310900] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.321797] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.310684] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.311623] audit: initializing netlink subsys (disabled) worker2 # [ 0.317113] audit: type=2000 audit(1790089392.042:1): state=initialized audit_enabled=0 res=1 lb # [ 0.311961] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.312753] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.318417] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.312678] audit: initializing netlink subsys (disabled) worker2 # [ 0.318430] cpuidle: using governor menu worker1 # [ 0.312755] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.313614] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.313664] audit: type=2000 audit(1790089392.050:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.320650] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.314569] thermal_sys: Registered thermal governor 'user_space' client # [ 0.326797] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.314852] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.327795] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.314855] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.321635] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.315365] audit: type=2000 audit(1790089392.048:1): state=initialized audit_enabled=0 res=1 lb # [ 0.315663] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.322418] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.316616] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.316596] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.316642] cpuidle: using governor menu worker2 # [ 0.323435] PCI: Using configuration type 1 for base access lb # [ 0.317395] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.318869] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.317686] cpuidle: using governor menu worker2 # [ 0.324529] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.319891] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.319887] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.320616] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.320918] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.321625] PCI: Using configuration type 1 for base access lb # [ 0.321666] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.329495] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.322747] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.322675] PCI: Using configuration type 1 for base access worker2 # [ 0.330415] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.338181] ACPI: Added _OSI(Module Device) lb # [ 0.323747] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.338797] ACPI: Added _OSI(Processor Device) client # [ 0.339534] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.335416] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.336415] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.329889] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.330614] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.330688] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.331662] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.345733] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.335614] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.336613] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.336663] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.337663] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.352202] ACPI: Interpreter enabled client # [ 0.352811] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.346767] ACPI: Added _OSI(Module Device) client # [ 0.353549] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.347416] ACPI: Added _OSI(Processor Device) worker2 # [ 0.348176] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.353871] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.354796] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.345214] ACPI: Added _OSI(Module Device) client # [ 0.357947] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.345614] ACPI: Added _OSI(Processor Device) worker1 # [ 0.346356] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.348909] ACPI: Added _OSI(Module Device) lb # [ 0.349613] ACPI: Added _OSI(Processor Device) worker2 # [ 0.356553] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.350202] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.366542] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.353160] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.360836] ACPI: Interpreter enabled worker2 # [ 0.361431] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.366802] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.362121] ACPI: Using IOAPIC for interrupt routing lb # [ 0.356038] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.368446] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.356517] ACPI: Interpreter enabled worker1 # [ 0.357071] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.368919] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.357614] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.364476] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.370140] PCI host bridge to bus 0000:00 worker2 # [ 0.365415] PCI: Using E820 reservations for host bridge windows client # [ 0.370800] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.360067] ACPI: Interpreter enabled worker1 # [ 0.358493] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.360678] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.371796] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.361377] ACPI: Using IOAPIC for interrupt routing client # [ 0.372795] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.368511] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.373796] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.374796] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.363725] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.363620] PCI: Using E820 reservations for host bridge windows lb # [ 0.364663] PCI: Using E820 reservations for host bridge windows client # [ 0.375796] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.364815] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.376796] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.377840] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.367723] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.379252] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.376213] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.377213] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.378493] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.379546] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.373596] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.380758] PCI host bridge to bus 0000:00 lb # [ 0.375224] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.381419] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.375668] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.382415] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.375967] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.376740] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.381861] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.383414] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.376692] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.382808] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.377784] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.384415] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.377735] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.379019] PCI host bridge to bus 0000:00 client # [ 0.383738] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.385421] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.378996] PCI host bridge to bus 0000:00 lb # [ 0.379666] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.379617] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.386415] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.385080] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.380663] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.380613] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.387445] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.381662] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.381613] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.388435] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.386701] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.382663] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.382612] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.383662] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.389917] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.383613] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.388814] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.384662] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.384612] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.389707] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.385663] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.385613] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.390506] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.386612] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.386614] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.390802] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.388061] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.388106] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.392814] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.392513] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.394837] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.393427] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.395715] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.396594] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.394362] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.395588] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.398246] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.390761] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.391674] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.397157] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.390822] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.392638] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.391667] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.394003] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.401774] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.392635] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.400456] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.402437] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.393937] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.401387] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.395381] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.402818] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.402189] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.395358] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.404342] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.403319] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.397701] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.398556] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.404971] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.405848] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.398633] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.399433] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.406687] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.399465] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.400490] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.400348] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.407503] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.407453] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.407802] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.402113] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.400619] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.408327] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.409185] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.409335] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.402166] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.403700] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.404543] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.410852] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.410808] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.405391] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.404632] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.411818] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.405466] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.407080] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.406338] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.413393] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.414373] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.407192] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.415097] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.415327] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.415437] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.409705] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.415818] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.410694] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.416987] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.411652] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.409628] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.417372] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.410499] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.413085] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.419435] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.411357] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.418808] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.420270] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.419773] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.412187] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.414670] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.415498] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.421171] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.421235] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.421422] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.416388] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.414652] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.416669] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.423306] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.422953] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.415526] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.423818] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.418236] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.416362] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.424427] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.425322] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.417619] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.419578] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.425397] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.420415] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.419185] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.427402] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.426857] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.421264] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.427803] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.420626] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.428811] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.421618] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.422705] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.428429] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.423662] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.430147] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.430380] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.423213] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.425238] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.430953] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.431804] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.425328] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.432707] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.426434] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.432462] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.425636] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.433537] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.426685] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.433437] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.427252] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.434384] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.428233] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.434985] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.435521] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.429676] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.428657] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.430631] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.435991] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.429661] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.436429] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.432254] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.438196] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.431151] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.438250] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.439003] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.439804] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.433707] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.434595] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.433289] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.440456] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.433636] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.435397] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.442269] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.443092] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.435161] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.436209] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.443436] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.437410] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.437705] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.444975] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.438251] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.438694] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.438635] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.439607] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.446433] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.441059] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.447274] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.440158] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.448151] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.442227] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.441620] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.442871] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.449000] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.441022] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.442443] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.444198] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.450150] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.443341] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.443428] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.444864] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.444184] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.444065] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.450623] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.446452] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.445360] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.445203] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.452260] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.445809] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.446039] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.453248] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.455248] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.447824] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.448088] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.448684] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.448808] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.449871] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.450373] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.451355] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.447510] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.455439] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.449175] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.455903] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.449942] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.456897] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.457895] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.450951] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.456286] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.458896] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.451919] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.459891] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.458193] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.460898] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.453669] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.450832] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.458663] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.461902] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.454477] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.462833] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.453380] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.459703] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.455669] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.463809] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.453945] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.464806] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.460675] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.457168] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.465753] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.454898] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.466577] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.462443] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.467552] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.463302] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.455866] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.467822] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.460727] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.464441] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.468782] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.461771] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.457641] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.458456] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.462761] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.466117] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.470534] iommu: Default domain type: Translated lb # [ 0.463766] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.470803] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.459708] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.464763] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.472037] ACPI: bus type USB registered lb # [ 0.465759] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.461308] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.472803] usbcore: registered new interface driver usbfs lb # [ 0.466760] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.473659] usbcore: registered new interface driver hub worker2 # [ 0.470166] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.474454] usbcore: registered new device driver usb lb # [ 0.467758] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.470521] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.468698] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.475845] NetLabel: Initializing worker2 # [ 0.471516] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.469641] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.476455] NetLabel: domain hash size = 128 worker1 # [ 0.465154] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.470377] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.472513] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.476796] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.465718] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.470679] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.473517] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.477688] NetLabel: unlabeled traffic allowed by default client # [ 0.478440] PCI: Using ACPI for IRQ routing lb # [ 0.471598] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.466714] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.474512] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.472442] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.467711] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.475514] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.473380] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.468715] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.476545] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.473674] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.469707] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.477459] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.470710] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.475638] iommu: Default domain type: Translated worker2 # [ 0.478432] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.476238] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.471723] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.479430] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.476941] ACPI: bus type USB registered worker1 # [ 0.472655] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.480431] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.477671] usbcore: registered new interface driver usbfs worker1 # [ 0.473635] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.481427] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.478521] usbcore: registered new interface driver hub worker1 # [ 0.474613] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.482427] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.479284] usbcore: registered new device driver usb worker1 # [ 0.475578] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.483431] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.480579] NetLabel: Initializing worker1 # [ 0.476360] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.484429] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.481107] NetLabel: domain hash size = 128 worker1 # [ 0.476624] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.481662] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.477612] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.486539] iommu: Default domain type: Translated lb # [ 0.482588] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.478595] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.483316] PCI: Using ACPI for IRQ routing worker2 # [ 0.487355] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.488499] ACPI: bus type USB registered worker1 # [ 0.480399] iommu: Default domain type: Translated worker2 # [ 0.489292] usbcore: registered new interface driver usbfs worker1 # [ 0.481237] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.490181] usbcore: registered new interface driver hub worker1 # [ 0.481888] ACPI: bus type USB registered worker2 # [ 0.490551] usbcore: registered new device driver usb worker1 # [ 0.482664] usbcore: registered new interface driver usbfs worker1 # [ 0.483598] usbcore: registered new interface driver hub worker2 # [ 0.492351] NetLabel: Initializing worker1 # [ 0.484326] usbcore: registered new device driver usb worker2 # [ 0.492895] NetLabel: domain hash size = 128 worker2 # [ 0.493415] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.485743] NetLabel: Initializing worker2 # [ 0.494388] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.486372] NetLabel: domain hash size = 128 worker2 # [ 0.495130] PCI: Using ACPI for IRQ routing worker1 # [ 0.486619] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.487591] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.488353] PCI: Using ACPI for IRQ routing client # [ 0.521718] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.521792] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.521792] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.521801] vgaarb: loaded client # [ 0.522565] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.522796] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.526882] clocksource: Switched to clocksource kvm-clock client # [ 0.528574] VFS: Disk quotas dquot_6.6.0 lb # [ 0.526281] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.531110] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.526658] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.532675] pnp: PnP ACPI init lb # [ 0.526658] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.533563] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.526699] vgaarb: loaded client # [ 0.534653] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.527571] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.536218] pnp: PnP ACPI: found 5 devices lb # [ 0.528312] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.539282] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.532812] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.539411] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.539411] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.533056] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.539419] vgaarb: loaded client # [ 0.543854] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.533609] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.545221] clocksource: Switched to clocksource acpi_pm lb # [ 0.536702] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.540155] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.546200] NET: Registered PF_INET protocol family worker2 # [ 0.540415] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.533609] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.537403] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.533618] vgaarb: loaded lb # [ 0.538800] pnp: PnP ACPI init client # [ 0.547327] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.534366] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.539670] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.534614] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.540696] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.542268] pnp: PnP ACPI: found 5 devices worker2 # [ 0.544540] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.546328] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.539712] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.548875] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.550395] pnp: PnP ACPI init worker1 # [ 0.543330] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.551332] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.544045] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.545474] pnp: PnP ACPI init lb # [ 0.550028] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.552492] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.551499] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.546268] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.554323] pnp: PnP ACPI: found 5 devices lb # [ 0.552542] NET: Registered PF_INET protocol family worker1 # [ 0.547238] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.548796] pnp: PnP ACPI: found 5 devices lb # [ 0.553722] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.564088] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.565658] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.567046] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.568470] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.562273] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.569786] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.563780] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.556412] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.570944] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.564776] NET: Registered PF_INET protocol family worker1 # [ 0.557819] clocksource: Switched to clocksource acpi_pm client # [ 0.572188] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.558802] NET: Registered PF_INET protocol family worker2 # [ 0.566033] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.573248] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.559952] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.574502] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.575463] NET: Registered PF_XDP protocol family client # [ 0.576338] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.577387] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.578444] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.579628] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.570618] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.580749] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.572082] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.581877] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.573417] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.583586] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.574817] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.576089] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.585960] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.577248] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.578631] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.587991] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.579823] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.582354] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.581073] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.590044] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.582053] NET: Registered PF_XDP protocol family worker2 # [ 0.583934] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.576624] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.591758] PCI: CLS 0 bytes, default 64 lb # [ 0.582965] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.585224] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.578104] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.592816] Trying to unpack rootfs image as initramfs... lb # [ 0.583958] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.586574] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.584942] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.579428] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.587812] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.586000] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.580783] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.587068] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.589019] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.582019] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.588134] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.590424] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.583206] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.589890] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.591622] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.584560] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.598833] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.592817] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.585669] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.593793] NET: Registered PF_XDP protocol family worker1 # [ 0.586885] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.592906] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.594716] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.587859] NET: Registered PF_XDP protocol family worker2 # [ 0.595730] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.588700] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.594887] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.596774] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.589705] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.597883] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.590682] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.596838] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.599054] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.591817] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.600188] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.592910] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.598765] PCI: CLS 0 bytes, default 64 worker1 # [ 0.594005] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.601886] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.599674] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.595736] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.601354] Trying to unpack rootfs image as initramfs... worker2 # [ 0.604427] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.598371] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.606734] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.600423] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.608718] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.602424] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.610429] PCI: CLS 0 bytes, default 64 worker1 # [ 0.604157] PCI: CLS 0 bytes, default 64 worker2 # [ 0.611348] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.605044] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.613123] Trying to unpack rootfs image as initramfs... worker1 # [ 0.606781] Trying to unpack rootfs image as initramfs... client # [ 0.639552] Initialise system trusted keyrings client # [ 0.642781] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.643835] Initialise system trusted keyrings lb # [ 0.646654] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.662079] Key type asymmetric registered worker1 # [ 0.652523] Initialise system trusted keyrings client # [ 0.666726] Asymmetric key parser 'x509' registered worker2 # [ 0.659939] Initialise system trusted keyrings client # [ 0.667554] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.655495] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.670819] io scheduler mq-deadline registered worker2 # [ 0.663716] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.671596] io scheduler kyber registered client # [ 0.674231] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.675562] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.669545] Key type asymmetric registered lb # [ 0.670240] Asymmetric key parser 'x509' registered lb # [ 0.671071] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.681477] Linux agpgart interface v0.103 client # [ 0.682262] ACPI: bus type drm_connector registered lb # [ 0.676634] io scheduler mq-deadline registered client # [ 0.685171] usbcore: registered new interface driver usbserial_generic lb # [ 0.677394] io scheduler kyber registered client # [ 0.686244] usbserial: USB Serial support registered for generic lb # [ 0.680114] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.675009] Key type asymmetric registered client # [ 0.689733] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.681420] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.689733] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.684918] Key type asymmetric registered client # [ 0.691976] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.679488] Asymmetric key parser 'x509' registered worker2 # [ 0.687548] Asymmetric key parser 'x509' registered worker1 # [ 0.680374] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.694877] drop_monitor: Initializing network drop monitor service worker2 # [ 0.688419] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.696003] NET: Registered PF_INET6 protocol family lb # [ 0.687512] Linux agpgart interface v0.103 lb # [ 0.688231] ACPI: bus type drm_connector registered worker1 # [ 0.683577] io scheduler mq-deadline registered worker1 # [ 0.684367] io scheduler kyber registered worker2 # [ 0.691646] io scheduler mq-deadline registered client # [ 0.699205] Segment Routing with IPv6 worker2 # [ 0.692440] io scheduler kyber registered worker1 # [ 0.687158] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.692993] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.695102] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.702749] In-situ OAM (IOAM) with IPv6 lb # [ 0.694091] usbserial: USB Serial support registered for generic client # [ 0.703836] IPI shorthand broadcast: enabled worker2 # [ 0.696382] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.690482] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.696472] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.696472] Please enable it if your BIOS has the CPPC option. lb # [ 0.698722] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.694103] Linux agpgart interface v0.103 worker2 # [ 0.702334] Linux agpgart interface v0.103 worker1 # [ 0.694916] ACPI: bus type drm_connector registered worker2 # [ 0.703075] ACPI: bus type drm_connector registered lb # [ 0.701627] drop_monitor: Initializing network drop monitor service lb # [ 0.702806] NET: Registered PF_INET6 protocol family worker1 # [ 0.697910] usbcore: registered new interface driver usbserial_generic client # [ 0.712047] sched_clock: Marking stable (579013907, 132693057)->(787318553, -75611589) worker1 # [ 0.699008] usbserial: USB Serial support registered for generic worker2 # [ 0.707665] usbcore: registered new interface driver usbserial_generic client # [ 0.715959] registered taskstats version 1 worker2 # [ 0.708815] usbserial: USB Serial support registered for generic lb # [ 0.708000] Segment Routing with IPv6 client # [ 0.716925] Loading compiled-in X.509 certificates worker1 # [ 0.703486] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.710485] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.711548] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.703486] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.711548] Please enable it if your BIOS has the CPPC option. lb # [ 0.711566] IPI shorthand broadcast: enabled worker1 # [ 0.705809] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.713785] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.708620] drop_monitor: Initializing network drop monitor service worker2 # [ 0.716690] drop_monitor: Initializing network drop monitor service worker1 # [ 0.709799] NET: Registered PF_INET6 protocol family worker2 # [ 0.717907] NET: Registered PF_INET6 protocol family worker1 # [ 0.714574] Segment Routing with IPv6 lb # [ 0.719879] sched_clock: Marking stable (586015274, 133437563)->(789538712, -70085875) worker1 # [ 0.715234] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.723053] Segment Routing with IPv6 worker1 # [ 0.717855] IPI shorthand broadcast: enabled worker2 # [ 0.725572] In-situ OAM (IOAM) with IPv6 lb # [ 0.724721] registered taskstats version 1 worker2 # [ 0.726687] IPI shorthand broadcast: enabled lb # [ 0.725691] Loading compiled-in X.509 certificates client # [ 0.734726] Demotion targets for Node 0: null client # [ 0.737753] Key type .fscrypt registered client # [ 0.738459] Key type fscrypt-provisioning registered client # [ 0.739436] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.726119] sched_clock: Marking stable (592014529, 133445972)->(801124054, -75663553) client # [ 0.741724] ima: Allocated hash algorithm: sha1 client # [ 0.742546] ima: No architecture policies found worker2 # [ 0.736084] sched_clock: Marking stable (602014613, 133514142)->(811622681, -76093926) worker1 # [ 0.729666] registered taskstats version 1 worker1 # [ 0.730678] Loading compiled-in X.509 certificates worker2 # [ 0.739712] registered taskstats version 1 client # [ 0.746726] PM: Magic number: 10:775:83 worker2 # [ 0.740724] Loading compiled-in X.509 certificates client # [ 0.748354] RAS: Correctable Errors collector initialized. lb # [ 0.744469] Demotion targets for Node 0: null lb # [ 0.745369] Key type .fscrypt registered client # [ 0.756393] clk: Disabling unused clocks lb # [ 0.748457] Key type fscrypt-provisioning registered lb # [ 0.749463] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.750379] ima: Allocated hash algorithm: sha1 lb # [ 0.751212] ima: No architecture policies found client # [ 0.760731] PM: genpd: Disabling unused power domains lb # [ 0.753469] PM: Magic number: 10:775:83 worker1 # [ 0.749474] Demotion targets for Node 0: null lb # [ 0.755159] RAS: Correctable Errors collector initialized. worker1 # [ 0.750417] Key type .fscrypt registered worker2 # [ 0.759547] Demotion targets for Node 0: null worker1 # [ 0.752469] Key type fscrypt-provisioning registered worker1 # [ 0.753475] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.754435] ima: Allocated hash algorithm: sha1 worker2 # [ 0.762575] Key type .fscrypt registered worker2 # [ 0.763264] Key type fscrypt-provisioning registered worker2 # [ 0.764271] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.757493] ima: No architecture policies found worker2 # [ 0.766546] ima: Allocated hash algorithm: sha1 worker2 # [ 0.767380] ima: No architecture policies found worker1 # [ 0.760476] PM: Magic number: 10:775:83 lb # [ 0.766209] clk: Disabling unused clocks worker2 # [ 0.769545] PM: Magic number: 10:775:83 worker1 # [ 0.762197] RAS: Correctable Errors collector initialized. lb # [ 0.768475] PM: genpd: Disabling unused power domains worker2 # [ 0.771154] RAS: Correctable Errors collector initialized. worker1 # [ 0.772182] clk: Disabling unused clocks worker2 # [ 0.781214] clk: Disabling unused clocks worker1 # [ 0.774479] PM: genpd: Disabling unused power domains worker2 # [ 0.783547] PM: genpd: Disabling unused power domains client # [ 0.923040] Freeing initrd memory: 29056K client # [ 0.926247] Freeing unused decrypted memory: 2028K client # [ 0.928945] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.930081] Write protecting the kernel read-only data: 32768k client # [ 0.931985] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.933547] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.936622] Freeing initrd memory: 29064K lb # [ 0.939928] Freeing unused decrypted memory: 2028K lb # [ 0.942809] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.937775] Freeing initrd memory: 29056K lb # [ 0.943938] Write protecting the kernel read-only data: 32768k worker2 # [ 0.947396] Freeing initrd memory: 29060K lb # [ 0.945887] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.941037] Freeing unused decrypted memory: 2028K lb # [ 0.947386] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.950699] Freeing unused decrypted memory: 2028K worker1 # [ 0.943847] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.944982] Write protecting the kernel read-only data: 32768k worker2 # [ 0.953430] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.946931] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.954600] Write protecting the kernel read-only data: 32768k worker1 # [ 0.948522] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.956481] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.958061] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.984490] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.985604] Run /init as init process client # [ 0.996237] systemd[1]: Inserted module 'autofs4' lb # [ 0.998341] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.999482] Run /init as init process worker1 # [ 0.999609] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.000699] Run /init as init process client # [ 1.016060] fuse: init (API version 7.45) worker2 # [ 1.008926] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.010030] Run /init as init process lb # [ 1.010972] systemd[1]: Inserted module 'autofs4' client # [ 1.023384] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.025792] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.011620] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.020808] systemd[1]: Inserted module 'autofs4' client # [ 1.028879] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.030826] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.036120] virtiofs virtio5: discovered new tag: nix-store client # [ 1.037741] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.031146] fuse: init (API version 7.45) worker1 # [ 1.031587] fuse: init (API version 7.45) client # [ 1.047002] virtiofs virtio6: discovered new tag: shared lb # [ 1.038661] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.040701] fuse: init (API version 7.45) client # [ 1.048710] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.041361] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.052613] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.039008] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.044684] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.054161] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.048060] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.046871] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.041821] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.050890] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.044981] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.054169] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.047184] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.052812] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.054325] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.056558] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.053732] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.062474] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.055715] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.061485] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.064023] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.062980] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.066424] virtiofs virtio7: discovered new tag: xchg lb # [ 1.067894] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.063234] virtiofs virtio6: discovered new tag: shared client # [ 1.077983] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.071726] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.064748] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.073194] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.068231] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.076771] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.069801] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.078182] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.091585] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.091313] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.100334] systemd[1]: Successfully made /usr/ read-only. client # [ 1.413675] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.420534] systemd[1]: Detected virtualization kvm. client # [ 1.422774] systemd[1]: Detected architecture x86-64. client # [ 1.424929] systemd[1]: Running in initrd. client # [ 1.427514] systemd[1]: Initializing machine ID from random generator. client # [ 1.430419] systemd[1]: Hostname set to . worker1 # [ 1.426918] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.432064] systemd[1]: Detected virtualization kvm. worker1 # [ 1.432964] systemd[1]: Detected architecture x86-64. worker1 # [ 1.433839] systemd[1]: Running in initrd. lb # [ 1.428301] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.434932] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.436181] systemd[1]: Hostname set to . lb # [ 1.440622] systemd[1]: Detected virtualization kvm. lb # [ 1.442788] systemd[1]: Detected architecture x86-64. lb # [ 1.444955] systemd[1]: Running in initrd. worker2 # [ 1.437096] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.449253] systemd[1]: Detected virtualization kvm. lb # [ 1.447535] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.451569] systemd[1]: Detected architecture x86-64. lb # [ 1.450423] systemd[1]: Hostname set to . worker2 # [ 1.453747] systemd[1]: Running in initrd. worker2 # [ 1.456205] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.459144] systemd[1]: Hostname set to . worker1 # [ 1.625934] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.644154] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.658404] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.664265] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.668844] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.670275] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.671733] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.672901] systemd[1]: Reached target Path Units. worker1 # [ 1.673841] systemd[1]: Reached target Slice Units. worker1 # [ 1.674728] systemd[1]: Reached target Swaps. worker1 # [ 1.675549] systemd[1]: Reached target Timer Units. worker2 # [ 1.681789] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.676573] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.677780] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.683602] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.678963] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.679947] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.681005] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.682001] systemd[1]: Reached target Socket Units. lb # [ 1.687860] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.683881] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.689108] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.690634] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.691803] systemd[1]: Reached target Path Units. lb # [ 1.692768] systemd[1]: Reached target Slice Units. lb # [ 1.693703] systemd[1]: Reached target Swaps. worker1 # [ 1.688537] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.694568] systemd[1]: Reached target Timer Units. lb # [ 1.695604] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.696884] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.698115] systemd[1]: Listening on Journal Sockets. lb # [ 1.699179] systemd[1]: Listening on udev Control Socket. lb # [ 1.700256] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.701246] systemd[1]: Reached target Socket Units. lb # [ 1.703187] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.713600] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.707524] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.718166] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.719338] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.720770] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.721902] systemd[1]: Reached target Path Units. worker1 # [ 1.696648] systemd[1]: Starting Journal Service... client # [ 1.722823] systemd[1]: Reached target Slice Units. client # [ 1.723730] systemd[1]: Reached target Swaps. client # [ 1.724585] systemd[1]: Reached target Timer Units. client # [ 1.725573] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.726908] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.728095] systemd[1]: Listening on Journal Sockets. client # [ 1.729111] systemd[1]: Listening on udev Control Socket. client # [ 1.730144] systemd[1]: Listening on udev Kernel Socket. client # [ 1.731109] systemd[1]: Reached target Socket Units. client # [ 1.733044] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.722637] systemd[1]: Starting Load Kernel Modules... client # [ 1.737848] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.719139] systemd[1]: Starting Journal Service... worker1 # [ 1.726556] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.734901] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.738817] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.740054] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.733649] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.741483] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.742651] systemd[1]: Reached target Path Units. worker2 # [ 1.743587] systemd[1]: Reached target Slice Units. worker2 # [ 1.744501] systemd[1]: Reached target Swaps. worker2 # [ 1.745343] systemd[1]: Reached target Timer Units. lb # [ 1.743655] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.746300] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.747587] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.748796] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.749886] systemd[1]: Listening on udev Control Socket. lb # [ 1.747577] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.750914] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.751903] systemd[1]: Reached target Socket Units. worker1 # [ 1.745015] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.748936] systemd[1]: Starting Journal Service... worker2 # [ 1.754605] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.747904] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.757595] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.756542] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.753181] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.759864] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.774916] systemd[1]: Starting Load Kernel Modules... lb # [ 1.766051] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.778828] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.765870] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.775733] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.766595] systemd[1]: Starting Journal Service... client # [ 1.788954] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.780118] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.778531] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.787848] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.799410] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.792709] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.786518] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.802037] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.793891] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.796622] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.809047] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.804759] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.797639] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.805524] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.815181] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.808017] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.821667] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.816911] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.818182] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.819500] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.826052] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.819045] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.837004] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.832894] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.827664] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.845549] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.838922] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.840018] systemd[1]: Finished Load Kernel Modules. lb # [ 1.847076] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.849610] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.859122] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.848661] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.857011] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.858707] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.866602] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.867056] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.733459] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.868212] systemd[1]: Started Journal Service. client # [ 1.882343] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.875662] systemd[1]: Starting Apply Kernel Variables... worker1 # worker1 # [ 1.738322] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.739344] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.745042] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.893928] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.890082] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.891324] systemd[1]: Started Journal Service. worker1 # [ 1.752531] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.753581] systemd[1]: Reached target Local File Systems. lb # [ 1.756739] systemd-modules-load[68]: Inserted module 'dm_mod' lb # [ 1.760934] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.755696] systemd[1]: Starting Create System Files and Directories... lb # [ 1.761939] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.904794] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.898720] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.768109] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.763602] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.766703] systemd[1]: Finished Apply Kernel Variables. client # [ 1.916800] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.910086] systemd[1]: Finished Load Kernel Modules. lb # [ 1.776082] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.778836] systemd[1]: Reached target Local File Systems. client # [ 1.787776] systemd-modules-load[68]: Inserted module 'dm_mod' lb # [ 1.782967] systemd[1]: Starting Create System Files and Directories... client # [ 1.791985] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.918725] systemd[1]: Starting Apply Kernel Variables... client # [ 1.794107] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.929051] systemd[1]: Started Journal Service. lb # [ 1.788151] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.793539] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.789740] systemd[1]: Finished Create System Files and Directories. client # [ 1.806397] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.938660] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.813960] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.817770] systemd[1]: Reached target Local File Systems. worker2 # [ 1.808513] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.811369] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.812457] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.946926] systemd[1]: Started Journal Service. client # [ 1.821925] systemd[1]: Starting Create System Files and Directories... lb # [ 1.817241] systemd[1]: Finished Create System Files and Directories. client # [ 1.827665] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.814258] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.823186] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.825157] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.833161] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.826196] systemd[1]: Reached target Local File Systems. worker2 # [ 1.830161] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.834787] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.840387] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 1.840264] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.860445] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.861549] systemd[1]: Finished Create System Files and Directories. lb # [ 1.865146] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.880250] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.882318] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 1.904634] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.897828] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.907074] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.900216] systemd[1]: Reached target System Initialization. worker1 # [ 1.901067] systemd[1]: Reached target Basic System. lb # [ 1.922825] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.923789] systemd[1]: Reached target System Initialization. lb # [ 1.924668] systemd[1]: Reached target Basic System. client # [ 1.963755] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.964714] systemd[1]: Reached target System Initialization. client # [ 1.965558] systemd[1]: Reached target Basic System. worker2 # [ 1.962571] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.965699] systemd[1]: Reached target System Initialization. worker2 # [ 1.966567] systemd[1]: Reached target Basic System. worker1 # [ 2.201296] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.215064] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.232523] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.241929] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.242627] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.248956] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.253184] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.253587] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.259128] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.254379] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.260354] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.256259] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.267960] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.264491] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.265926] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.267033] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.273644] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.274356] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.276174] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.271104] usb usb1: Product: EHCI Host Controller worker1 # [ 2.271811] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.272698] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.273817] hub 1-0:1.0: USB hub found worker1 # [ 2.276592] hub 1-0:1.0: 6 ports detected lb # [ 2.283974] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.293134] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.284887] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.286366] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.290255] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.297469] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.289486] usb usb1: Product: EHCI Host Controller lb # [ 2.290144] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.291036] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.292541] hub 1-0:1.0: USB hub found lb # [ 2.293845] hub 1-0:1.0: 6 ports detected worker1 # [ 2.290578] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.304874] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.297641] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.305587] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.291295] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.308838] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.302284] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.301549] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.302335] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.299650] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.300422] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.317235] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.317978] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.310859] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.320104] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.313675] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.314355] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.310531] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.311637] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.326807] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.320295] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.329100] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.330214] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.324309] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.325057] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.333707] usb usb1: Product: EHCI Host Controller worker2 # [ 2.326839] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.324730] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.334371] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.325852] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.336649] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.338445] hub 1-0:1.0: USB hub found client # [ 2.339727] hub 1-0:1.0: 6 ports detected worker1 # [ 2.192182] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.334550] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.335475] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.343756] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.344507] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.338241] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.339538] usb usb1: Product: EHCI Host Controller worker2 # [ 2.340181] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.334404] usb usb2: Product: UHCI Host Controller worker2 # [ 2.342463] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.335307] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.343710] hub 1-0:1.0: USB hub found worker1 # [ 2.336327] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.345348] hub 1-0:1.0: 6 ports detected lb # [ 2.344117] usb usb2: Product: UHCI Host Controller worker2 # [ 2.347595] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.354594] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.207070] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.348309] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.355755] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.351623] SCSI subsystem initialized lb # [ 2.353227] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.213918] (udev-worker)[90]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.354116] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.363425] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.216215] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.357855] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.364538] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.354015] hub 2-0:1.0: USB hub found worker2 # [ 2.363316] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.363301] hub 2-0:1.0: USB hub found worker2 # [ 2.368820] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.368122] hub 2-0:1.0: 2 ports detected worker2 # [ 2.369938] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.378723] usb usb2: Product: UHCI Host Controller client # [ 2.379420] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.366479] hub 2-0:1.0: 2 ports detected lb # [ 2.238440] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.378154] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.389944] SCSI subsystem initialized lb # [ 2.382787] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.393726] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.252445] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.380399] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.381366] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.389410] usb usb2: Product: UHCI Host Controller worker2 # [ 2.390234] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.251318] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.267201] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.253884] systemd[1]: Finished Virtual Console Setup. lb # [ 2.259372] (udev-worker)[84]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.402892] hub 2-0:1.0: USB hub found lb # [ 2.261540] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.390755] SCSI subsystem initialized worker2 # [ 2.266114] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.274798] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.268080] systemd[1]: Starting Virtual Console Setup... client # [ 2.410101] hub 2-0:1.0: 2 ports detected worker1 # [ 2.398581] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.407586] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.275152] (udev-worker)[84]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.286360] (udev-worker)[90]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.288369] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.282161] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.409902] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.418855] SCSI subsystem initialized worker1 # [ 2.413629] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.423476] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.285072] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.285926] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.427022] hub 2-0:1.0: USB hub found worker1 # [ 2.287142] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.292229] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.421547] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.422669] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.296283] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.433570] hub 2-0:1.0: 2 ports detected worker1 # [ 2.428635] usb usb3: Product: UHCI Host Controller worker1 # [ 2.429302] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.430301] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.305507] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.313631] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.438312] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.440473] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.435818] hub 3-0:1.0: USB hub found client # [ 2.317518] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.310059] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.437523] hub 3-0:1.0: 2 ports detected client # [ 2.456148] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.456901] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.451334] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.449594] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.450797] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.445791] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.461194] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.447506] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.320068] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.320943] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.450540] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.451299] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.325078] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.460467] usb usb3: Product: UHCI Host Controller worker1 # [ 2.454768] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.461370] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.463682] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.464431] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.458563] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.473760] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.474562] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.465930] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.462236] usb usb4: Product: UHCI Host Controller lb # [ 2.468950] hub 3-0:1.0: USB hub found worker1 # [ 2.463552] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.464318] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.479268] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.480444] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.333374] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.472653] hub 3-0:1.0: 2 ports detected worker1 # [ 2.468845] hub 4-0:1.0: USB hub found worker2 # [ 2.476080] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.354593] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.339452] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.347302] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.488167] usb usb3: Product: UHCI Host Controller worker2 # [ 2.348330] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.474580] hub 4-0:1.0: 2 ports detected client # [ 2.356426] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.483653] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.482604] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.483416] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.360067] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.352323] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.493753] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.494545] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.487532] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.489538] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.488309] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.490694] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.500155] hub 3-0:1.0: USB hub found lb # [ 2.491792] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.501212] hub 3-0:1.0: 2 ports detected worker2 # [ 2.496557] usb usb3: Product: UHCI Host Controller lb # [ 2.494637] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.497235] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.366397] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.503314] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.504869] hub 3-0:1.0: USB hub found client # [ 2.511850] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.512614] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.371681] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.508581] hub 3-0:1.0: 2 ports detected lb # [ 2.508152] usb usb4: Product: UHCI Host Controller client # [ 2.518191] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.510516] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.519529] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.511342] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.514681] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.513140] hub 4-0:1.0: USB hub found client # [ 2.521954] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.515394] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.524747] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.516885] hub 4-0:1.0: 2 ports detected worker1 # [ 2.511474] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.520920] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.513799] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.389328] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.524664] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.518658] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.532819] usb usb4: Product: UHCI Host Controller worker1 # [ 2.519656] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.402444] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.536228] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.396482] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.524029] scsi host0: ahci lb # [ 2.529475] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.531369] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.525782] scsi host1: ahci worker2 # [ 2.533568] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.540999] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.527333] scsi host2: ahci client # [ 2.409601] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.529171] scsi host3: ahci lb # [ 2.533967] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.544147] hub 4-0:1.0: USB hub found worker1 # [ 2.530890] scsi host4: ahci worker1 # [ 2.532557] scsi host5: ahci worker2 # [ 2.539796] usb usb4: Product: UHCI Host Controller client # [ 2.547770] hub 4-0:1.0: 2 ports detected worker1 # [ 2.533143] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.541824] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.535272] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.543659] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.536491] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.537615] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.538729] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.547479] hub 4-0:1.0: USB hub found lb # [ 2.545383] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.539891] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.546234] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.549601] hub 4-0:1.0: 2 ports detected client # [ 2.565852] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.558177] scsi host0: ahci lb # [ 2.559770] scsi host1: ahci lb # [ 2.561625] scsi host2: ahci lb # [ 2.563252] scsi host3: ahci lb # [ 2.564945] scsi host4: ahci lb # [ 2.566516] scsi host5: ahci worker2 # [ 2.568723] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.567147] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.576596] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.577725] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.569246] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.579230] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.570469] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.571736] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.572894] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.574076] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.578373] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.579835] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.588459] scsi host0: ahci client # [ 2.590786] scsi host1: ahci worker2 # [ 2.585542] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.594218] scsi host2: ahci worker2 # [ 2.587379] scsi host0: ahci client # [ 2.595633] scsi host3: ahci worker2 # [ 2.588870] scsi host1: ahci client # [ 2.597363] scsi host4: ahci worker2 # [ 2.590598] scsi host2: ahci client # [ 2.599024] scsi host5: ahci worker2 # [ 2.592664] scsi host3: ahci client # [ 2.599598] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.594389] scsi host4: ahci client # [ 2.601726] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.596019] scsi host5: ahci client # [ 2.602871] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.597113] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.604090] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.605271] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.598834] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.606482] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.600030] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.601168] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.602329] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.603497] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.641570] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.644375] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.647594] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.649352] usb 1-1: Manufacturer: QEMU worker1 # [ 2.650984] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.661581] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.664398] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.667895] usb 1-1: Product: QEMU USB Tablet lb # [ 2.669659] usb 1-1: Manufacturer: QEMU lb # [ 2.671118] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.688420] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.694610] hid: raw HID events driver (C) Jiri Kosina client # [ 2.708053] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.710311] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.712903] usb 1-1: Product: QEMU USB Tablet client # [ 2.714318] usb 1-1: Manufacturer: QEMU client # [ 2.715597] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.715553] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.716713] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.718068] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.718781] usb 1-1: Manufacturer: QEMU worker2 # [ 2.719349] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.735308] hid: raw HID events driver (C) Jiri Kosina client # [ 2.750149] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.610387] systemd[1]: Mounting /sysroot... lb # [ 2.634591] systemd[1]: Mounting /sysroot... client # [ 2.665362] systemd[1]: Mounting /sysroot... worker2 # [ 2.680781] systemd[1]: Mounting /sysroot... worker1 # [ 2.847314] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.856200] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.857103] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.858181] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.859036] ata3.00: applying bridge limits worker1 # [ 2.859814] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.860737] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.861621] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.862410] ata3.00: configured for UDMA/100 worker1 # [ 2.863520] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.891757] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.892859] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.894008] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.895046] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.895852] ata3.00: applying bridge limits lb # [ 2.896596] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.897475] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.898273] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.899218] ata3.00: configured for UDMA/100 lb # [ 2.900342] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.911036] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.920782] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.913343] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.922063] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.916028] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.923624] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.925385] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.918493] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.927112] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.920648] ata3.00: applying bridge limits client # [ 2.928975] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.922571] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.931004] ata3.00: applying bridge limits client # [ 2.932472] ata3.00: configured for UDMA/100 worker2 # [ 2.924986] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.934056] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.927129] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.923024] usbcore: registered new interface driver usbhid worker2 # [ 2.929700] ata3.00: configured for UDMA/100 client # [ 2.936380] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.925881] usbhid: USB HID core driver worker2 # [ 2.932240] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.945600] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.957740] usbcore: registered new interface driver usbhid lb # [ 2.958541] usbhid: USB HID core driver worker1 # [ 2.953678] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.957582] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.961622] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.972303] EXT4-fs (vda): mounted filesystem 7d823774-0814-4db3-bca3-e30f19ea8fc0 r/w with ordered data mode. Quota mode: none. lb # [ 2.980778] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.844622] systemd[1]: Mounted /sysroot. lb # [ 2.984703] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.846154] systemd[1]: Reached target Initrd Root File System. lb # [ 2.985874] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.851072] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.001558] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 3.012893] usbcore: registered new interface driver usbhid worker1 # [ 2.866744] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.016480] usbhid: USB HID core driver worker2 # [ 3.010766] usbcore: registered new interface driver usbhid worker1 # [ 2.869584] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.011572] usbhid: USB HID core driver worker1 # [ 2.871058] systemd[1]: Reloading... lb # [ 3.015301] EXT4-fs (vda): mounted filesystem 1cb8b1e1-3655-44cd-a136-c6cc505c2048 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.023674] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.889278] systemd[1]: Mounted /sysroot. lb # [ 2.889922] systemd[1]: Reached target Initrd Root File System. lb # [ 2.892086] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.029760] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 3.038284] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.031672] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 3.041774] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 3.037658] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 3.045075] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.904282] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.907063] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.909113] systemd[1]: Reloading... client # [ 3.055965] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 3.059554] EXT4-fs (vda): mounted filesystem 8c7b3614-db1c-412b-887e-f6c723c095b2 r/w with ordered data mode. Quota mode: none. client # [ 2.933459] systemd[1]: Mounted /sysroot. client # [ 2.936549] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.064368] EXT4-fs (vda): mounted filesystem 39edbccd-c281-4673-885f-74cac8e156c6 r/w with ordered data mode. Quota mode: none. client # [ 2.939837] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.936476] systemd[1]: Mounted /sysroot. worker2 # [ 2.939066] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.941811] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.954118] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.958509] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.961082] systemd[1]: Reloading... worker2 # [ 2.955364] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.951689] systemd[1]: Reloading finished in 79 ms. worker2 # [ 2.961176] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.962612] systemd[1]: Reloading... worker1 # [ 2.960430] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.965172] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 2.968097] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.969490] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.971137] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 2.989889] systemd[1]: Reloading finished in 81 ms. lb # [ 2.999077] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... lb # [ 3.003139] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... lb # [ 3.006863] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.008388] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.009452] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.045292] systemd[1]: Reloading finished in 84 ms. worker2 # [ 3.042307] systemd[1]: Reloading finished in 81 ms. client # [ 3.054299] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... client # [ 3.057145] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker2 # [ 3.050584] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... client # [ 3.062690] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.055166] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... client # [ 3.064121] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.065171] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.058166] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.059502] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.060658] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.612180] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.618167] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.627323] systemd[1]: Mounting /sysroot/run... lb # [ 3.635937] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.641958] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.638639] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.649167] systemd[1]: Mounting /sysroot/run... lb # [ 3.658306] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.668190] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.654278] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.675154] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.671903] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.684172] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.681093] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.684209] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.695170] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.689163] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.692142] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.685827] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.687272] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.697139] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.704621] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.691523] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.694950] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.696983] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.700650] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.709986] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.711210] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.717067] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.717826] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.712622] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.719203] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.722356] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.725965] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.725821] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.729059] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.730907] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.731740] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.733150] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.742969] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.736837] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.736224] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.737675] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.749646] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.751160] systemd[1]: Mounted /sysroot/run. client # [ 3.752721] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.753704] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.747403] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.748871] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.757934] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.751089] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.768506] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.769965] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.772393] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.773192] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.774335] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.775995] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.778551] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.793877] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.795294] systemd[1]: Reached target Initrd File Systems. client # [ 3.796953] systemd[1]: Starting Find NixOS closure... client # [ 3.799597] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.799156] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.806716] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.808200] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.809670] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.818322] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.825411] systemd[1]: Finished Find NixOS closure. client # [ 3.826698] systemd[1]: Reached target Initrd Default Target. client # [ 3.828631] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.822440] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.823581] systemd[1]: Stopped target Basic System. worker2 # [ 3.824535] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.826109] systemd[1]: Stopped target Path Units. worker2 # [ 3.826785] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.827876] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.828940] systemd[1]: Stopped target Slice Units. worker2 # [ 3.829687] systemd[1]: Stopped target Socket Units. worker2 # [ 3.830795] systemd[1]: Stopped target System Initialization. worker2 # [ 3.831819] systemd[1]: Stopped target Swaps. worker2 # [ 3.832762] systemd[1]: Stopped target Timer Units. worker2 # [ 3.833811] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.834860] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.842920] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.836129] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.844194] systemd[1]: Stopped target Basic System. worker2 # [ 3.837196] systemd[1]: Stopped Find NixOS closure. client # [ 3.846061] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.838707] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.846842] systemd[1]: Stopped target Path Units. worker2 # [ 3.839694] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.847526] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.848678] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.841295] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.849706] systemd[1]: Stopped target Slice Units. client # [ 3.850395] systemd[1]: Stopped target Socket Units. worker2 # [ 3.843068] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.851124] systemd[1]: Stopped target System Initialization. worker2 # [ 3.844066] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.844750] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.853151] systemd[1]: Stopped target Swaps. worker2 # [ 3.845781] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.853822] systemd[1]: Stopped target Timer Units. client # [ 3.854518] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.846763] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.855409] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.856243] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.848717] systemd[1]: Stopped Create System Files and Directories. client # [ 3.857232] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.850127] systemd[1]: Stopped target Local File Systems. client # [ 3.858467] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.850911] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.852178] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.860125] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.861195] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.854131] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.862208] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.863370] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.855660] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.864411] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.857286] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.858384] systemd[1]: Stopped Virtual Console Setup. client # [ 3.866164] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.867448] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.868630] systemd[1]: Stopped Create System Files and Directories. client # [ 3.869776] systemd[1]: Stopped target Local File Systems. client # [ 3.871146] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.872440] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.873601] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.867400] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.875130] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.876142] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.869129] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.877949] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.871121] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.875367] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.886819] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.879175] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.880578] systemd[1]: Closed udev Control Socket. worker2 # [ 3.882284] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.883209] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.891436] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.884352] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.886235] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.887467] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.888568] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.896562] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.889604] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.890864] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.898624] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.893133] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.901695] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.902721] systemd[1]: Closed udev Control Socket. client # [ 3.903900] systemd[1]: Starting Cleanup udev Database... client # [ 3.904747] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.906129] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.906991] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.909116] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.910091] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.910993] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.912191] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.913629] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.907196] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.908635] systemd[1]: Finished Cleanup udev Database. worker2 # [ 3.910162] systemd[1]: Reached target Switch Root. worker2 # [ 3.911541] systemd[1]: Starting NixOS Activation... client # [ 3.930164] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.931637] systemd[1]: Finished Cleanup udev Database. client # [ 3.933127] systemd[1]: Reached target Switch Root. client # [ 3.935232] systemd[1]: Starting NixOS Activation... worker2 # [ 3.974259] initrd-nixos-activation-start[190]: booting system configuration /nix/store/gcqx0ly4a11w34z8kprj4p7mv3aciczk-nixos-system-worker2-test client # [ 3.993633] initrd-nixos-activation-start[192]: booting system configuration /nix/store/dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test worker2 # [ 3.997532] initrd-nixos-activation-start[190]: running activation script... client # [ 4.020605] initrd-nixos-activation-start[192]: running activation script... worker2 # [ 4.180322] initrd-nixos-activation-start[213]: setting up /etc... client # [ 4.215954] initrd-nixos-activation-start[215]: setting up /etc... worker2 # [ 4.291992] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.293639] systemd[1]: Finished NixOS Activation. worker2 # [ 4.295658] systemd[1]: Starting Switch Root... client # [ 4.309708] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.312113] systemd[1]: Finished NixOS Activation. client # [ 4.314321] systemd[1]: Starting Switch Root... worker2 # [ 4.308154] systemd[1]: Switching root. client # [ 4.327149] systemd[1]: Switching root. worker2 # [ 4.568904] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.593081] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.680042] NET: Registered PF_VSOCK protocol family worker2 # [ 4.680425] NET: Registered PF_VSOCK protocol family worker1 # [ 4.611879] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.637077] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.659995] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.661570] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.663497] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.667214] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.684354] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.687390] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.685913] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.691143] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.687647] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.696675] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.695211] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.696426] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.698125] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.711549] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.713126] systemd[1]: Stopped target Basic System. lb # [ 4.718812] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.713878] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.714654] systemd[1]: Stopped target Path Units. worker1 # [ 4.715479] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.721293] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.716780] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.719191] systemd[1]: Stopped target Slice Units. worker1 # [ 4.719933] systemd[1]: Stopped target Socket Units. worker1 # [ 4.720672] systemd[1]: Stopped target System Initialization. worker1 # [ 4.721479] systemd[1]: Stopped target Swaps. worker1 # [ 4.722102] systemd[1]: Stopped target Timer Units. worker1 # [ 4.722781] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.728765] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.723620] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.729864] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.724829] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.725874] systemd[1]: Stopped Find NixOS closure. lb # [ 4.731570] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.727067] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.728111] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.729158] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.730363] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.732244] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.733160] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.734453] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.735729] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.737104] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.737962] systemd[1]: Stopped target Local File Systems. lb # [ 4.744545] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.740155] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.745735] systemd[1]: Stopped target Basic System. worker1 # [ 4.741236] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.748254] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.749050] systemd[1]: Stopped target Path Units. worker1 # [ 4.743023] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.749709] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.744846] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.750697] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.745860] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.751706] systemd[1]: Stopped target Slice Units. lb # [ 4.752432] systemd[1]: Stopped target Socket Units. worker1 # [ 4.747657] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.753187] systemd[1]: Stopped target System Initialization. lb # [ 4.753914] systemd[1]: Stopped target Swaps. lb # [ 4.754553] systemd[1]: Stopped target Timer Units. lb # [ 4.755258] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.756050] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.756857] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.758398] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.754117] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.759614] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.761147] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.762380] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.763385] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.758154] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.764706] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.765754] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.767095] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.761892] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.768843] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.769923] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.765066] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.771343] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.766129] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.772140] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.773399] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.768673] systemd[1]: Closed udev Control Socket. lb # [ 4.775135] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.770075] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.770850] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.771901] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.778073] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.773124] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.779110] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.774189] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.780077] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.775197] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.777103] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.778223] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.779593] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.790678] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.792247] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.794961] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.797142] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.794892] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.800907] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.802226] systemd[1]: Closed udev Control Socket. worker1 # [ 4.797061] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.797804] systemd[1]: Reached target Switch Root. lb # [ 4.803812] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.799366] systemd[1]: Starting NixOS Activation... lb # [ 4.804728] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.805840] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.807226] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.808367] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.810143] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.811076] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.811895] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.814143] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.828853] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.831089] systemd[1]: Finished Cleanup udev Database. lb # [ 4.831778] systemd[1]: Reached target Switch Root. lb # [ 4.833514] systemd[1]: Starting NixOS Activation... worker1 # [ 4.869178] initrd-nixos-activation-start[192]: booting system configuration /nix/store/qdm894g7fk24niwl4p4m0ddcdy1ggpcl-nixos-system-worker1-test worker1 # [ 4.895779] initrd-nixos-activation-start[192]: running activation script... client # [ 5.036597] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.046220] systemd[1]: Detected virtualization kvm. lb # [ 4.904751] initrd-nixos-activation-start[192]: booting system configuration /nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test client # [ 5.048049] systemd[1]: Detected architecture x86-64. client # [ 5.049914] systemd[1]: Detected first boot. client # [ 5.053285] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.040325] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.050058] systemd[1]: Detected virtualization kvm. worker2 # [ 5.051862] systemd[1]: Detected architecture x86-64. worker2 # [ 5.053917] systemd[1]: Detected first boot. worker2 # [ 5.058040] systemd[1]: Initializing machine ID from random generator. lb # [ 4.931693] initrd-nixos-activation-start[192]: running activation script... worker2 # [ 5.180878] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.082783] initrd-nixos-activation-start[215]: setting up /etc... client # [ 5.260234] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.130100] initrd-nixos-activation-start[215]: setting up /etc... worker2 # [ 5.277129] systemd[1]: Applying preset policy. worker1 # [ 5.186968] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.189174] systemd[1]: Finished NixOS Activation. worker1 # [ 5.190560] systemd[1]: Starting Switch Root... worker1 # [ 5.203782] systemd[1]: Switching root. client # [ 5.359616] systemd[1]: Applying preset policy. lb # [ 5.236915] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.238583] systemd[1]: Finished NixOS Activation. lb # [ 5.240601] systemd[1]: Starting Switch Root... lb # [ 5.254763] systemd[1]: Switching root. worker2 # [ 5.445661] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.459657] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 5.497277] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.519893] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.558658] NET: Registered PF_VSOCK protocol family lb # [ 5.609513] NET: Registered PF_VSOCK protocol family worker2 # [ 5.634948] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.636349] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.638809] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.640902] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.642307] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.643231] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.644605] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.645784] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.646557] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.647265] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.648098] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.648902] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.649725] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.650594] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.657894] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.651522] systemd[1]: Reached target Path Units. worker2 # [ 5.652186] systemd[1]: Reached target Remote File Systems. client # [ 5.659284] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.652959] systemd[1]: Reached target Slice Units. worker2 # [ 5.653699] systemd[1]: Reached target Swaps. client # [ 5.661272] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.655357] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 5.663321] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.657713] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.664602] systemd[1]: Created slice User and Session Slice. client # [ 5.665570] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.666797] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 5.667916] systemd[1]: Expecting device /dev/hvc0... client # [ 5.668623] systemd[1]: Expecting device /dev/ttyS0... client # [ 5.669434] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.670235] systemd[1]: Stopped target initrd-fs.target. client # [ 5.671018] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.671832] systemd[1]: Stopped target initrd-switch-root.target. client # [ 5.672784] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.673765] systemd[1]: Reached target Path Units. client # [ 5.674481] systemd[1]: Reached target Remote File Systems. client # [ 5.675235] systemd[1]: Reached target Slice Units. client # [ 5.675940] systemd[1]: Reached target Swaps. worker2 # [ 5.659329] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.677781] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.672953] systemd[1]: Listening on Factory Reset Management. client # [ 5.680212] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.673907] systemd[1]: Listening on Hostname Service Socket. client # [ 5.682020] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.676480] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.677850] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.680335] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.681426] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.682587] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.683891] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.687371] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.688376] systemd[1]: Listening on udev Control Socket. client # [ 5.683884] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.689241] systemd[1]: Listening on udev Varlink Socket. client # [ 5.696299] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.691463] systemd[1]: Mounting Huge Pages File System... client # [ 5.699104] systemd[1]: Starting Journal Log Access Socket... client # [ 5.700481] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.695589] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.703156] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.704232] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 5.705390] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.706707] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.700839] systemd[1]: Mounting Kernel Debug File System... client # [ 5.710527] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.711575] systemd[1]: Listening on udev Control Socket. client # [ 5.712498] systemd[1]: Listening on udev Varlink Socket. client # [ 5.714548] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.709980] systemd[1]: Mounting Kernel Trace File System... client # [ 5.717754] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.717537] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.724802] systemd[1]: Mounting Kernel Debug File System... client # [ 5.730043] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.725839] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.728897] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 5.738761] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.737671] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.748770] systemd[1]: Starting Load Kernel Module configfs... client # [ 5.749628] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.748165] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.763562] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.761307] systemd[1]: Mounting FUSE Control File System... client # [ 5.771150] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.764643] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 5.784801] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.779682] systemd[1]: Starting Journal Service... client # [ 5.785638] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.787033] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.792110] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 5.804084] systemd[1]: Starting Journal Service... worker2 # [ 5.798119] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.800566] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.810183] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.806911] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.812047] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.813802] systemd[1]: Mounted Huge Pages File System. client # [ 5.821331] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.815688] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.818639] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.819968] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.822823] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.825005] systemd[1]: Mounted FUSE Control File System. client # [ 5.835922] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.829563] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.838793] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.832534] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.833895] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.838387] systemd[1]: Mounting Kernel Configuration File System... client # [ 5.850622] systemd[1]: Starting Coldplug All udev Devices... client # [ 5.852933] systemd-journald[285]: Collecting audit messages is enabled. client # [ 5.863038] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.860376] systemd[1]: Mounted Kernel Configuration File System. client # [ 5.869853] systemd[1]: Mounted Huge Pages File System. client # [ 5.738927] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.742327] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 5.880467] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.883168] systemd[1]: Started Journal Service. client # [ 5.753995] systemd[1]: Mounted Kernel Debug File System. client # [ 5.755870] systemd[1]: Mounted Kernel Trace File System. client # [ 5.761367] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.762333] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 5.767099] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.769366] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.899276] EXT4-fs (vda): re-mounted 39edbccd-c281-4673-885f-74cac8e156c6. worker2 # [ 5.901727] systemd-journald[283]: Collecting audit messages is enabled. client # [ 5.909344] loop: module loaded client # [ 5.779556] systemd-modules-load[286]: Inserted module 'loop' worker2 # [ 5.908989] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.911867] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.913623] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.791106] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.919839] loop: module loaded client # [ 5.794450] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.920852] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.922564] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.799217] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.930592] systemd[1]: Finished Load Kernel Modules. client # [ 5.806450] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.940736] EXT4-fs (vda): re-mounted 8c7b3614-db1c-412b-887e-f6c723c095b2. worker1 # [ 5.918505] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.934942] systemd[1]: Starting Firewall... worker1 # [ 5.928239] systemd[1]: Detected virtualization kvm. worker1 # [ 5.930090] systemd[1]: Detected architecture x86-64. worker1 # [ 5.932064] systemd[1]: Detected first boot. worker2 # [ 5.940846] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 5.935941] systemd[1]: Initializing machine ID from random generator. client # [ 5.826680] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 5.833570] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.962858] systemd[1]: Started Journal Service. client # [ 5.840442] systemd-oomd[288]: No swap; memory pressure usage will be degraded client # [ 5.843395] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 5.830677] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.844416] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 5.837805] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 5.855099] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.848153] systemd-modules-load[284]: Inserted module 'loop' client # [ 5.855908] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.857157] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.849457] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.973986] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.983741] systemd[1]: Detected virtualization kvm. lb # [ 5.985523] systemd[1]: Detected architecture x86-64. lb # [ 5.987483] systemd[1]: Detected first boot. lb # [ 5.991569] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.865362] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 5.874516] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 5.905243] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.899656] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 5.900652] systemd[1]: Reached target First Boot Complete. client # [ 6.042146] systemd-journald[285]: Received client request to flush runtime journal. worker2 # [ 6.055206] systemd-journald[283]: Received client request to flush runtime journal. worker1 # [ 6.058508] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.994445] systemd[1]: Finished Load/Save OS Random Seed. client # [ 5.996245] systemd[1]: Reached target First Boot Complete. client # [ 5.997761] systemd[1]: Finished Apply Kernel Variables. client # [ 6.001333] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.015192] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.019735] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.148537] systemd[1]: Applying preset policy. worker2 # [ 6.067404] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.070592] systemd-oomd[285]: No swap; memory pressure usage will be degraded client # [ 6.080145] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.075272] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.077168] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.078063] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.079058] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.080867] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.089036] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.091141] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.092633] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 6.220256] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.115056] systemd-udevd[315]: Using default interface naming scheme 'v261'. client # [ 6.123768] systemd-udevd[317]: Using default interface naming scheme 'v261'. client # [ 6.155152] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.183391] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.310317] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.318686] systemd[1]: Applying preset policy. client # [ 6.238138] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.284982] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.296835] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.295382] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.324943] (udev-worker)[321]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.329062] (udev-worker)[321]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.331352] (udev-worker)[323]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.492149] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.493633] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 6.368808] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.495869] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.502282] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.497924] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.499251] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.500200] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.501417] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.502497] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.503216] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.503994] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.504856] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.505617] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.506380] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.507264] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.508198] systemd[1]: Reached target Path Units. worker1 # [ 6.508937] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.509700] systemd[1]: Reached target Slice Units. worker1 # [ 6.510379] systemd[1]: Reached target Swaps. worker1 # [ 6.512139] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 6.514547] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 6.516237] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.402846] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.404705] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.406093] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.408400] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.409885] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.518111] systemd[1]: Listening on Factory Reset Management. client # [ 6.411543] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.530714] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 6.533677] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.534824] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.537399] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.538541] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.539649] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.540981] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.544875] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.545916] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.546789] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.548888] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.551320] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.556867] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.564586] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.571325] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.586200] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 6.450082] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.578509] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.579334] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.584757] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.589257] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.614725] ACPI: button: Power Button [PWRF] worker2 # [ 6.475378] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.603517] systemd[1]: Mounting FUSE Control File System... worker1 # [ 6.604327] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.636237] mousedev: PS/2 mouse device common for all mice worker2 # [ 6.503442] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.631910] systemd[1]: Starting Journal Service... worker2 # [ 6.510226] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.637962] systemd[1]: Starting Load Kernel Modules... client # [ 6.652759] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 6.644816] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.527673] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.649504] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 6.650397] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.525724] (udev-worker)[350]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.528151] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.669542] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 6.657182] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.663963] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.665337] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.662202] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.667859] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.669889] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.664635] systemd[1]: Mounted Huge Pages File System. lb # [ 6.671233] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.666591] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.672134] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.673334] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.668954] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.674469] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.675151] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.675896] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.676753] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.671380] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.677546] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.678297] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.679131] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.673650] systemd[1]: Mounted FUSE Control File System. lb # [ 6.680127] systemd[1]: Reached target Path Units. lb # [ 6.680898] systemd[1]: Reached target Remote File Systems. lb # [ 6.681868] systemd[1]: Reached target Slice Units. lb # [ 6.682622] systemd[1]: Reached target Swaps. lb # [ 6.684487] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.554145] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.554885] systemd[1]: Reached target Local File Systems. lb # [ 6.687018] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.557247] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.688832] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.684278] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 6.560440] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.563682] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.690337] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 6.564781] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.573631] systemd[1]: Mounted /run/wrappers. client # [ 6.575109] systemd[1]: Reached target Local File Systems. worker2 # [ 6.567899] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.578071] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.690792] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.571312] systemd[1]: Starting Create System Files and Directories... lb # [ 6.703303] systemd[1]: Listening on Hostname Service Socket. client # [ 6.581071] systemd[1]: Starting register-nix-paths.service... lb # [ 6.706112] systemd[1]: Starting Journal Log Access Socket... lb # [ 6.707631] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.710491] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.711623] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.712768] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.714051] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.590780] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.591574] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.592721] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 6.718076] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.719115] systemd[1]: Listening on udev Control Socket. lb # [ 6.720003] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.714522] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.597571] systemd[1]: Starting Create System Files and Directories... lb # [ 6.722230] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.717500] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.724799] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.722077] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.732587] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.739105] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.748165] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.744656] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.759747] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.759786] EXT4-fs (vda): re-mounted 7d823774-0814-4db3-bca3-e30f19ea8fc0. lb # [ 6.765530] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.770797] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.772774] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.774961] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.781151] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.780876] systemd-journald[285]: Collecting audit messages is enabled. lb # [ 6.787725] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.782849] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.783802] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.788985] loop: module loaded lb # [ 6.797564] systemd[1]: Mounting FUSE Control File System... lb # [ 6.800001] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.799260] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.803806] systemd[1]: Starting Firewall... worker2 # [ 6.682341] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.812159] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.817887] systemd[1]: Starting Journal Service... worker2 # [ 6.687495] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.823025] systemd[1]: Starting Load Kernel Modules... client # [ 6.706806] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.833610] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.711784] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.714711] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.713261] systemd[1]: Finished Create System Files and Directories. lb # [ 6.847511] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.725369] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.718236] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.710357] systemd[1]: Queued start job for default target Multi-User System.[ 6.844890] systemd[1]: Started Journal Service. worker2 # [ 6.720395] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # lb # [ 6.852617] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.729731] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.717901] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.721368] systemd-modules-load[286]: Inserted module 'loop' lb # [ 6.862391] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 6.731195] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.732445] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.872966] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.875798] systemd-journald[285]: Collecting audit messages is enabled. worker1 # [ 6.739579] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.881841] systemd[1]: Mounted Huge Pages File System. lb # [ 6.884631] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.893177] systemd[1]: Mounted Kernel Debug File System. client # [ 6.679309] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 6.760429] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.899794] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.761509] systemd[1]: Reached target First Boot Complete. lb # [ 6.909800] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.778706] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.915726] systemd[1]: Started Journal Service. lb # [ 6.783378] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.788814] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 6.924512] loop: module loaded lb # [ 6.794241] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.795588] systemd-modules-load[286]: Inserted module 'loop' worker1 # [ 6.788503] systemd-oomd[287]: No swap; memory pressure usage will be degraded worker2 # [ 6.798343] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.806204] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.801629] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 6.809264] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.937911] systemd-journald[285]: Received client request to flush runtime journal. lb # [ 6.813084] systemd[1]: Mounted FUSE Control File System. lb # [ 6.822402] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.956649] EXT4-fs (vda): re-mounted 1cb8b1e1-3655-44cd-a136-c6cc505c2048. client # [ 6.834417] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.827886] systemd[1]: Starting Firewall... client # [ 6.840977] systemd[1]: Starting Update is Completed... lb # [ 6.837985] systemd[1]: Starting Apply Kernel Variables... client # [ 6.679394] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 6.684718] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 6.843067] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.849830] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.854080] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.858062] systemd[1]: Starting Update is Completed... lb # [ 6.858282] systemd-oomd[287]: No swap; memory pressure usage will be degraded lb # [ 6.862745] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.875684] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.887731] systemd[1]: Finished Update is Completed. client # [ 6.684784] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T15:03:18 UTC (1790089398) lb # [ 6.879142] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.684855] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 6.889178] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.889952] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.894350] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.695501] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 6.729370] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 6.903636] Console: switching to colour dummy device 80x25 client # [ 7.024824] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.024938] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 6.935268] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.944065] systemd[1]: Finished Update is Completed. worker1 # [ 6.937438] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.941103] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.942236] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.943424] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.085749] systemd-journald[285]: Received client request to flush runtime journal. client # [ 7.038156] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.038418] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 6.988827] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 6.991587] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.993909] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.996196] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.998467] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.000707] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.002810] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.999555] systemd-udevd[318]: Using default interface naming scheme 'v261'. client # [ 7.150457] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.150460] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.155800] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.156503] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.043381] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.046985] systemd[1]: Finished Firewall. lb # [ 7.047158] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.048301] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.050828] systemd[1]: Reached target First Boot Complete. lb # [ 7.052326] systemd[1]: Finished Apply Kernel Variables. lb # [ 7.056234] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.059103] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 7.063612] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 7.077424] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.110753] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.113694] systemd[1]: Stopped Virtual Console Setup. client # [ 7.122553] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.249144] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.270065] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.281052] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.144392] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.163100] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 7.171762] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.172938] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.171392] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.172636] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.175429] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 7.311802] ppdev: user-space parallel port driver lb # [ 7.219896] systemd-udevd[326]: Using default interface naming scheme 'v261'. client # [ 7.348928] Console: switching to colour frame buffer device 160x50 client # [ 7.351077] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 7.363033] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.372484] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 7.191386] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.241547] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 7.236099] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.255819] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.258227] systemd[1]: Stopped Virtual Console Setup. client # [ 7.264675] systemd[1]: Starting Virtual Console Setup... lb # [ 7.266209] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.310696] ACPI: button: Power Button [PWRF] worker2 # [ 7.336544] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.403763] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.409595] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.409660] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T15:03:18 UTC (1790089398) worker2 # [ 7.409736] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.411729] systemd-journald[283]: Time jumped backwards, rotating. worker1 # [ 7.328569] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.493305] kvm_amd: TSC scaling supported client # [ 7.494153] kvm_amd: Nested Virtualization enabled client # [ 7.494646] kvm_amd: Nested Paging enabled client # [ 7.495390] kvm_amd: LBR virtualization supported client # [ 7.496025] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.496570] kvm_amd: Virtual GIF supported client # [ 7.497416] kvm_amd: Virtual NMI enabled worker1 # [ 7.362202] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.424391] Console: switching to colour dummy device 80x25 worker2 # [ 7.436780] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.436884] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.370438] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.383404] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.536504] EDAC MC: Ver: 3.0.0 worker2 # [ 7.507979] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.531286] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.531289] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.401389] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.413769] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.416073] systemd[1]: Reached target Local File Systems. worker2 # [ 7.559590] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 7.560226] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.420215] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.424185] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.428338] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.429284] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.434336] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.438904] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.454984] (udev-worker)[362]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.462875] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 7.458274] (udev-worker)[362]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.492903] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 7.495154] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.496782] systemd[1]: Reached target System Initialization. worker2 # [ 7.498884] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.499889] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.501088] systemd[1]: Reached target Timer Units. worker2 # [ 7.501818] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.503096] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.520336] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 7.519323] (udev-worker)[353]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 7.522602] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.521531] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.525140] systemd[1]: Reached target Socket Units. worker2 # [ 7.526785] systemd[1]: Reached target Basic System. lb # [ 7.524983] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.531707] systemd[1]: Started backdoor.service. client # [ 7.540281] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.533662] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.536323] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.539548] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.544828] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.545582] systemd[1]: Started Reset console on configuration changes. client # [ 7.554633] systemd-vconsole-setup[420]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 7.558064] systemd[1]: Finished Virtual Console Setup. client # [ 7.558906] systemd[1]: Reached target System Initialization. client # [ 7.560291] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.561429] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.554068] systemd[1]: Starting resolvconf update... client # [ 7.562703] systemd[1]: Reached target Timer Units. client # [ 7.564212] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.565113] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.558087] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.565913] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 7.567885] systemd[1]: Reached target Socket Units. client # [ 7.568600] systemd[1]: Reached target Basic System. client # [ 7.570091] systemd[1]: Started backdoor.service. client # [ 7.574060] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 7.579051] systemd[1]: Starting nftables firewall... client # [ 7.582957] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.579090] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.573330] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 7.579795] systemd[1]: Reached target Local File Systems. worker1 # [ 7.576625] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.594063] systemd[1]: Starting Post-Boot Actions... lb # [ 7.584427] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.589232] systemd[1]: Starting register-nix-paths.service... lb # [ 7.592500] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.593382] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.606324] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.591347] systemd[1]: Finished Create System Files and Directories. lb # [ 7.599137] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.596094] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.598345] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 7.615075] systemd[1]: Starting Create System Files and Directories... client # [ 7.625130] systemd[1]: Starting resolvconf update... client # connecting to host... worker2 # [ 7.638239] systemd[1]: Finished Post-Boot Actions. client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 7.671646] systemd[1]: Finished Post-Boot Actions. client # [ 7.675663] nsncd[428]: Sep 22 15:03:19.622 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.680792] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.692748] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.668194] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.672992] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client: connected to guest root shell worker2 # [ 7.669390] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.694484] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.693582] systemd[1]: Reached target User and Group Name Lookups. client: (connecting took 8.36 seconds) worker2 # connecting to host... client: (finished: waiting for the VM to finish booting, in 8.37 seconds) worker2 # [ 7.675645] nsncd[513]: Sep 22 15:03:18.890 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.701146] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 7.679641] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.681765] systemd[1]: Starting User Login Management... client # [ 7.711051] systemd[1]: Starting User Login Management... lb # [ 7.701666] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.704092] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 7.717082] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.655583] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.729640] dbus-broker-launch[517]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.725081] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.729100] systemd[1]: Starting Update is Completed... worker2 # [ 7.743648] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.744999] dbus-broker-launch[517]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.747126] dbus-broker-launch[517]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 7.655824] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.766184] systemd[1]: Started D-Bus System Message Bus. lb # [ 7.764897] systemd[1]: Finished Create System Files and Directories. lb # [ 7.776109] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.781892] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.663524] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.803578] dbus-broker-launch[517]: Ready lb # [ 7.813158] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.813564] systemd[1]: Finished Update is Completed. worker2 # [ 7.663634] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 7.770031] Console: switching to colour frame buffer device 160x50 lb # [ 7.820282] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.821748] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.823864] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.827332] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.830644] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.832416] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.859819] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 7.860772] systemd[1]: Stopping Host and Network Name Lookups... client # [ 7.861583] systemd[1]: Stopped target User and Group Name Lookups. client # [ 7.862440] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.864873] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 7.869426] systemd[1]: nscd.service: Deactivated successfully. client # [ 7.870410] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 7.878779] systemd-logind[458]: New seat seat0. worker1 # [ 7.867374] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.869186] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.885649] systemd-logind[458]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 7.871879] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.888819] systemd-logind[458]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 7.874418] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.016522] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 7.892419] dbus-broker-launch[457]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.842352] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 7.877572] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.895107] systemd-logind[458]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 7.880685] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.882718] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.898441] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.887151] systemd[1]: Stopping Host and Network Name Lookups... client # [ 7.899297] dbus-broker-launch[457]: NSS returned no entry for 'systemd-timesync' client # [ 7.900936] dbus-broker-launch[457]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 7.903195] systemd[1]: Started User Login Management. worker2 # [ 7.893873] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 7.899553] systemd[1]: Stopping User and Group Name Lookups... lb # [ 7.898411] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.901252] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 7.903366] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 7.907898] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.909555] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.912277] systemd-logind[536]: New seat seat0. client # [ 7.922375] systemd[1]: Starting linger-users.service... worker2 # [ 7.917217] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.918244] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.918972] systemd-logind[536]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 7.917609] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.920108] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.920807] systemd[1]: Started User Login Management. worker2 # [ 7.925221] systemd[1]: Starting linger-users.service... lb # [ 7.924376] systemd[1]: Starting Update is Completed... worker2 # [ 7.927621] nsncd[585]: Sep 22 15:03:19.147 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.931135] systemd-logind[536]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 7.933292] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.934207] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.942209] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 7.935718] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.950250] systemd-logind[536]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 7.961070] systemd[1]: Finished resolvconf update. client # [ 7.971369] dbus-broker-launch[457]: Ready worker2 # [ 7.965033] systemd[1]: Reached target Preparation for Network. worker2 # [ 7.969058] systemd[1]: Starting DHCP Client... worker2 # [ 7.971401] systemd[1]: Starting Address configuration of eth1... worker2 # [ 7.975122] systemd[1]: Starting Extra networking commands.... client # [ 7.984217] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.986662] nsncd[517]: Sep 22 15:03:19.934 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.979368] systemd[1]: Finished Update is Completed. client # [ 7.989771] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.991500] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.993779] systemd[1]: Finished resolvconf update. client # [ 7.995981] systemd[1]: linger-users.service: Deactivated successfully. client # [ 7.997226] systemd[1]: Finished linger-users.service. worker1 # [ 7.982355] systemd[1]: Finished Firewall. worker2 # [ 7.992503] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.002391] systemd[1]: Starting DHCP Client... worker2 # [ 7.996102] systemd[1]: Finished linger-users.service. worker1 # [ 8.137757] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 8.159774] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 8.175589] ACPI: button: Power Button [PWRF] lb # [ 8.181082] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 8.196326] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.093836] dhcpcd[553]: dhcpcd-10.3.2 starting client # [ 8.099184] dhcpcd[561]: dev: loaded udev client # [ 8.240785] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.102358] network-addresses-eth1-start[616]: adding address 192.168.1.4/24... done worker1 # [ 8.108557] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.109810] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.120545] network-addresses-eth1-start[616]: adding address 2001:db8:1::4/64... done client # [ 8.147225] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.143979] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.280995] ppdev: user-space parallel port driver client # [ 8.313622] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 8.326002] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.326926] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 8.328841] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.329684] cfg80211: failed to load regulatory.db worker1 # [ 8.272824] mousedev: PS/2 mouse device common for all mice client # [ 8.371105] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.239599] dhcpcd[561]: eth0: waiting for carrier client # [ 8.240545] dhcpcd[561]: eth0: carrier acquired worker2 # [ 8.233506] systemd-vconsole-setup[598]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.237744] systemd[1]: Finished Virtual Console Setup. client # [ 8.246502] systemd[1]: Finished nftables firewall. client # [ 8.248612] systemd[1]: Reached target Preparation for Network. client # [ 8.251103] dhcpcd[561]: DUID 00:01:00:01:32:45:55:38:52:54:00:12:34:56 client # [ 8.251960] dhcpcd[561]: eth0: IAID 00:12:34:56 client # [ 8.252651] dhcpcd[561]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 8.255182] systemd[1]: Starting Address configuration of eth1... client # [ 8.257287] systemd[1]: Starting Extra networking commands.... worker1 # [ 8.282818] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 8.254312] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.291763] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.291832] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T15:03:19 UTC (1790089399) worker2 # [ 8.256199] systemd[1]: Reached target Network. worker2 # [ 8.260087] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.264495] dhcpcd[627]: dhcpcd-10.3.2 starting worker2 # [ 8.270991] dhcpcd[687]: dev: loaded udev worker2 # [ 8.417564] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.431243] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.426557] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.426977] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.291905] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.292853] systemd-journald[285]: Time jumped backwards, rotating. client # [ 8.307279] network-addresses-eth1-start[585]: adding address 192.168.1.1/24... done worker1 # [ 8.320642] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 8.302092] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.303149] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.303807] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 8.307707] systemd[1]: Starting Virtual Console Setup... client # [ 8.319064] network-addresses-eth1-start[585]: adding address 2001:db8:1::1/64... done client # [ 8.330750] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.327601] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.327731] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.337234] Console: switching to colour dummy device 80x25 worker1 # [ 8.402590] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.453383] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 8.453388] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 8.331222] systemd[1]: Finished Permit User Sessions. worker2 # [ 8.339156] systemd[1]: Started Getty on tty1. worker2 # [ 8.339814] systemd[1]: Reached target Login Prompts. client # [ 8.351805] systemd[1]: Finished Extra networking commands.. client # [ 8.353552] systemd[1]: Reached target Network. lb # [ 8.343931] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.356114] systemd[1]: Starting Permit User Sessions... lb # [ 8.346787] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.371849] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.491508] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.492346] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 8.374958] systemd[1]: Started Getty on tty1. client # [ 8.376335] systemd[1]: Reached target Login Prompts. lb # [ 8.245884] ACPI: button: Power Button [PWRF] worker2 # [ 8.505291] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.279089] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 8.310787] mousedev: PS/2 mouse device common for all mice lb # [ 8.311390] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 8.312143] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T15:03:19 UTC (1790089399) worker1 # [ 8.526809] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 8.528131] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 8.530639] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.531546] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 8.416108] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.312232] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 8.314617] systemd-journald[285]: Time jumped backwards, rotating. lb # [ 8.360810] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.431320] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.434382] systemd[1]: Reached target System Initialization. lb # [ 8.441176] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.436193] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.442630] systemd[1]: Reached target System Initialization. worker1 # [ 8.439228] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 8.579986] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.445168] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.446254] systemd[1]: Started niks3 garbage collection timer. worker1 # [ 8.442218] systemd[1]: Reached target Timer Units. lb # [ 8.447718] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 8.444161] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.449733] systemd[1]: Reached target Timer Units. lb # [ 8.451179] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.446205] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 8.451129] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 8.457840] systemd[1]: Listening on niks3 server socket. worker1 # [ 8.452105] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.453247] systemd[1]: Reached target Socket Units. lb # [ 8.458640] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.459428] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.460581] systemd[1]: Reached target Socket Units. lb # [ 8.461368] systemd[1]: Reached target Basic System. worker1 # [ 8.456123] systemd[1]: Reached target Basic System. lb # [ 8.463073] systemd[1]: Started backdoor.service. lb # [ 8.465063] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.461094] systemd[1]: Started backdoor.service. worker1 # [ 8.461818] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.462819] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.360930] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.411341] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 8.451063] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.465136] systemd[1]: Starting Post-Boot Actions... lb # [ 8.474376] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.473582] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.474649] systemd[1]: Starting resolvconf update... worker1 # [ 8.475424] systemd[1]: Starting D-Bus System Message Bus... lb # [ 8.486100] systemd[1]: Starting Post-Boot Actions... lb # [ 8.499541] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.639797] kvm_amd: TSC scaling supported worker2 # [ 8.640215] kvm_amd: Nested Virtualization enabled worker2 # [ 8.641063] kvm_amd: Nested Paging enabled worker2 # [ 8.641700] kvm_amd: LBR virtualization supported worker2 # [ 8.642137] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.642850] kvm_amd: Virtual GIF supported worker2 # [ 8.643230] kvm_amd: Virtual NMI enabled worker2 # [ 8.647827] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.648774] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.650829] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.651662] cfg80211: failed to load regulatory.db lb # [ 8.526166] systemd[1]: Starting resolvconf update... lb # [ 8.533490] systemd[1]: Started rustfs.service. lb # [ 8.503509] Console: switching to colour dummy device 80x25 lb # [ 8.563050] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.563186] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.552274] systemd[1]: Starting rustfs-bucket.service... worker1 # [ 8.555174] systemd[1]: Finished Post-Boot Actions. lb # [ 8.560720] systemd[1]: Finished Firewall. worker2 # [ 8.696904] EDAC MC: Ver: 3.0.0 worker2 # [ 8.699614] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.568287] dhcpcd[687]: eth0: waiting for carrier worker2 # [ 8.570208] dhcpcd[687]: libudev: received NULL device worker2 # [ 8.570992] dhcpcd[687]: libudev: received NULL device lb # [ 8.581466] nsncd[521]: Sep 22 15:03:19.902 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.587496] systemd[1]: Finished Post-Boot Actions. lb # [ 8.590092] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.585912] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.587805] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.590496] systemd[1]: Reached target User and Group Name Lookups. lb # connecting to host... worker1 # [ 8.594108] systemd[1]: Starting User Login Management... worker1 # connecting to host... worker1 # [ 8.597482] nsncd[515]: Sep 22 15:03:19.936 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.614198] systemd-vconsole-setup[690]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.736468] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.616836] systemd[1]: Finished Virtual Console Setup. lb # [ 8.736756] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.626277] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.627210] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.628596] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.643495] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.642578] dbus-broker-launch[520]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.652887] dbus-broker-launch[520]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.653938] dbus-broker-launch[520]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.664263] systemd[1]: Starting User Login Management... lb # [ 8.808869] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.808872] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.677259] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.677748] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.678581] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.818564] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.819208] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.712803] dbus-broker-launch[520]: Ready worker1 # [ 8.834289] Console: switching to colour frame buffer device 160x50 worker1 # [ 8.876384] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.773864] systemd-logind[539]: New seat seat0. worker1 # [ 8.778839] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.785292] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.782957] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.786245] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 8.789099] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 8.789920] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.792164] systemd[1]: Started User Login Management. worker1 # [ 8.792898] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.796665] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.798135] systemd[1]: Starting linger-users.service... worker1 # [ 8.800703] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.847142] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.850142] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.859121] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.863492] systemd-logind[539]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 8.867474] systemd-logind[539]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.878095] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.881055] systemd[1]: Finished linger-users.service. worker1 # [ 8.891388] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.892233] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.893082] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.895889] nsncd[592]: Sep 22 15:03:20.236 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.906555] systemd-logind[550]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.910315] systemd-logind[550]: New seat seat0. lb # [ 8.914089] systemd[1]: Started User Login Management. worker1 # [ 8.913767] systemd[1]: Finished resolvconf update. lb # [ 8.919413] dbus-broker-launch[549]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.915212] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.921154] systemd[1]: Starting DHCP Client... worker1 # [ 8.924258] systemd[1]: Starting Address configuration of eth1... lb # [ 8.931280] dbus-broker-launch[549]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.927059] systemd[1]: Starting Extra networking commands.... lb # [ 8.932331] dbus-broker-launch[549]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.934334] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.935244] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 8.936083] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.936860] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.939709] systemd-logind[550]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.942639] systemd[1]: Starting linger-users.service... lb # [ 8.943462] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 8.951315] systemd[1]: nscd.service: Deactivated successfully. lb # [ 8.954239] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client: (finished: waiting for unit network-addresses-eth1.service, in 9.63 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.039182] network-addresses-eth1-start[622]: adding address 192.168.1.3/24... done worker1 # [ 9.059308] network-addresses-eth1-start[622]: adding address 2001:db8:1::3/64... done worker1 # [ 9.196023] ppdev: user-space parallel port driver worker1 # [ 9.082756] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.132620] dhcpcd[687]: eth0: carrier acquired worker2 # [ 9.138095] dhcpcd[687]: DUID 00:01:00:01:32:45:55:38:52:54:00:12:34:56 worker2 # [ 9.138981] dhcpcd[687]: eth0: IAID 00:12:34:56 worker2 # [ 9.139715] dhcpcd[687]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.136816] systemd-vconsole-setup[603]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.212309] ppdev: user-space parallel port driver lb # [ 9.235372] Console: switching to colour frame buffer device 160x50 lb # [ 9.284742] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.984858] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.147350] systemd[1]: Finished Virtual Console Setup. lb # [ 9.153109] systemd[1]: Started D-Bus System Message Bus. lb # [ 9.154267] dbus-broker-launch[549]: Ready lb # [ 9.156530] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.161293] nsncd[612]: Sep 22 15:03:20.412 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.164355] systemd[1]: Finished linger-users.service. lb # [ 9.165889] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.167354] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.169451] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.170790] systemd[1]: Finished resolvconf update. worker1 # [ 9.167147] systemd-logind[539]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 9.173700] systemd[1]: Reached target Preparation for Network. lb # [ 9.174544] systemd[1]: Starting DHCP Client... lb # [ 9.182379] systemd[1]: Starting Address configuration of eth1... lb # [ 9.190245] systemd[1]: Starting Extra networking commands.... worker1 # [ 9.191772] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.192686] systemd[1]: Reached target Network. lb # [ 9.199406] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.194591] systemd[1]: Starting Permit User Sessions... lb # [ 9.200421] systemd-logind[550]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.202718] dhcpcd[631]: dhcpcd-10.3.2 starting worker1 # [ 9.209447] dhcpcd[691]: dev: loaded udev lb # [ 9.215144] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.356360] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.359024] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.360449] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.362023] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.243234] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.244278] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.244948] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 9.249144] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.258387] systemd[1]: Finished Permit User Sessions. lb # [ 9.265327] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.272344] systemd[1]: Started Getty on tty1. worker1 # [ 9.273042] systemd[1]: Reached target Login Prompts. worker1 # [ 9.427859] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.438031] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 9.343429] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.511846] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.397345] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.403684] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.420332] systemd[1]: Starting Virtual Console Setup... lb # [ 9.424970] network-addresses-eth1-start[648]: adding address 192.168.1.2/24... done worker1 # [ 9.568281] kvm_amd: TSC scaling supported worker1 # [ 9.568971] kvm_amd: Nested Virtualization enabled worker1 # [ 9.570125] kvm_amd: Nested Paging enabled worker1 # [ 9.570855] kvm_amd: LBR virtualization supported worker1 # [ 9.571393] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.572236] kvm_amd: Virtual GIF supported worker1 # [ 9.572973] kvm_amd: Virtual NMI enabled worker1 # [ 9.585182] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.586031] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.588867] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 9.589938] cfg80211: failed to load regulatory.db lb # [ 9.471135] network-addresses-eth1-start[648]: adding address 2001:db8:1::2/64... done worker1 # [ 9.620325] EDAC MC: Ver: 3.0.0 worker1 # [ 9.634099] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 9.501918] dhcpcd[691]: eth0: waiting for carrier worker1 # [ 9.503204] dhcpcd[691]: eth0: carrier acquired worker1 # [ 9.508556] dhcpcd[691]: DUID 00:01:00:01:32:45:55:38:52:54:00:12:34:56 worker1 # [ 9.510060] dhcpcd[691]: eth0: IAID 00:12:34:56 worker1 # [ 9.511319] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.517818] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.545483] dhcpcd[687]: eth0: soliciting a DHCP lease worker2 # [ 9.685927] NET: Registered PF_PACKET protocol family worker2 # [ 9.556559] dhcpcd[687]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.559146] dhcpcd[687]: eth0: probing address 10.0.2.15/24 worker1 # [ 9.569446] systemd-vconsole-setup[694]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.572890] systemd[1]: Finished Virtual Console Setup. lb # [ 9.585186] dhcpcd[670]: dhcpcd-10.3.2 starting lb # [ 9.596351] dhcpcd[730]: dev: loaded udev lb # [ 9.746288] kvm_amd: TSC scaling supported lb # [ 9.746747] kvm_amd: Nested Virtualization enabled lb # [ 9.747188] kvm_amd: Nested Paging enabled lb # [ 9.614530] systemd[1]: Finished Extra networking commands.. lb # [ 9.616574] systemd[1]: Reached target Network. lb # [ 9.751589] kvm_amd: LBR virtualization supported lb # [ 9.752084] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 9.754544] kvm_amd: Virtual GIF supported lb # [ 9.755005] kvm_amd: Virtual NMI enabled lb # [ 9.624167] systemd[1]: Starting PostgreSQL Server... lb # [ 9.628939] systemd[1]: Starting Permit User Sessions... lb # [ 9.780022] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.780492] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.710366] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.875885] EDAC MC: Ver: 3.0.0 lb # [ 9.749174] systemd[1]: Finished Permit User Sessions. lb # [ 9.761278] systemd[1]: Started Getty on tty1. lb # [ 9.763242] systemd[1]: Reached target Login Prompts. client # [ 9.798262] dhcpcd[561]: eth0: soliciting a DHCP lease client # [ 9.948227] NET: Registered PF_PACKET protocol family client # [ 9.822969] dhcpcd[561]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 9.827389] dhcpcd[561]: eth0: probing address 10.0.2.15/24 lb # [ 9.971197] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 10.004997] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 10.005989] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 10.008215] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 10.009123] cfg80211: failed to load regulatory.db lb # [ 10.081760] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 9.950640] dhcpcd[730]: eth0: waiting for carrier lb # [ 9.951721] dhcpcd[730]: eth0: carrier acquired lb # [ 9.958727] postgresql-pre-start[744]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.960172] postgresql-pre-start[744]: This user must also own the server process. lb # [ 9.965488] dhcpcd[730]: DUID 00:01:00:01:32:45:55:39:52:54:00:12:34:56 lb # [ 9.966455] dhcpcd[730]: eth0: IAID 00:12:34:56 lb # [ 9.967249] dhcpcd[730]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.972902] postgresql-pre-start[744]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.974149] postgresql-pre-start[744]: The default database encoding has accordingly been set to "UTF8". lb # [ 9.975322] postgresql-pre-start[744]: The default text search configuration will be set to "english". lb # [ 9.976437] postgresql-pre-start[744]: Data page checksums are enabled. lb # [ 9.977340] postgresql-pre-start[744]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.978514] postgresql-pre-start[744]: creating subdirectories ... ok lb # [ 9.979355] postgresql-pre-start[744]: selecting dynamic shared memory implementation ... posix worker1 # [ 9.977189] dhcpcd[691]: eth0: soliciting a DHCP lease worker1 # [ 10.128580] NET: Registered PF_PACKET protocol family worker1 # [ 10.002899] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.005356] dhcpcd[691]: eth0: probing address 10.0.2.15/24 lb # [ 10.075304] postgresql-pre-start[744]: selecting default "max_connections" ... 100 lb # [ 10.099666] systemd-vconsole-setup[678]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 10.103648] systemd[1]: Finished Virtual Console Setup. lb # [ 10.148026] postgresql-pre-start[744]: selecting default "shared_buffers" ... 128MB lb: (finished: waiting for unit network-addresses-eth1.service, in 1.31 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.03 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service lb # [ 10.524300] dhcpcd[730]: eth0: soliciting a DHCP lease lb # [ 10.684786] NET: Registered PF_PACKET protocol family lb # [ 10.555475] dhcpcd[730]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 10.558167] dhcpcd[730]: eth0: probing address 10.0.2.15/24 client # [ 10.624206] dhcpcd[561]: eth0: soliciting an IPv6 router client # [ 10.625475] dhcpcd[561]: eth0: Router Advertisement from fe80::2 client # [ 10.626345] dhcpcd[561]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.627203] dhcpcd[561]: eth0: adding route to fec0::/64 client # [ 10.627930] dhcpcd[561]: eth0: adding default route via fe80::2 lb # [ 10.806772] postgresql-pre-start[744]: selecting default time zone ... UTC lb # [ 10.809210] postgresql-pre-start[744]: creating configuration files ... ok lb # [ 10.967464] postgresql-pre-start[744]: running bootstrap script ... ok worker2 # [ 11.058738] dhcpcd[687]: eth0: soliciting an IPv6 router worker2 # [ 11.061619] dhcpcd[687]: eth0: Router Advertisement from fe80::2 worker2 # [ 11.063716] dhcpcd[687]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 11.065944] dhcpcd[687]: eth0: adding route to fec0::/64 worker2 # [ 11.067800] dhcpcd[687]: eth0: adding default route via fe80::2 worker1 # [ 11.154479] dhcpcd[691]: eth0: soliciting an IPv6 router worker1 # [ 11.157365] dhcpcd[691]: eth0: Router Advertisement from fe80::2 worker1 # [ 11.159492] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 11.161621] dhcpcd[691]: eth0: adding route to fec0::/64 worker1 # [ 11.163435] dhcpcd[691]: eth0: adding default route via fe80::2 lb # [ 11.336741] postgresql-pre-start[744]: performing post-bootstrap initialization ... ok lb # [ 11.471666] postgresql-pre-start[744]: syncing data to disk ... ok lb # [ 11.473616] postgresql-pre-start[744]: initdb: warning: enabling "trust" authentication for local connections lb # [ 11.474848] postgresql-pre-start[744]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 11.476710] postgresql-pre-start[744]: Success. You can now start the database server using: lb # [ 11.477776] postgresql-pre-start[744]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 11.552586] postgres[790]: [790] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 11.556350] postgres[790]: [790] LOG: listening on IPv6 address "::1", port 5432 lb # [ 11.557582] postgres[790]: [790] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 11.560667] postgres[790]: [790] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 11.572204] postgres[803]: [803] LOG: database system was shut down at 2026-09-22 15:03:22 GMT lb # [ 11.579213] postgres[790]: [790] LOG: database system is ready to accept connections lb # [ 11.589116] systemd[1]: Started PostgreSQL Server. lb # [ 11.593062] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 11.729154] postgresql-setup-start[819]: CREATE DATABASE lb # [ 11.756678] postgresql-setup-start[824]: CREATE ROLE lb # [ 11.768180] postgresql-setup-start[826]: ALTER DATABASE lb # [ 11.772593] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 11.774574] systemd[1]: Reached target PostgreSQL. lb # [ 12.143572] dhcpcd[730]: eth0: soliciting an IPv6 router lb # [ 12.146538] dhcpcd[730]: eth0: Router Advertisement from fe80::2 lb # [ 12.148661] dhcpcd[730]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.150849] dhcpcd[730]: eth0: adding route to fec0::/64 lb # [ 12.152738] dhcpcd[730]: eth0: adding default route via fe80::2 worker2 # [ 13.977993] dhcpcd[687]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 13.981582] dhcpcd[687]: eth0: adding route to 10.0.2.0/24 worker2 # [ 13.983899] dhcpcd[687]: eth0: adding default route via 10.0.2.2 worker2 # [ 14.065672] systemd[1]: Started DHCP Client. worker2 # [ 14.067748] systemd[1]: Reached target Multi-User System. worker2 # [ 14.068619] systemd[1]: Startup finished in 879ms (kernel) + 3.644s (initrd) + 9.543s (userspace) = 14.067s. worker1 # [ 14.323711] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 14.327762] dhcpcd[691]: eth0: adding route to 10.0.2.0/24 worker1 # [ 14.330575] dhcpcd[691]: eth0: adding default route via 10.0.2.2 worker1 # [ 14.402757] systemd[1]: Started DHCP Client. worker1 # [ 14.404882] systemd[1]: Reached target Multi-User System. worker1 # [ 14.405815] systemd[1]: Startup finished in 870ms (kernel) + 4.531s (initrd) + 9.001s (userspace) = 14.404s. client # [ 14.761622] dhcpcd[561]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 14.763735] dhcpcd[561]: eth0: adding route to 10.0.2.0/24 client # [ 14.766660] dhcpcd[561]: eth0: adding default route via 10.0.2.2 client # [ 14.848354] systemd[1]: Started DHCP Client. client # [ 14.850579] systemd[1]: Reached target Multi-User System. client # [ 14.851585] systemd[1]: Startup finished in 856ms (kernel) + 3.669s (initrd) + 10.325s (userspace) = 14.851s. lb # [ 15.679735] dhcpcd[730]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 15.682929] dhcpcd[730]: eth0: adding route to 10.0.2.0/24 lb # [ 15.685419] dhcpcd[730]: eth0: adding default route via 10.0.2.2 lb # [ 15.771246] systemd[1]: Started DHCP Client. lb # [ 15.773534] systemd[1]: Reached target Network is Online. lb # [ 15.776334] systemd[1]: Started Envoy reverse proxy. lb # [ 15.780662] systemd[1]: Started mock-oidc.service. lb # [ 16.024922] mock-oidc-server[917]: Mock OIDC Server running lb # [ 16.026868] mock-oidc-server[917]: OIDC Address: 192.168.1.2:8080 lb # [ 16.027737] mock-oidc-server[917]: Issue Address: 0.0.0.0:8081 lb # [ 16.028800] mock-oidc-server[917]: Issuer: http://192.168.1.2:8080/oidc lb # [ 16.029700] mock-oidc-server[917]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 16.030756] mock-oidc-server[917]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 16.032051] mock-oidc-server[917]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 16.120627] envoy[916]: [2026-09-22 15:03:27.441][916][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 16.123191] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 16.124580] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 16.126388] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 16.130593] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 16.133798] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 16.135604] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 16.137287] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 16.139098] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 16.142313] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 16.145181] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 16.146881] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 16.148577] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 16.150588] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 16.152579] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 16.154915] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 16.160086] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 16.161949] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 16.164042] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 16.165719] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 16.167407] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 16.169434] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 16.171211] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 16.173437] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 16.186332] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 16.188587] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 16.191798] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 16.194784] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 16.197168] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 16.199750] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 16.201562] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 16.203676] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 16.206659] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 16.208459] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 16.211157] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 16.220743] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 16.225419] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 16.227086] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 16.228579] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 16.232812] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 16.238996] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 16.244190] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 16.246583] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 16.249512] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 16.251152] envoy[916]: [2026-09-22 15:03:27.443][916][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 16.254764] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 16.280119] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 16.282697] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 16.285047] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.287402] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 16.289091] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 16.295426] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 16.297163] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 16.301635] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.304083] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 16.305790] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 16.308443] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 16.311287] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 16.313054] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 16.314585] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 16.316463] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 16.319248] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 16.320856] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 16.325304] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 16.328163] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 16.333670] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.336928] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 16.339646] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 16.341998] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 16.344425] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 16.346198] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 16.350258] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 16.351731] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 16.354468] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 16.356601] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 16.359716] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 16.361824] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 16.364025] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 16.365842] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 16.369733] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 16.373849] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 16.376266] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.378468] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 16.380790] envoy[916]: [2026-09-22 15:03:27.444][916][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 16.384044] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 16.386441] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 16.388675] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 16.390537] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 16.395160] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 16.396642] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 16.398458] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 16.404493] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 16.406855] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 16.410087] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 16.416050] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 16.417756] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 16.419737] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 16.421385] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 16.424058] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 16.435159] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 16.436986] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 16.439322] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 16.440997] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 16.443798] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 16.446060] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 16.451102] envoy[916]: [2026-09-22 15:03:27.447][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 16.452575] envoy[916]: [2026-09-22 15:03:27.503][916][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 16.453874] envoy[916]: [2026-09-22 15:03:27.504][916][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 16.466765] envoy[916]: [2026-09-22 15:03:27.504][916][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 16.468229] envoy[916]: [2026-09-22 15:03:27.504][916][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 16.475640] envoy[916]: [2026-09-22 15:03:27.504][916][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 16.479601] envoy[916]: [2026-09-22 15:03:27.800][916][info][main] [source/server/server.cc:968] runtime: {} lb # [ 16.482938] envoy[916]: [2026-09-22 15:03:27.804][916][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 16.484927] envoy[916]: [2026-09-22 15:03:27.805][916][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 16.487080] envoy[916]: [2026-09-22 15:03:27.808][916][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 16.489734] envoy[916]: [2026-09-22 15:03:27.810][916][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 16.491255] envoy[916]: [2026-09-22 15:03:27.810][916][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 16.493030] envoy[916]: [2026-09-22 15:03:27.810][916][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 16.518425] envoy[916]: [2026-09-22 15:03:27.839][916][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 16.524068] envoy[916]: [2026-09-22 15:03:27.845][916][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 16.524608] systemd[1]: Reached target Network is Online. lb # [ 16.526542] envoy[916]: [2026-09-22 15:03:27.847][916][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 16.529737] envoy[916]: [2026-09-22 15:03:27.850][916][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 16.531863] systemd[1]: Starting scheduler-token.service... worker1 # [ 16.520084] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 16.597471] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 16.601295] systemd[1]: Finished scheduler-token.service. worker2 # [ 16.603279] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 68ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 16.609983] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 16.645433] nix-grpc-daemon[783]: ts=2026-09-22T15:03:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 16.658339] nix-grpc-daemon[783]: ts=2026-09-22T15:03:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 16.660743] nix-grpc-daemon[783]: ts=2026-09-22T15:03:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 16.669957] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 16.671497] nix-grpc-daemon[783]: E0000 00:00:1790089408.011152 783 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 16.677906] nix-grpc-daemon[783]: E0000 00:00:1790089408.019238 783 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 16.680634] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 16.683984] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 16.706297] nix-grpc-daemon[782]: ts=2026-09-22T15:03:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 16.699564] nix-grpc-daemon[783]: E0000 00:00:1790089408.040936 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.716637] nix-grpc-daemon[782]: ts=2026-09-22T15:03:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 16.719427] nix-grpc-daemon[782]: ts=2026-09-22T15:03:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 16.720473] envoy[916]: [2026-09-22 15:03:28.041][916][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 16.718699] nix-grpc-daemon[783]: E0000 00:00:1790089408.060152 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 16.724364] envoy[916]: [2026-09-22 15:03:28.041][916][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 16.729432] nix-grpc-daemon[782]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 16.723056] nix-grpc-daemon[783]: E0000 00:00:1790089408.062551 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.730939] nix-grpc-daemon[782]: E0000 00:00:1790089407.952820 782 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 16.728306] envoy[916]: [2026-09-22 15:03:28.041][916][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 16.736380] nix-grpc-daemon[782]: E0000 00:00:1790089407.959979 782 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.739592] nix-grpc-daemon[782]: ts=2026-09-22T15:03:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 16.735531] envoy[916]: [2026-09-22 15:03:28.056][916][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 16.742505] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 16.734056] nix-grpc-daemon[783]: E0000 00:00:1790089408.075545 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 16.746860] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.755063] nix-grpc-daemon[782]: E0000 00:00:1790089407.978615 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 16.751061] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.773471] nix-grpc-daemon[782]: E0000 00:00:1790089407.997186 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.778100] nix-grpc-daemon[782]: E0000 00:00:1790089407.999424 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.788758] nix-grpc-daemon[782]: E0000 00:00:1790089408.012442 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.800320] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.801956] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.954201] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.958310] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.003564] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.007540] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.159320] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.163325] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.208690] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.212563] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.364495] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.368465] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.413660] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.417528] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.569570] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.573511] nix-grpc-daemon[783]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.618712] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.622603] nix-grpc-daemon[782]: ts=2026-09-22T15:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.775954] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.779250] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.824494] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.827958] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.976841] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.980794] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.029142] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.033140] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.181951] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.186131] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.233932] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.237807] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.387144] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.391239] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.439394] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.443334] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.592444] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.596444] nix-grpc-daemon[783]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.643886] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.645615] nix-grpc-daemon[782]: ts=2026-09-22T15:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.797500] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.799351] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.847960] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.851279] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.000608] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.004626] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.049260] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.053154] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.205659] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.209815] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.253977] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.257822] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.410520] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.412500] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.458544] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.460276] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.613323] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.615271] nix-grpc-daemon[783]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.661155] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.662906] nix-grpc-daemon[782]: ts=2026-09-22T15:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.816374] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.817987] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.865374] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.868568] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.019105] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.021079] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.066718] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.070621] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.222350] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.226269] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.271904] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.275723] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.427193] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.431552] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.476473] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.478280] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.632832] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.637529] nix-grpc-daemon[783]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.679060] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.680833] nix-grpc-daemon[782]: ts=2026-09-22T15:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.703503] rustfs-bucket-start[980]: mb s3://farm lb # [ 20.707815] systemd[1]: Finished rustfs-bucket.service. lb # [ 20.715465] systemd[1]: Starting niks3 server... lb # [ 20.836435] postgres[996]: [996] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 20.839132] postgres[996]: [996] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker1 # [ 20.836325] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.839523] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.860296] niks3-server[990]: 2026/09/22 15:03:32 OK 20241026095416_initial_model.sql (12.39ms) lb # [ 20.863536] niks3-server[990]: 2026/09/22 15:03:32 OK 20251210153512_drop_unused_gin_index.sql (3.61ms) lb # [ 20.868787] niks3-server[990]: 2026/09/22 15:03:32 OK 20251218171726_add_pins.sql (4.03ms) lb # [ 20.873265] niks3-server[990]: 2026/09/22 15:03:32 OK 20260628120000_add_object_size_and_stats.sql (3.23ms) lb # [ 20.877660] niks3-server[990]: 2026/09/22 15:03:32 OK 20260905000000_add_claims.sql (4.34ms) lb # [ 20.881945] niks3-server[990]: 2026/09/22 15:03:32 OK 20260920000000_drop_claims.sql (4.2ms) worker2 # [ 20.883359] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 lb # [ 20.883236] niks3-server[990]: 2026/09/22 15:03:32 goose: successfully migrated database to version: 20260920000000 worker2 # [ 20.886557] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.887255] niks3-server[990]: 2026/09/22 15:03:32 OK 1_commit_pending_closure.sql (5.3ms) lb # [ 20.890205] niks3-server[990]: 2026/09/22 15:03:32 OK 2_object_stats_trigger.sql (2.49ms) lb # [ 20.891302] niks3-server[990]: 2026/09/22 15:03:32 goose: up to current file version: 2 lb # [ 20.894571] niks3-server[990]: 2026/09/22 15:03:32 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 20.925182] niks3-server[990]: 2026/09/22 15:03:32 INFO Read proxy enabled — serving cache objects from S3 lb # [ 20.926683] niks3-server[990]: 2026/09/22 15:03:32 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 20.929185] niks3-server[990]: 2026/09/22 15:03:32 INFO systemd watchdog enabled interval=15s lb # [ 20.930443] systemd[1]: Started niks3 server. lb # [ 20.932061] niks3-server[990]: 2026/09/22 15:03:32 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 20.933618] systemd[1]: Reached target Multi-User System. lb # [ 20.935936] systemd[1]: Startup finished in 869ms (kernel) + 4.581s (initrd) + 15.483s (userspace) = 20.935s. worker1 # [ 21.037766] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.041650] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.084330] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.088229] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.242514] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.246455] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.289323] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.293325] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 10.87 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.04 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 21.428342] envoy[916]: conn peer=[::1]:34342 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker1 # [ 21.448528] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.451635] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.494289] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.499283] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.550785] systemd[1]: Starting scheduler-token.service... worker2 # [ 21.588294] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 21.589931] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.591358] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 39ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 21.649595] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.653494] nix-grpc-daemon[783]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 21.699523] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.703340] nix-grpc-daemon[782]: ts=2026-09-22T15:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.854820] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.856564] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.905811] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.908911] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.057858] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.061932] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.106966] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.110839] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.264349] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.268294] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.311980] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.315925] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.464866] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.466774] nix-grpc-daemon[783]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.517189] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.520848] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 22.668224] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.671980] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 22.722582] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.725712] nix-grpc-daemon[782]: ts=2026-09-22T15:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.872958] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.874745] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.924922] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.928607] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.075593] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.077479] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.129866] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.133928] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.278238] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.280105] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.335138] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.339156] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.481309] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.485264] nix-grpc-daemon[783]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.540146] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.544123] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.686134] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.690758] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 23.744500] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.746450] nix-grpc-daemon[782]: ts=2026-09-22T15:03:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 23.893446] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.896659] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.949289] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.952566] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.094521] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.098536] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.149963] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.151704] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.299837] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.303820] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.353117] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.356869] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.504920] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.509931] nix-grpc-daemon[783]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.557295] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.559122] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.710949] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.715419] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.760192] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_connected addr=lb:50051 lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 24.763966] nix-grpc-daemon[782]: ts=2026-09-22T15:03:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 24.916520] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.918284] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.966528] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.969608] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.119159] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.121179] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.167917] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.171846] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.321885] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.324105] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.372943] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.376866] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.524609] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.526458] nix-grpc-daemon[783]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.577453] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.579220] nix-grpc-daemon[782]: ts=2026-09-22T15:03:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.727097] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.733165] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.780493] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.786459] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 25.932129] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.933809] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.987574] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.991182] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.134782] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.136708] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.192305] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.196111] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.337624] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.339699] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.397292] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.400985] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.540411] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.542237] nix-grpc-daemon[783]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.602192] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.605968] nix-grpc-daemon[782]: ts=2026-09-22T15:03:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.742579] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.744365] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.806283] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.808045] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1 # [ 26.947152] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.950443] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.010536] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.013664] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.147903] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.152155] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.211055] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.212795] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.352949] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.357245] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.413540] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.415248] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.557874] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.559712] nix-grpc-daemon[783]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.616436] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.620398] nix-grpc-daemon[782]: ts=2026-09-22T15:03:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.760482] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.764521] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.821144] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.825149] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 27.965685] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.967451] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.027344] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.030455] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.168213] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.170296] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.228274] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.232125] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.371135] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.373121] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.433354] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.436892] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.574347] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.578385] nix-grpc-daemon[783]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.635299] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.639144] nix-grpc-daemon[782]: ts=2026-09-22T15:03:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.779308] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.783709] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.839448] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.841218] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 28.986265] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.989429] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.043710] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.047154] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.186798] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.190754] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.244726] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.248476] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.391749] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.395868] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.449714] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.453552] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.596614] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.598458] nix-grpc-daemon[783]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.654615] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.658261] nix-grpc-daemon[782]: ts=2026-09-22T15:03:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.799058] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.800957] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.858891] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.862549] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 30.002314] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.003710] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.064924] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.068085] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.203141] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.205054] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.266093] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.269868] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.405661] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.407620] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.471175] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.474968] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.608378] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.610221] nix-grpc-daemon[783]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.676169] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.679991] nix-grpc-daemon[782]: ts=2026-09-22T15:03:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.810951] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.812850] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.880823] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.884137] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.937760] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_take_over lb # [ 30.943545] niks3-server[990]: 2026/09/22 15:03:42 INFO lead: acquired remote=192.168.1.3:48494 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 31.013965] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.015668] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 31.086477] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.089558] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.216383] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.218232] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.287222] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.290986] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.419365] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.423404] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.492238] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.495979] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.624565] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.628398] nix-grpc-daemon[783]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.697237] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.701120] nix-grpc-daemon[782]: ts=2026-09-22T15:03:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.829455] nix-grpc-daemon[783]: ts=2026-09-22T15:03:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.842175] nix-grpc-daemon[783]: ts=2026-09-22T15:03:43Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60894 worker1 # [ 31.846249] nix-grpc-daemon[783]: ts=2026-09-22T15:03:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 31.902255] nix-grpc-daemon[782]: ts=2026-09-22T15:03:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.902133] nix-grpc-daemon[783]: ts=2026-09-22T15:03:43Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 31.903447] nix-grpc-daemon[783]: ts=2026-09-22T15:03:43Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60894 worker1 # [ 31.905908] nix-grpc-daemon[783]: ts=2026-09-22T15:03:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.87 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 32.694528] nix-grpc-daemon[783]: ts=2026-09-22T15:03:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 32.705828] systemd[1]: Started Nix Daemon. worker1 # [ 32.828569] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 32.844768] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker1 # [ 32.934464] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 2/5) worker1 # [ 32.987505] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 3/5) worker1 # [ 33.156735] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 339 ms (attempt 4/5) worker1 # [ 33.497967] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 33.502798] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 33.536268] nix-grpc-daemon[782]: ts=2026-09-22T15:03:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 33.544514] systemd[1]: Started Nix Daemon. worker2 # [ 33.650226] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 33.669829] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 1/5) worker2 # [ 33.703804] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5) worker2 # [ 33.862129] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 263 ms (attempt 3/5) worker2 # [ 34.126404] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 739 ms (attempt 4/5) worker2 # [ 34.870333] nix-grpc-daemon[782]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 34.872211] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 34.880779] nix-grpc-daemon[782]: ts=2026-09-22T15:03:46Z level=debug event=path_info_miss path=dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test error="error: path '/nix/store/dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 34.886427] nix-grpc-daemon[783]: ts=2026-09-22T15:03:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 34.898207] nix-grpc-daemon[783]: ts=2026-09-22T15:03:46Z level=debug event=path_info_miss path=dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test error="error: path '/nix/store/dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 35.107987] nix-grpc-daemon[783]: ts=2026-09-22T15:03:46Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:60898 worker2 # [ 35.134154] nix-grpc-daemon[782]: ts=2026-09-22T15:03:46Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 35.136263] nix-grpc-daemon[782]: ts=2026-09-22T15:03:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:39548 worker2 # [ 35.141460] nix-grpc-daemon[782]: ts=2026-09-22T15:03:46Z level=debug event=path_info_miss path=dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test error="error: path '/nix/store/dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 35.145368] nix-grpc-daemon[782]: ts=2026-09-22T15:03:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:39548 worker2 # [ 35.150382] nix-grpc-daemon[782]: ts=2026-09-22T15:03:46Z level=debug event=path_info_miss path=dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test error="error: path '/nix/store/dgyp9fws2n1q2rg73k4nrsyrfqvcsmf6-nixos-system-client-test' is required, but there is no substituter that can build it" lb # [ 36.522913] envoy[916]: conn peer=[2001:db8:1::1]:46764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2233 lb # [ 36.526978] envoy[916]: conn peer=[2001:db8:1::1]:59982 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=360 ms=46 client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker2 # [ 37.318976] nix-grpc-daemon[782]: ts=2026-09-22T15:03:48Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 37.441938] nix-grpc-daemon[783]: ts=2026-09-22T15:03:48Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.94 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 37.575076] nix-grpc-daemon[783]: ts=2026-09-22T15:03:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 37.588660] nix-grpc-daemon[782]: ts=2026-09-22T15:03:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 37.597446] nix-grpc-daemon[783]: ts=2026-09-22T15:03:48Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker1 # [ 37.599180] nix-grpc-daemon[783]: ts=2026-09-22T15:03:48Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 37.646454] nix-grpc-daemon[783]: ts=2026-09-22T15:03:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 37.652665] nix-grpc-daemon[783]: ts=2026-09-22T15:03:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 client # copying 1 paths to 'lb:50051'... worker1 # [ 37.659152] nix-grpc-daemon[783]: ts=2026-09-22T15:03:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 37.677866] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 37.693836] nix-grpc-daemon[783]: ts=2026-09-22T15:03:49Z level=info event=niks3_push_started pid=880 worker1 # [ 37.842630] nix-grpc-daemon[880]: time=2026-09-22T15:03:49.183Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 37.938590] nix-daemon[865]: accepted connection from pid 893, user nix-grpc-daemon (trusted) worker1 # [ 37.954558] nix-daemon[865]: reaped child process 896, status = succeeded worker1 # [ 38.041178] nix-daemon[865]: accepted connection from pid 898, user nix-grpc-daemon (trusted) worker1 # [ 38.056479] nix-daemon[865]: reaped child process 901, status = succeeded lb # [ 38.066134] niks3-server[990]: 2026/09/22 15:03:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.067657] nix-grpc-daemon[880]: time=2026-09-22T15:03:49.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 38.070694] nix-grpc-daemon[880]: time=2026-09-22T15:03:49.410Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 38.094710] niks3-server[990]: 2026/09/22 15:03:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 38.102180] niks3-server[990]: 2026/09/22 15:03:49 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 38.114459] niks3-server[990]: 2026/09/22 15:03:49 INFO Signed narinfos id=1 count=1 worker1 # [ 38.111056] nix-grpc-daemon[880]: time=2026-09-22T15:03:49.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.123863] niks3-server[990]: 2026/09/22 15:03:49 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 38.128731] niks3-server[990]: 2026/09/22 15:03:49 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 38.138087] niks3-server[990]: 2026/09/22 15:03:49 INFO Completed upload id=1 worker1 # [ 38.132891] nix-grpc-daemon[880]: time=2026-09-22T15:03:49.474Z level=INFO msg="Upload complete. (286ms)" worker1 # [ 38.135548] nix-grpc-daemon[783]: ts=2026-09-22T15:03:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 38.143442] niks3-server[990]: 2026/09/22 15:03:49 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker1 # [ 38.143213] nix-grpc-daemon[783]: ts=2026-09-22T15:03:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 38.150259] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 38.156218] nix-daemon[865]: reaped child process 878, status = succeeded worker1 # [ 38.160388] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 39.632414] nix-daemon[865]: reaped child process 905, status = succeeded worker1 # [ 39.679525] nix-daemon[865]: accepted connection from pid 922, user nix-grpc-daemon (trusted) worker1 # [ 39.696825] nix-daemon[865]: reaped child process 925, status = succeeded lb # [ 39.702992] niks3-server[990]: 2026/09/22 15:03:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.706398] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.047Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 39.707904] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.049Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 39.727611] niks3-server[990]: 2026/09/22 15:03:51 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 39.735043] niks3-server[990]: 2026/09/22 15:03:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 39.737056] niks3-server[990]: 2026/09/22 15:03:51 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 39.739326] niks3-server[990]: 2026/09/22 15:03:51 INFO Signed narinfos id=2 count=1 worker1 # [ 39.735492] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.077Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.744491] niks3-server[990]: 2026/09/22 15:03:51 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 39.748737] niks3-server[990]: 2026/09/22 15:03:51 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 39.756347] niks3-server[990]: 2026/09/22 15:03:51 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 39.759460] niks3-server[990]: 2026/09/22 15:03:51 INFO Completed upload id=2 worker1 # [ 39.754051] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.095Z level=INFO msg="Upload complete. (185ms)" worker1 # [ 39.761026] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 39.765268] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker1 # [ 39.768317] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.773556] nix-daemon[865]: reaped child process 903, status = succeeded worker1 # [ 39.808096] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 39.814299] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 39.820241] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.161Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 39.825111] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 39.840987] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 39.936923] nix-daemon[865]: accepted connection from pid 931, user nix-grpc-daemon (trusted) worker1 # [ 39.952865] nix-daemon[865]: reaped child process 934, status = succeeded worker1 # [ 40.039345] nix-daemon[865]: accepted connection from pid 936, user nix-grpc-daemon (trusted) worker1 # [ 40.053738] nix-daemon[865]: reaped child process 939, status = succeeded lb # [ 40.064907] niks3-server[990]: 2026/09/22 15:03:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.064365] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.405Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 40.065778] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.405Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 40.078535] niks3-server[990]: 2026/09/22 15:03:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 40.080886] niks3-server[990]: 2026/09/22 15:03:51 INFO Signed narinfos id=3 count=1 worker1 # [ 40.077039] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.418Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.085633] niks3-server[990]: 2026/09/22 15:03:51 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 40.088446] niks3-server[990]: 2026/09/22 15:03:51 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 40.093762] niks3-server[990]: 2026/09/22 15:03:51 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 40.097713] niks3-server[990]: 2026/09/22 15:03:51 INFO Completed upload id=3 worker1 # [ 40.092479] nix-grpc-daemon[880]: time=2026-09-22T15:03:51.433Z level=INFO msg="Upload complete. (244ms)" worker1 # [ 40.094664] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 40.100745] niks3-server[990]: 2026/09/22 15:03:51 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 40.097874] nix-grpc-daemon[783]: ts=2026-09-22T15:03:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 40.105578] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 40.108695] nix-daemon[865]: reaped child process 929, status = succeeded client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker1 # [ 40.114100] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 41.334435] nix-daemon[865]: reaped child process 943, status = succeeded worker1 # [ 41.411688] nix-daemon[865]: accepted connection from pid 959, user nix-grpc-daemon (trusted) worker1 # [ 41.425715] nix-daemon[865]: reaped child process 962, status = succeeded lb # [ 41.438298] niks3-server[990]: 2026/09/22 15:03:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.437651] nix-grpc-daemon[880]: time=2026-09-22T15:03:52.778Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 41.439937] nix-grpc-daemon[880]: time=2026-09-22T15:03:52.780Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 41.455284] niks3-server[990]: 2026/09/22 15:03:52 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 41.460478] niks3-server[990]: 2026/09/22 15:03:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign worker1 # [ 41.460282] nix-grpc-daemon[880]: time=2026-09-22T15:03:52.801Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.465137] niks3-server[990]: 2026/09/22 15:03:52 INFO Signed narinfos id=4 count=1 lb # [ 41.470069] niks3-server[990]: 2026/09/22 15:03:52 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 41.474216] niks3-server[990]: 2026/09/22 15:03:52 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 41.478950] niks3-server[990]: 2026/09/22 15:03:52 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 41.483994] niks3-server[990]: 2026/09/22 15:03:52 INFO Completed upload id=4 worker1 # [ 41.479859] nix-grpc-daemon[880]: time=2026-09-22T15:03:52.821Z level=INFO msg="Upload complete. (158ms)" lb # [ 41.485830] niks3-server[990]: 2026/09/22 15:03:52 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 41.485654] nix-grpc-daemon[783]: ts=2026-09-22T15:03:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 41.491559] nix-grpc-daemon[783]: ts=2026-09-22T15:03:52Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker1 # [ 41.493486] nix-grpc-daemon[783]: ts=2026-09-22T15:03:52Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 41.501405] nix-daemon[865]: reaped child process 941, status = succeeded worker1 # [ 41.534650] nix-grpc-daemon[783]: ts=2026-09-22T15:03:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 41.543300] nix-grpc-daemon[783]: ts=2026-09-22T15:03:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 41.552766] nix-grpc-daemon[880]: time=2026-09-22T15:03:52.894Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 41.558569] nix-grpc-daemon[783]: ts=2026-09-22T15:03:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 41.563370] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 41.654609] nix-daemon[865]: accepted connection from pid 969, user nix-grpc-daemon (trusted) worker1 # [ 41.669174] nix-daemon[865]: reaped child process 972, status = succeeded worker1 # [ 41.756349] nix-daemon[865]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker1 # [ 41.772978] nix-daemon[865]: reaped child process 977, status = succeeded lb # [ 41.781922] niks3-server[990]: 2026/09/22 15:03:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.782102] nix-grpc-daemon[880]: time=2026-09-22T15:03:53.123Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 41.783867] nix-grpc-daemon[880]: time=2026-09-22T15:03:53.123Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 41.797593] niks3-server[990]: 2026/09/22 15:03:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 41.800341] niks3-server[990]: 2026/09/22 15:03:53 INFO Signed narinfos id=5 count=1 worker1 # [ 41.795319] nix-grpc-daemon[880]: time=2026-09-22T15:03:53.136Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.802880] niks3-server[990]: 2026/09/22 15:03:53 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 41.806552] niks3-server[990]: 2026/09/22 15:03:53 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 41.810772] niks3-server[990]: 2026/09/22 15:03:53 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 41.818597] niks3-server[990]: 2026/09/22 15:03:53 INFO Completed upload id=5 worker1 # [ 41.813229] nix-grpc-daemon[880]: time=2026-09-22T15:03:53.154Z level=INFO msg="Upload complete. (243ms)" lb # [ 41.821252] niks3-server[990]: 2026/09/22 15:03:53 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 41.815962] nix-grpc-daemon[783]: ts=2026-09-22T15:03:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 41.819871] nix-grpc-daemon[783]: ts=2026-09-22T15:03:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 41.827722] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 41.830907] nix-daemon[865]: reaped child process 967, status = succeeded worker1 # [ 41.837907] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 43.111638] nix-daemon[865]: reaped child process 981, status = succeeded worker1 # [ 43.154306] nix-daemon[865]: accepted connection from pid 997, user nix-grpc-daemon (trusted) worker1 # [ 43.169770] nix-daemon[865]: reaped child process 1000, status = succeeded lb # [ 43.179331] niks3-server[990]: 2026/09/22 15:03:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.178674] nix-grpc-daemon[880]: time=2026-09-22T15:03:54.519Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.180454] nix-grpc-daemon[880]: time=2026-09-22T15:03:54.521Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 43.203815] niks3-server[990]: 2026/09/22 15:03:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 43.208924] niks3-server[990]: 2026/09/22 15:03:54 INFO Signed narinfos id=6 count=1 worker1 # [ 43.203590] nix-grpc-daemon[880]: time=2026-09-22T15:03:54.544Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.210393] niks3-server[990]: 2026/09/22 15:03:54 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 43.214151] niks3-server[990]: 2026/09/22 15:03:54 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 43.217387] niks3-server[990]: 2026/09/22 15:03:54 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 43.222576] niks3-server[990]: 2026/09/22 15:03:54 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 43.226726] niks3-server[990]: 2026/09/22 15:03:54 INFO Completed upload id=6 worker1 # [ 43.221292] nix-grpc-daemon[880]: time=2026-09-22T15:03:54.562Z level=INFO msg="Upload complete. (174ms)" lb # [ 43.228673] niks3-server[990]: 2026/09/22 15:03:54 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 43.224283] nix-grpc-daemon[783]: ts=2026-09-22T15:03:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 43.233262] nix-daemon[865]: reaped child process 979, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.80 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.14 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.10 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 44.005700] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 44.017029] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 44.023259] nix-grpc-daemon[880]: time=2026-09-22T15:03:55.364Z level=INFO msg="All 2 paths already cached" worker1 # [ 44.033524] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.19 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.72 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 44.501334] nix-grpc-daemon[782]: ts=2026-09-22T15:03:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39548 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 44.507983] nix-grpc-daemon[782]: ts=2026-09-22T15:03:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 44.515995] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker1 # [ 44.520306] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 44.523835] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 44.532310] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 44.540941] nix-grpc-daemon[880]: time=2026-09-22T15:03:55.882Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 44.545601] nix-grpc-daemon[783]: ts=2026-09-22T15:03:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 44.551301] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 44.644070] nix-daemon[865]: accepted connection from pid 1029, user nix-grpc-daemon (trusted) worker1 # [ 44.659623] nix-daemon[865]: reaped child process 1032, status = succeeded worker1 # [ 44.745771] nix-daemon[865]: accepted connection from pid 1034, user nix-grpc-daemon (trusted) worker1 # [ 44.760742] nix-daemon[865]: reaped child process 1037, status = succeeded lb # [ 44.771395] niks3-server[990]: 2026/09/22 15:03:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.776226] nix-grpc-daemon[880]: time=2026-09-22T15:03:56.117Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 44.777604] nix-grpc-daemon[880]: time=2026-09-22T15:03:56.117Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 44.798137] niks3-server[990]: 2026/09/22 15:03:56 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 44.808611] niks3-server[990]: 2026/09/22 15:03:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 44.810964] nix-grpc-daemon[880]: time=2026-09-22T15:03:56.152Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.816770] niks3-server[990]: 2026/09/22 15:03:56 INFO Signed narinfos id=7 count=1 lb # [ 44.821961] niks3-server[990]: 2026/09/22 15:03:56 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 44.833920] niks3-server[990]: 2026/09/22 15:03:56 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 44.841449] niks3-server[990]: 2026/09/22 15:03:56 INFO Completed upload id=7 worker1 # [ 44.838558] nix-grpc-daemon[880]: time=2026-09-22T15:03:56.179Z level=INFO msg="Upload complete. (282ms)" lb # [ 44.845221] niks3-server[990]: 2026/09/22 15:03:56 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 44.843086] nix-grpc-daemon[783]: ts=2026-09-22T15:03:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 44.847553] nix-grpc-daemon[783]: ts=2026-09-22T15:03:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 44.857277] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 44.864841] nix-daemon[865]: reaped child process 1027, status = succeeded client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 44.868717] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 45.683967] nix-daemon[865]: reaped child process 1041, status = succeeded worker1 # [ 45.765796] nix-daemon[865]: accepted connection from pid 1057, user nix-grpc-daemon (trusted) worker1 # [ 45.779584] nix-daemon[865]: reaped child process 1060, status = succeeded lb # [ 45.791991] niks3-server[990]: 2026/09/22 15:03:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.793032] nix-grpc-daemon[880]: time=2026-09-22T15:03:57.134Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.794570] nix-grpc-daemon[880]: time=2026-09-22T15:03:57.136Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 45.816070] niks3-server[990]: 2026/09/22 15:03:57 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 45.820076] niks3-server[990]: 2026/09/22 15:03:57 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 45.824188] niks3-server[990]: 2026/09/22 15:03:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 45.826963] niks3-server[990]: 2026/09/22 15:03:57 INFO Signed narinfos id=8 count=1 worker1 # [ 45.821887] nix-grpc-daemon[880]: time=2026-09-22T15:03:57.163Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.828751] niks3-server[990]: 2026/09/22 15:03:57 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 45.835053] niks3-server[990]: 2026/09/22 15:03:57 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 45.837851] niks3-server[990]: 2026/09/22 15:03:57 INFO Completed upload id=8 worker1 # [ 45.832364] nix-grpc-daemon[880]: time=2026-09-22T15:03:57.173Z level=INFO msg="Upload complete. (158ms)" lb # [ 45.839590] niks3-server[990]: 2026/09/22 15:03:57 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 45.835083] nix-grpc-daemon[783]: ts=2026-09-22T15:03:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 45.843632] nix-daemon[865]: reaped child process 1039, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.51 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 1.78 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 worker1 # [ 46.180881] nix-grpc-daemon[783]: ts=2026-09-22T15:03:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 46.197415] nix-grpc-daemon[782]: ts=2026-09-22T15:03:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 46.202616] nix-grpc-daemon[783]: ts=2026-09-22T15:03:57Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 46.215832] nix-grpc-daemon[782]: ts=2026-09-22T15:03:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 46.207220] nix-grpc-daemon[783]: ts=2026-09-22T15:03:57Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.221764] nix-grpc-daemon[782]: ts=2026-09-22T15:03:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker2 # [ 46.227610] nix-grpc-daemon[782]: ts=2026-09-22T15:03:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 46.233573] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 46.245956] nix-grpc-daemon[782]: ts=2026-09-22T15:03:57Z level=info event=niks3_push_started pid=878 worker2 # [ 46.372959] nix-grpc-daemon[878]: time=2026-09-22T15:03:57.596Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 46.470460] nix-daemon[850]: accepted connection from pid 891, user nix-grpc-daemon (trusted) worker2 # [ 46.487616] nix-daemon[850]: reaped child process 894, status = succeeded lb # [ 46.523148] envoy[916]: conn peer=[2001:db8:1::1]:59984 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=5 lb # [ 46.524618] envoy[916]: conn peer=[2001:db8:1::1]:60000 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=5 lb # [ 46.526055] envoy[916]: conn peer=[2001:db8:1::1]:60012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9477 tx=4364 ms=5672 lb # [ 46.527528] envoy[916]: conn peer=[2001:db8:1::1]:52170 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=478 ms=39 lb # [ 46.528913] envoy[916]: conn peer=[2001:db8:1::1]:52176 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4122 tx=1860 ms=1354 worker2 # [ 46.583062] nix-daemon[850]: accepted connection from pid 896, user nix-grpc-daemon (trusted) worker2 # [ 46.597054] nix-daemon[850]: reaped child process 899, status = succeeded lb # [ 46.600586] niks3-server[990]: 2026/09/22 15:03:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.606938] nix-grpc-daemon[878]: time=2026-09-22T15:03:57.830Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 46.610666] nix-grpc-daemon[878]: time=2026-09-22T15:03:57.832Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 46.621904] niks3-server[990]: 2026/09/22 15:03:57 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 46.624205] niks3-server[990]: 2026/09/22 15:03:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 46.627613] niks3-server[990]: 2026/09/22 15:03:57 INFO Signed narinfos id=9 count=1 worker2 # [ 46.629912] nix-grpc-daemon[878]: time=2026-09-22T15:03:57.853Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.630466] niks3-server[990]: 2026/09/22 15:03:57 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 46.635513] niks3-server[990]: 2026/09/22 15:03:57 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 46.638890] niks3-server[990]: 2026/09/22 15:03:57 INFO Completed upload id=9 worker2 # [ 46.640908] nix-grpc-daemon[878]: time=2026-09-22T15:03:57.864Z level=INFO msg="Upload complete. (263ms)" worker2 # [ 46.642812] nix-grpc-daemon[782]: ts=2026-09-22T15:03:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 46.643261] niks3-server[990]: 2026/09/22 15:03:57 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker2 # [ 46.650339] nix-grpc-daemon[782]: ts=2026-09-22T15:03:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 46.652357] nix-daemon[850]: reaped child process 876, status = succeeded worker2 # [ 46.654826] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 46.661142] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker2 # [ 47.885239] nix-daemon[850]: reaped child process 903, status = succeeded worker2 # [ 47.958751] nix-daemon[850]: accepted connection from pid 919, user nix-grpc-daemon (trusted) worker2 # [ 47.971374] nix-daemon[850]: reaped child process 922, status = succeeded lb # [ 47.976807] niks3-server[990]: 2026/09/22 15:03:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.983321] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.206Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 47.985107] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.208Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 48.000278] niks3-server[990]: 2026/09/22 15:03:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 48.001992] niks3-server[990]: 2026/09/22 15:03:59 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst worker2 # [ 48.009876] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.233Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.007782] niks3-server[990]: 2026/09/22 15:03:59 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 48.010825] niks3-server[990]: 2026/09/22 15:03:59 INFO Signed narinfos id=10 count=1 lb # [ 48.015760] niks3-server[990]: 2026/09/22 15:03:59 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 48.021172] niks3-server[990]: 2026/09/22 15:03:59 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 48.024286] niks3-server[990]: 2026/09/22 15:03:59 INFO Completed upload id=10 worker2 # [ 48.026261] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.250Z level=INFO msg="Upload complete. (156ms)" lb # [ 48.026647] niks3-server[990]: 2026/09/22 15:03:59 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 48.029033] nix-grpc-daemon[782]: ts=2026-09-22T15:03:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 48.035725] nix-daemon[850]: reaped child process 901, status = succeeded worker1 # [ 48.030955] nix-grpc-daemon[783]: ts=2026-09-22T15:03:59Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker1 # [ 48.035404] nix-grpc-daemon[783]: ts=2026-09-22T15:03:59Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.081781] nix-grpc-daemon[782]: ts=2026-09-22T15:03:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 48.093795] nix-grpc-daemon[782]: ts=2026-09-22T15:03:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 48.105789] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.329Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker2 # [ 48.113942] nix-grpc-daemon[782]: ts=2026-09-22T15:03:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 48.123164] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 48.220163] nix-daemon[850]: accepted connection from pid 926, user nix-grpc-daemon (trusted) worker2 # [ 48.235102] nix-daemon[850]: reaped child process 929, status = succeeded worker2 # [ 48.316627] nix-daemon[850]: accepted connection from pid 931, user nix-grpc-daemon (trusted) worker2 # [ 48.329867] nix-daemon[850]: reaped child process 934, status = succeeded lb # [ 48.333981] niks3-server[990]: 2026/09/22 15:03:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.343647] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.567Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 48.345184] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.568Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 48.365784] niks3-server[990]: 2026/09/22 15:03:59 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 48.375277] niks3-server[990]: 2026/09/22 15:03:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker2 # [ 48.382120] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.605Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.380498] niks3-server[990]: 2026/09/22 15:03:59 INFO Signed narinfos id=11 count=1 lb # [ 48.386198] niks3-server[990]: 2026/09/22 15:03:59 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 48.399737] niks3-server[990]: 2026/09/22 15:03:59 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 48.406260] niks3-server[990]: 2026/09/22 15:03:59 INFO Completed upload id=11 worker2 # [ 48.408064] nix-grpc-daemon[878]: time=2026-09-22T15:03:59.631Z level=INFO msg="Upload complete. (274ms)" worker2 # [ 48.412101] nix-grpc-daemon[782]: ts=2026-09-22T15:03:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 48.411105] niks3-server[990]: 2026/09/22 15:03:59 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 48.417566] nix-grpc-daemon[782]: ts=2026-09-22T15:03:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 48.427122] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 48.432322] nix-daemon[850]: reaped child process 924, status = succeeded client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... worker2 # [ 48.437353] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker2 # [ 49.474215] nix-daemon[850]: reaped child process 938, status = succeeded worker2 # [ 49.557941] nix-daemon[850]: accepted connection from pid 954, user nix-grpc-daemon (trusted) worker2 # [ 49.571483] nix-daemon[850]: reaped child process 957, status = succeeded lb # [ 49.578681] niks3-server[990]: 2026/09/22 15:04:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.587050] nix-grpc-daemon[878]: time=2026-09-22T15:04:00.810Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 49.588617] nix-grpc-daemon[878]: time=2026-09-22T15:04:00.812Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 49.620737] niks3-server[990]: 2026/09/22 15:04:00 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 49.625968] niks3-server[990]: 2026/09/22 15:04:00 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 49.633312] niks3-server[990]: 2026/09/22 15:04:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 49.639444] niks3-server[990]: 2026/09/22 15:04:00 INFO Signed narinfos id=12 count=1 worker2 # [ 49.642197] nix-grpc-daemon[878]: time=2026-09-22T15:04:00.865Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.648738] niks3-server[990]: 2026/09/22 15:04:00 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 49.656092] niks3-server[990]: 2026/09/22 15:04:00 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 49.663111] niks3-server[990]: 2026/09/22 15:04:00 INFO Completed upload id=12 lb # [ 49.665068] niks3-server[990]: 2026/09/22 15:04:00 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 49.665403] nix-grpc-daemon[878]: time=2026-09-22T15:04:00.889Z level=INFO msg="Upload complete. (220ms)" worker2 # [ 49.671959] nix-grpc-daemon[782]: ts=2026-09-22T15:04:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker1 # [ 49.670870] nix-grpc-daemon[783]: ts=2026-09-22T15:04:01Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 49.675675] nix-grpc-daemon[783]: ts=2026-09-22T15:04:01Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 49.688152] nix-daemon[850]: reaped child process 936, status = succeeded worker2 # [ 49.721273] nix-grpc-daemon[782]: ts=2026-09-22T15:04:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 49.733092] nix-grpc-daemon[782]: ts=2026-09-22T15:04:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 49.745575] nix-grpc-daemon[878]: time=2026-09-22T15:04:00.969Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 49.754876] nix-grpc-daemon[782]: ts=2026-09-22T15:04:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker2 # [ 49.777708] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 49.881443] nix-daemon[850]: accepted connection from pid 961, user nix-grpc-daemon (trusted) worker2 # [ 49.895737] nix-daemon[850]: reaped child process 964, status = succeeded worker2 # [ 49.977894] nix-daemon[850]: accepted connection from pid 966, user nix-grpc-daemon (trusted) worker2 # [ 49.990553] nix-daemon[850]: reaped child process 969, status = succeeded lb # [ 49.996437] niks3-server[990]: 2026/09/22 15:04:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.007071] nix-grpc-daemon[878]: time=2026-09-22T15:04:01.230Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 50.008915] nix-grpc-daemon[878]: time=2026-09-22T15:04:01.232Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 50.029833] niks3-server[990]: 2026/09/22 15:04:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 50.035102] niks3-server[990]: 2026/09/22 15:04:01 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst worker2 # [ 50.044837] nix-grpc-daemon[878]: time=2026-09-22T15:04:01.268Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.042697] niks3-server[990]: 2026/09/22 15:04:01 INFO Signed narinfos id=13 count=1 lb # [ 50.050101] niks3-server[990]: 2026/09/22 15:04:01 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 50.063554] niks3-server[990]: 2026/09/22 15:04:01 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 50.071077] niks3-server[990]: 2026/09/22 15:04:01 INFO Completed upload id=13 lb # [ 50.074231] niks3-server[990]: 2026/09/22 15:04:01 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 50.075898] nix-grpc-daemon[878]: time=2026-09-22T15:04:01.299Z level=INFO msg="Upload complete. (284ms)" worker2 # [ 50.080575] nix-grpc-daemon[782]: ts=2026-09-22T15:04:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 50.086728] nix-grpc-daemon[782]: ts=2026-09-22T15:04:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 50.096515] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 50.106199] nix-daemon[850]: reaped child process 959, status = succeeded client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... worker2 # [ 50.111120] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker2 # [ 51.350063] nix-daemon[850]: reaped child process 973, status = succeeded worker2 # [ 51.425783] nix-daemon[850]: accepted connection from pid 989, user nix-grpc-daemon (trusted) worker2 # [ 51.438329] nix-daemon[850]: reaped child process 992, status = succeeded lb # [ 51.443342] niks3-server[990]: 2026/09/22 15:04:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.453825] nix-grpc-daemon[878]: time=2026-09-22T15:04:02.677Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 51.455437] nix-grpc-daemon[878]: time=2026-09-22T15:04:02.679Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 51.486154] niks3-server[990]: 2026/09/22 15:04:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 51.491549] niks3-server[990]: 2026/09/22 15:04:02 INFO Signed narinfos id=14 count=1 worker2 # [ 51.497534] nix-grpc-daemon[878]: time=2026-09-22T15:04:02.721Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.496693] niks3-server[990]: 2026/09/22 15:04:02 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 51.503967] niks3-server[990]: 2026/09/22 15:04:02 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 51.512123] niks3-server[990]: 2026/09/22 15:04:02 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 51.519595] niks3-server[990]: 2026/09/22 15:04:02 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 51.526143] niks3-server[990]: 2026/09/22 15:04:02 INFO Completed upload id=14 lb # [ 51.527364] niks3-server[990]: 2026/09/22 15:04:02 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker2 # [ 51.528420] nix-grpc-daemon[878]: time=2026-09-22T15:04:02.752Z level=INFO msg="Upload complete. (209ms)" worker2 # [ 51.534934] nix-grpc-daemon[782]: ts=2026-09-22T15:04:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker2 # [ 51.549393] nix-daemon[850]: reaped child process 971, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.52 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 51.775696] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:55376 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 51.819891] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:55376 worker1 # [ 51.823244] nix-grpc-daemon[783]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 51.833216] nix-grpc-daemon[783]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 51.840810] nix-grpc-daemon[783]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.19 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 51.983175] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:51468 worker2 # [ 51.989480] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:51468 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.18 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/868" client # removing stale temporary roots file "/nix/var/nix/temproots/848" client # removing stale temporary roots file "/nix/var/nix/temproots/860" client # removing stale temporary roots file "/nix/var/nix/temproots/904" client # removing stale temporary roots file "/nix/var/nix/temproots/827" client # removing stale temporary roots file "/nix/var/nix/temproots/889" client # removing stale temporary roots file "/nix/var/nix/temproots/881" client # removing stale temporary roots file "/nix/var/nix/temproots/811" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 52.284360] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 52.280382] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 52.289960] nix-grpc-daemon[880]: time=2026-09-22T15:04:03.630Z level=INFO msg="All 1 paths already cached" worker2 # [ 52.302877] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 52.310095] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 client # copying 3 paths... worker2 # [ 52.320115] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker2 # [ 52.336371] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 52.335978] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60898 worker2 # [ 52.341823] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_out=232 worker1 # [ 52.340799] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 52.350166] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 52.354930] nix-grpc-daemon[782]: ts=2026-09-22T15:04:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.38 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 6.38 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 52.464483] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: ac21f476d45a4d59b011210af565c1fd client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup worker1 # [ 52.575375] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 client # [ 52.595560] nix[957]: don't know how to build these paths: client # [ 52.597133] nix[957]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 52.588723] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 52.592902] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.598271] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 52.607969] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 client # [ 52.631770] nix[957]: copying 1 paths to 'lb:50051'... client # [ 52.632707] nix[957]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 52.617790] nix-grpc-daemon[783]: ts=2026-09-22T15:04:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 52.626798] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 52.726343] nix-daemon[865]: accepted connection from pid 1080, user nix-grpc-daemon (trusted) worker1 # [ 52.741527] nix-daemon[865]: reaped child process 1083, status = succeeded worker1 # [ 52.829447] nix-daemon[865]: accepted connection from pid 1085, user nix-grpc-daemon (trusted) worker1 # [ 52.843454] nix-daemon[865]: reaped child process 1088, status = succeeded lb # [ 52.857818] niks3-server[990]: 2026/09/22 15:04:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.858522] nix-grpc-daemon[880]: time=2026-09-22T15:04:04.200Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.860084] nix-grpc-daemon[880]: time=2026-09-22T15:04:04.201Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 52.889727] niks3-server[990]: 2026/09/22 15:04:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 52.895067] niks3-server[990]: 2026/09/22 15:04:04 INFO Signed narinfos id=15 count=1 worker1 # [ 52.893160] nix-grpc-daemon[880]: time=2026-09-22T15:04:04.234Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.904884] niks3-server[990]: 2026/09/22 15:04:04 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 52.911115] niks3-server[990]: 2026/09/22 15:04:04 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 52.929646] niks3-server[990]: 2026/09/22 15:04:04 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 52.937557] niks3-server[990]: 2026/09/22 15:04:04 INFO Completed upload id=15 lb # [ 52.940228] niks3-server[990]: 2026/09/22 15:04:04 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 52.932392] nix-grpc-daemon[880]: time=2026-09-22T15:04:04.273Z level=INFO msg="Upload complete. (296ms)" worker1 # [ 52.937880] nix-grpc-daemon[783]: ts=2026-09-22T15:04:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 52.944905] nix-grpc-daemon[783]: ts=2026-09-22T15:04:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 52.955566] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 52.966188] nix-daemon[865]: reaped child process 1078, status = succeeded worker1 # [ 52.971940] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # [ 52.985653] nix[957]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 53.516661] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 8002bc736539413c8032aacf5163fa91 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.06 seconds) worker2 # [ 53.673269] nix-grpc-daemon[782]: ts=2026-09-22T15:04:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39548 client # [ 53.687155] nix[973]: don't know how to build these paths: client # [ 53.688128] nix[973]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 53.677527] nix-grpc-daemon[783]: ts=2026-09-22T15:04:05Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 53.681913] nix-grpc-daemon[783]: ts=2026-09-22T15:04:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 client # [ 53.699376] nix[973]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 lb # [ 56.523490] envoy[916]: conn peer=[2001:db8:1::1]:52190 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9468 tx=4360 ms=5361 lb # [ 56.527420] envoy[916]: conn peer=[2001:db8:1::1]:52200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2887 ms=138 lb # [ 56.531266] envoy[916]: conn peer=[2001:db8:1::1]:52218 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=70 lb # [ 56.535488] envoy[916]: conn peer=[2001:db8:1::1]:52206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=84 lb # [ 56.539076] envoy[916]: conn peer=[2001:db8:1::1]:52210 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=79 client: (finished: must succeed: sleep 2, in 2.04 seconds) worker1 # [ 56.791132] nix-daemon[865]: reaped child process 1092, status = succeeded client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 56.872466] nix-daemon[865]: accepted connection from pid 1124, user nix-grpc-daemon (trusted) worker1 # [ 56.887387] nix-daemon[865]: reaped child process 1127, status = succeeded lb # [ 56.900255] niks3-server[990]: 2026/09/22 15:04:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.904724] nix-grpc-daemon[880]: time=2026-09-22T15:04:08.245Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 56.907069] nix-grpc-daemon[880]: time=2026-09-22T15:04:08.247Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 56.937083] niks3-server[990]: 2026/09/22 15:04:08 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 56.951504] niks3-server[990]: 2026/09/22 15:04:08 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 56.962986] niks3-server[990]: 2026/09/22 15:04:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 56.969056] niks3-server[990]: 2026/09/22 15:04:08 INFO Signed narinfos id=16 count=1 worker1 # [ 56.966560] nix-grpc-daemon[880]: time=2026-09-22T15:04:08.307Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.974531] niks3-server[990]: 2026/09/22 15:04:08 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 56.984679] niks3-server[990]: 2026/09/22 15:04:08 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 56.987363] niks3-server[990]: 2026/09/22 15:04:08 INFO Completed upload id=16 worker1 # [ 56.983536] nix-grpc-daemon[880]: time=2026-09-22T15:04:08.324Z level=INFO msg="Upload complete. (201ms)" lb # [ 56.992419] niks3-server[990]: 2026/09/22 15:04:08 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker1 # [ 56.991332] nix-grpc-daemon[783]: ts=2026-09-22T15:04:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 57.000308] nix-grpc-daemon[783]: ts=2026-09-22T15:04:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 57.012661] nix-daemon[865]: reaped child process 1090, status = succeeded client # [ 57.057341] systemd[1]: dedup2.service: Deactivated successfully. client # [ 57.060378] systemd[1]: dedup2.service: Consumed 138ms CPU time over 3.540s wall clock time, 35.4M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic. client # [ 57.066309] systemd[1]: dedup1.service: Deactivated successfully. client # [ 57.069543] systemd[1]: dedup1.service: Consumed 114ms CPU time over 4.604s wall clock time, 43.5M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.68 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 58.256613] nix-grpc-daemon[782]: ts=2026-09-22T15:04:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 58.259188] nix-grpc-daemon[783]: ts=2026-09-22T15:04:09Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker1 # [ 58.260948] nix-grpc-daemon[783]: ts=2026-09-22T15:04:09Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 58.267719] nix-grpc-daemon[782]: ts=2026-09-22T15:04:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 58.276795] nix-grpc-daemon[782]: ts=2026-09-22T15:04:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 58.285529] nix-grpc-daemon[782]: ts=2026-09-22T15:04:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 58.296347] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 58.398179] nix-daemon[850]: accepted connection from pid 1017, user nix-grpc-daemon (trusted) worker2 # [ 58.412688] nix-daemon[850]: reaped child process 1020, status = succeeded worker2 # [ 58.493197] nix-daemon[850]: accepted connection from pid 1022, user nix-grpc-daemon (trusted) worker2 # [ 58.506210] nix-daemon[850]: reaped child process 1025, status = succeeded lb # [ 58.510902] niks3-server[990]: 2026/09/22 15:04:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 58.517257] nix-grpc-daemon[878]: time=2026-09-22T15:04:09.740Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 58.518595] nix-grpc-daemon[878]: time=2026-09-22T15:04:09.740Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 58.523565] niks3-server[990]: 2026/09/22 15:04:09 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 58.526262] niks3-server[990]: 2026/09/22 15:04:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 58.528315] niks3-server[990]: 2026/09/22 15:04:09 INFO Signed narinfos id=17 count=1 worker2 # [ 58.531607] nix-grpc-daemon[878]: time=2026-09-22T15:04:09.755Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.532565] niks3-server[990]: 2026/09/22 15:04:09 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 58.537062] niks3-server[990]: 2026/09/22 15:04:09 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 58.540948] niks3-server[990]: 2026/09/22 15:04:09 INFO Completed upload id=17 worker2 # [ 58.542692] nix-grpc-daemon[878]: time=2026-09-22T15:04:09.766Z level=INFO msg="Upload complete. (235ms)" worker2 # [ 58.544684] nix-grpc-daemon[782]: ts=2026-09-22T15:04:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 58.543584] niks3-server[990]: 2026/09/22 15:04:09 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 58.547906] nix-grpc-daemon[782]: ts=2026-09-22T15:04:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 58.554190] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 58.557697] nix-daemon[850]: reaped child process 1015, status = succeeded worker2 # [ 58.562091] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 64.974880] nix-grpc-daemon[782]: ts=2026-09-22T15:04:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker2 # [ 64.986282] nix-daemon[850]: reaped child process 1029, status = succeeded worker2 # [ 64.987263] nix-daemon[850]: reaped child process 1027, status = succeeded worker1 # [ 65.099630] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 65.105791] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker1 # [ 65.107912] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 65.110428] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 65.118193] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 65.125411] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 65.130784] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 65.224852] nix-daemon[865]: accepted connection from pid 1144, user nix-grpc-daemon (trusted) worker1 # [ 65.241435] nix-daemon[865]: reaped child process 1147, status = succeeded worker1 # [ 65.326767] nix-daemon[865]: accepted connection from pid 1149, user nix-grpc-daemon (trusted) worker1 # [ 65.341201] nix-daemon[865]: reaped child process 1152, status = succeeded lb # [ 65.353211] niks3-server[990]: 2026/09/22 15:04:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.356393] nix-grpc-daemon[880]: time=2026-09-22T15:04:16.697Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 65.357793] nix-grpc-daemon[880]: time=2026-09-22T15:04:16.697Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 65.379925] niks3-server[990]: 2026/09/22 15:04:16 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 65.384860] niks3-server[990]: 2026/09/22 15:04:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 65.386839] niks3-server[990]: 2026/09/22 15:04:16 INFO Signed narinfos id=18 count=1 worker1 # [ 65.383556] nix-grpc-daemon[880]: time=2026-09-22T15:04:16.724Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.392320] niks3-server[990]: 2026/09/22 15:04:16 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 65.398063] niks3-server[990]: 2026/09/22 15:04:16 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 65.401634] niks3-server[990]: 2026/09/22 15:04:16 INFO Completed upload id=18 worker1 # [ 65.396392] nix-grpc-daemon[880]: time=2026-09-22T15:04:16.737Z level=INFO msg="Upload complete. (260ms)" worker1 # [ 65.398962] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 65.405212] niks3-server[990]: 2026/09/22 15:04:16 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 65.402613] nix-grpc-daemon[783]: ts=2026-09-22T15:04:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 65.410668] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 65.415121] nix-daemon[865]: reaped child process 1142, status = succeeded worker1 # [ 65.420531] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) lb # [ 66.523061] envoy[916]: conn peer=[2001:db8:1::1]:52230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2998 tx=1537 ms=4433 lb # [ 66.525118] envoy[916]: conn peer=[2001:db8:1::1]:55146 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1197 ms=3346 lb # [ 66.526914] envoy[916]: conn peer=[2001:db8:1::1]:55152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=935 ms=6728 worker1 # [ 71.433559] nix-grpc-daemon[783]: ts=2026-09-22T15:04:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker1 # [ 71.445926] nix-daemon[865]: reaped child process 1156, status = succeeded worker1 # [ 71.447198] nix-daemon[865]: reaped child process 1154, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.48 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 71.648533] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 834d4cdbc4464e7e87b03cb4626803d5 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share worker2 # [ 71.779747] nix-grpc-daemon[782]: ts=2026-09-22T15:04:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39548 client # [ 71.793883] nix[1047]: don't know how to build these paths: client # [ 71.794817] nix[1047]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 71.786461] nix-grpc-daemon[783]: ts=2026-09-22T15:04:23Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 71.791434] nix-grpc-daemon[783]: ts=2026-09-22T15:04:23Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 71.801253] nix-grpc-daemon[782]: ts=2026-09-22T15:04:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 71.813445] nix-grpc-daemon[782]: ts=2026-09-22T15:04:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 client # [ 71.831074] nix[1047]: copying 1 paths to 'lb:50051'... client # [ 71.831807] nix[1047]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 71.824459] nix-grpc-daemon[782]: ts=2026-09-22T15:04:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 71.835147] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 71.938860] nix-daemon[850]: accepted connection from pid 1052, user nix-grpc-daemon (trusted) worker2 # [ 71.951881] nix-daemon[850]: reaped child process 1055, status = succeeded worker2 # [ 72.036064] nix-daemon[850]: accepted connection from pid 1057, user nix-grpc-daemon (trusted) worker2 # [ 72.049154] nix-daemon[850]: reaped child process 1060, status = succeeded lb # [ 72.054901] niks3-server[990]: 2026/09/22 15:04:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.066149] nix-grpc-daemon[878]: time=2026-09-22T15:04:23.289Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 72.067546] nix-grpc-daemon[878]: time=2026-09-22T15:04:23.289Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 72.085116] niks3-server[990]: 2026/09/22 15:04:23 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 72.092270] niks3-server[990]: 2026/09/22 15:04:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 72.100121] niks3-server[990]: 2026/09/22 15:04:23 INFO Signed narinfos id=19 count=1 worker2 # [ 72.105252] nix-grpc-daemon[878]: time=2026-09-22T15:04:23.328Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.106956] niks3-server[990]: 2026/09/22 15:04:23 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 72.121444] niks3-server[990]: 2026/09/22 15:04:23 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 72.127110] niks3-server[990]: 2026/09/22 15:04:23 INFO Completed upload id=19 worker2 # [ 72.128981] nix-grpc-daemon[878]: time=2026-09-22T15:04:23.352Z level=INFO msg="Upload complete. (282ms)" lb # [ 72.130123] niks3-server[990]: 2026/09/22 15:04:23 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 72.133280] nix-grpc-daemon[782]: ts=2026-09-22T15:04:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 72.140120] nix-grpc-daemon[782]: ts=2026-09-22T15:04:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 72.148712] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 72.156885] nix-daemon[850]: reaped child process 1050, status = succeeded worker2 # [ 72.161669] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # [ 72.168647] nix[1047]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 72.713942] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: e446a0eb30924db6ba3a8fb2d17af180 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) client # [ 72.855954] nix[1063]: don't know how to build these paths: client # [ 72.856859] nix[1063]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 72.839978] nix-grpc-daemon[783]: ts=2026-09-22T15:04:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 72.850421] nix-grpc-daemon[783]: ts=2026-09-22T15:04:24Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 72.860885] nix-grpc-daemon[782]: ts=2026-09-22T15:04:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 client # [ 72.873820] nix[1063]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 75.963481] systemd[1]: share1.service: Sent signal SIGINT to main process 1047 (nix) on client request. client # [ 75.971511] nix[1047]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.05 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 75.978241] nix[1047]: error: interrupted by the user client # [ 76.018694] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 76.020212] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 76.022156] systemd[1]: share1.service: Consumed 115ms CPU time over 4.373s wall clock time, 41.5M memory peak, 6.1K incoming IP traffic, 8.2K outgoing IP traffic. lb # [ 76.524596] envoy[916]: conn peer=[2001:db8:1::1]:43050 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=933 ms=6390 lb # [ 76.528528] envoy[916]: conn peer=[2001:db8:1::1]:43056 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2982 tx=814 ms=4200 client: (finished: waiting for success: ! systemctl is-active share1, in 1.06 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 77.398393] nix-daemon[850]: reaped child process 1064, status = succeeded worker2 # [ 77.482561] nix-daemon[850]: accepted connection from pid 1098, user nix-grpc-daemon (trusted) worker2 # [ 77.496218] nix-daemon[850]: reaped child process 1101, status = succeeded lb # [ 77.500429] niks3-server[990]: 2026/09/22 15:04:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 77.513585] nix-grpc-daemon[878]: time=2026-09-22T15:04:28.736Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 77.516489] nix-grpc-daemon[878]: time=2026-09-22T15:04:28.738Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 77.555616] niks3-server[990]: 2026/09/22 15:04:28 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 77.560830] niks3-server[990]: 2026/09/22 15:04:28 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 77.573229] niks3-server[990]: 2026/09/22 15:04:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 77.581157] nix-grpc-daemon[878]: time=2026-09-22T15:04:28.804Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.578885] niks3-server[990]: 2026/09/22 15:04:28 INFO Signed narinfos id=20 count=1 lb # [ 77.584690] niks3-server[990]: 2026/09/22 15:04:28 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 77.590062] niks3-server[990]: 2026/09/22 15:04:28 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 77.594619] niks3-server[990]: 2026/09/22 15:04:28 INFO Completed upload id=20 worker2 # [ 77.596625] nix-grpc-daemon[878]: time=2026-09-22T15:04:28.820Z level=INFO msg="Upload complete. (223ms)" lb # [ 77.596161] niks3-server[990]: 2026/09/22 15:04:28 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 77.599460] nix-grpc-daemon[782]: ts=2026-09-22T15:04:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 77.603405] nix-grpc-daemon[782]: ts=2026-09-22T15:04:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 77.616330] nix-daemon[850]: reaped child process 1062, status = succeeded client # [ 77.680470] systemd[1]: share2.service: Deactivated successfully. client # [ 77.683973] systemd[1]: share2.service: Consumed 119ms CPU time over 4.969s wall clock time, 37.5M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.06 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.02 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.67 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 78.367835] systemd[1]: Started Nix Daemon. client # [ 78.456496] nix-daemon[1114]: accepted connection from pid 1111, user root (trusted) worker1 # [ 78.562839] nix-grpc-daemon[783]: ts=2026-09-22T15:04:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 78.569306] nix-grpc-daemon[783]: ts=2026-09-22T15:04:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 78.585242] nix-grpc-daemon[783]: ts=2026-09-22T15:04:29Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 78.590891] nix-grpc-daemon[783]: ts=2026-09-22T15:04:29Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 78.596843] nix-grpc-daemon[783]: ts=2026-09-22T15:04:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 78.608155] nix-grpc-daemon[783]: ts=2026-09-22T15:04:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 78.619916] nix-grpc-daemon[783]: ts=2026-09-22T15:04:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 78.628824] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 78.733831] nix-daemon[865]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 78.748824] nix-daemon[865]: reaped child process 1204, status = succeeded worker1 # [ 78.838149] nix-daemon[865]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 78.853178] nix-daemon[865]: reaped child process 1209, status = succeeded lb # [ 78.864799] niks3-server[990]: 2026/09/22 15:04:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.869260] nix-grpc-daemon[880]: time=2026-09-22T15:04:30.210Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 78.870800] nix-grpc-daemon[880]: time=2026-09-22T15:04:30.212Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 78.896685] niks3-server[990]: 2026/09/22 15:04:30 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 78.905529] niks3-server[990]: 2026/09/22 15:04:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 78.910726] niks3-server[990]: 2026/09/22 15:04:30 INFO Signed narinfos id=21 count=1 worker1 # [ 78.908452] nix-grpc-daemon[880]: time=2026-09-22T15:04:30.249Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.921319] niks3-server[990]: 2026/09/22 15:04:30 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 78.929462] niks3-server[990]: 2026/09/22 15:04:30 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker1 # [ 78.930450] nix-grpc-daemon[880]: time=2026-09-22T15:04:30.271Z level=INFO msg="Upload complete. (288ms)" lb # [ 78.936166] niks3-server[990]: 2026/09/22 15:04:30 INFO Completed upload id=21 worker1 # [ 78.932893] nix-grpc-daemon[783]: ts=2026-09-22T15:04:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 78.939863] niks3-server[990]: 2026/09/22 15:04:30 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 78.939175] nix-grpc-daemon[783]: ts=2026-09-22T15:04:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 78.950069] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 78.952741] nix-daemon[865]: reaped child process 1199, status = succeeded worker1 # [ 78.957702] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 79.796457] nix-daemon[865]: reaped child process 1213, status = succeeded worker1 # [ 79.869070] nix-daemon[865]: accepted connection from pid 1230, user nix-grpc-daemon (trusted) worker1 # [ 79.883994] nix-daemon[865]: reaped child process 1233, status = succeeded lb # [ 79.893864] niks3-server[990]: 2026/09/22 15:04:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.892985] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.234Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 79.895278] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.236Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 79.913516] niks3-server[990]: 2026/09/22 15:04:31 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 79.915547] niks3-server[990]: 2026/09/22 15:04:31 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker1 # [ 79.917313] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.258Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.922398] niks3-server[990]: 2026/09/22 15:04:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 79.924058] niks3-server[990]: 2026/09/22 15:04:31 INFO Signed narinfos id=22 count=1 lb # [ 79.930196] niks3-server[990]: 2026/09/22 15:04:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 79.932165] niks3-server[990]: 2026/09/22 15:04:31 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 79.937972] niks3-server[990]: 2026/09/22 15:04:31 INFO Completed upload id=22 worker1 # [ 79.932723] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.274Z level=INFO msg="Upload complete. (168ms)" lb # [ 79.939231] niks3-server[990]: 2026/09/22 15:04:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 79.936644] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker1 # [ 79.944799] nix-daemon[865]: reaped child process 1211, status = succeeded worker2 # [ 79.950879] nix-grpc-daemon[782]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 79.960882] nix-grpc-daemon[782]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 79.983519] nix-grpc-daemon[782]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 79.988687] nix-grpc-daemon[782]: ts=2026-09-22T15:04:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 80.183913] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 80.187589] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 80.193527] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.535Z level=INFO msg="All 1 paths already cached" worker1 # [ 80.203475] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 80.205720] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 80.208474] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 80.215870] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 80.223850] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.565Z level=INFO msg="All 1 paths already cached" worker1 # [ 80.228111] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 80.233072] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 80.321286] nix-daemon[865]: accepted connection from pid 1239, user nix-grpc-daemon (trusted) worker1 # [ 80.337290] nix-daemon[865]: reaped child process 1242, status = succeeded worker1 # [ 80.421218] nix-daemon[865]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker1 # [ 80.436535] nix-daemon[865]: reaped child process 1247, status = succeeded lb # [ 80.447099] niks3-server[990]: 2026/09/22 15:04:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 80.450828] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.792Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 80.452278] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.792Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 80.477234] niks3-server[990]: 2026/09/22 15:04:31 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 80.486410] niks3-server[990]: 2026/09/22 15:04:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 80.492844] niks3-server[990]: 2026/09/22 15:04:31 INFO Signed narinfos id=23 count=1 worker1 # [ 80.490740] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.832Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.497856] niks3-server[990]: 2026/09/22 15:04:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 80.510410] niks3-server[990]: 2026/09/22 15:04:31 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker1 # [ 80.512227] nix-grpc-daemon[880]: time=2026-09-22T15:04:31.853Z level=INFO msg="Upload complete. (273ms)" lb # [ 80.517612] niks3-server[990]: 2026/09/22 15:04:31 INFO Completed upload id=23 lb # [ 80.520378] niks3-server[990]: 2026/09/22 15:04:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 80.515457] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 80.521201] nix-grpc-daemon[783]: ts=2026-09-22T15:04:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 80.530063] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 80.535077] nix-daemon[865]: reaped child process 1237, status = succeeded worker1 # [ 80.539847] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 81.575949] nix-daemon[865]: reaped child process 1251, status = succeeded worker1 # [ 81.661102] nix-daemon[865]: accepted connection from pid 1267, user nix-grpc-daemon (trusted) worker1 # [ 81.674349] nix-daemon[865]: reaped child process 1270, status = succeeded lb # [ 81.687819] niks3-server[990]: 2026/09/22 15:04:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 81.692605] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 81.694254] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.035Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 81.725848] niks3-server[990]: 2026/09/22 15:04:33 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 81.740698] niks3-server[990]: 2026/09/22 15:04:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 81.750239] niks3-server[990]: 2026/09/22 15:04:33 INFO Signed narinfos id=24 count=1 worker1 # [ 81.748338] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.089Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.753774] niks3-server[990]: 2026/09/22 15:04:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 81.759397] niks3-server[990]: 2026/09/22 15:04:33 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 81.770029] niks3-server[990]: 2026/09/22 15:04:33 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 81.773616] niks3-server[990]: 2026/09/22 15:04:33 INFO Completed upload id=24 lb # [ 81.775955] niks3-server[990]: 2026/09/22 15:04:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 81.769898] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.111Z level=INFO msg="Upload complete. (220ms)" worker1 # [ 81.776590] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker2 # [ 81.794491] nix-grpc-daemon[782]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 81.792441] nix-daemon[865]: reaped child process 1249, status = succeeded worker2 # [ 81.803057] nix-grpc-daemon[782]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 81.825471] nix-grpc-daemon[782]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 81.830132] nix-grpc-daemon[782]: ts=2026-09-22T15:04:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 82.033184] nix-grpc-daemon[782]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 82.040098] nix-grpc-daemon[782]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 82.045817] nix-grpc-daemon[878]: time=2026-09-22T15:04:33.267Z level=INFO msg="All 2 paths already cached" worker1 # [ 82.044627] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 82.047082] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 82.049644] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 82.056792] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 82.065111] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.406Z level=INFO msg="All 2 paths already cached" worker1 # [ 82.069760] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 82.073156] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 82.168364] nix-daemon[865]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 82.185768] nix-daemon[865]: reaped child process 1279, status = succeeded worker1 # [ 82.265663] nix-daemon[865]: accepted connection from pid 1281, user nix-grpc-daemon (trusted) worker1 # [ 82.283141] nix-daemon[865]: reaped child process 1284, status = succeeded lb # [ 82.286675] niks3-server[990]: 2026/09/22 15:04:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.289929] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.631Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 82.291753] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.632Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 82.315535] niks3-server[990]: 2026/09/22 15:04:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 82.321546] niks3-server[990]: 2026/09/22 15:04:33 INFO Signed narinfos id=25 count=1 worker1 # [ 82.319488] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.660Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.330114] niks3-server[990]: 2026/09/22 15:04:33 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 82.335420] niks3-server[990]: 2026/09/22 15:04:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 82.346260] niks3-server[990]: 2026/09/22 15:04:33 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 82.354484] niks3-server[990]: 2026/09/22 15:04:33 INFO Completed upload id=25 worker1 # [ 82.349080] nix-grpc-daemon[880]: time=2026-09-22T15:04:33.690Z level=INFO msg="Upload complete. (268ms)" lb # [ 82.357095] niks3-server[990]: 2026/09/22 15:04:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 82.352573] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 82.358604] nix-grpc-daemon[783]: ts=2026-09-22T15:04:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 82.367566] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 82.370595] nix-daemon[865]: reaped child process 1274, status = succeeded worker1 # [ 82.376131] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 83.200805] nix-daemon[865]: reaped child process 1288, status = succeeded worker1 # [ 83.277182] nix-daemon[865]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) worker1 # [ 83.291651] nix-daemon[865]: reaped child process 1308, status = succeeded lb # [ 83.304209] niks3-server[990]: 2026/09/22 15:04:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 83.311859] nix-grpc-daemon[880]: time=2026-09-22T15:04:34.653Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 83.313372] nix-grpc-daemon[880]: time=2026-09-22T15:04:34.654Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 83.346113] niks3-server[990]: 2026/09/22 15:04:34 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 83.350345] niks3-server[990]: 2026/09/22 15:04:34 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 83.361512] niks3-server[990]: 2026/09/22 15:04:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 83.366174] niks3-server[990]: 2026/09/22 15:04:34 INFO Signed narinfos id=26 count=1 worker1 # [ 83.363211] nix-grpc-daemon[880]: time=2026-09-22T15:04:34.704Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.372490] niks3-server[990]: 2026/09/22 15:04:34 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 83.376560] niks3-server[990]: 2026/09/22 15:04:34 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 83.379412] niks3-server[990]: 2026/09/22 15:04:34 INFO Completed upload id=26 lb # [ 83.381904] niks3-server[990]: 2026/09/22 15:04:34 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 83.375461] nix-grpc-daemon[880]: time=2026-09-22T15:04:34.716Z level=INFO msg="Upload complete. (192ms)" worker1 # [ 83.383568] nix-grpc-daemon[783]: ts=2026-09-22T15:04:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker2 # [ 83.394814] nix-grpc-daemon[782]: ts=2026-09-22T15:04:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 83.396427] nix-daemon[865]: reaped child process 1286, status = succeeded worker2 # [ 83.403637] nix-grpc-daemon[782]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 83.425695] nix-grpc-daemon[782]: ts=2026-09-22T15:04:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 83.430731] nix-grpc-daemon[782]: ts=2026-09-22T15:04:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_out=232 client # [ 83.550410] nix-daemon[1114]: reaped child process 1116, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.28 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.34 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.10 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 84.185559] nix-daemon[1114]: accepted connection from pid 1197, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 84.290794] nix-grpc-daemon[782]: ts=2026-09-22T15:04:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:39548 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 84.287343] nix-grpc-daemon[783]: ts=2026-09-22T15:04:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 84.375628] nix-daemon[865]: accepted connection from pid 1315, user nix-grpc-daemon (trusted) worker1 # [ 84.389151] nix-daemon[865]: reaped child process 1318, status = succeeded lb # [ 84.401773] niks3-server[990]: 2026/09/22 15:04:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.402826] nix-grpc-daemon[880]: time=2026-09-22T15:04:35.744Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 84.404602] nix-grpc-daemon[880]: time=2026-09-22T15:04:35.745Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 84.426413] niks3-server[990]: 2026/09/22 15:04:35 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 84.441081] niks3-server[990]: 2026/09/22 15:04:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 84.447058] niks3-server[990]: 2026/09/22 15:04:35 INFO Signed narinfos id=27 count=1 worker1 # [ 84.444755] nix-grpc-daemon[880]: time=2026-09-22T15:04:35.786Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.453684] niks3-server[990]: 2026/09/22 15:04:35 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 84.465874] niks3-server[990]: 2026/09/22 15:04:35 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 84.471700] niks3-server[990]: 2026/09/22 15:04:35 INFO Completed upload id=27 worker1 # [ 84.465941] nix-grpc-daemon[880]: time=2026-09-22T15:04:35.807Z level=INFO msg="Upload complete. (176ms)" lb # [ 84.474536] niks3-server[990]: 2026/09/22 15:04:35 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker1 # [ 84.484348] nix-grpc-daemon[783]: ts=2026-09-22T15:04:35Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker1 # [ 84.488551] nix-grpc-daemon[783]: ts=2026-09-22T15:04:35Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 84.535167] nix-grpc-daemon[782]: ts=2026-09-22T15:04:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 84.544035] nix-grpc-daemon[782]: ts=2026-09-22T15:04:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 client # copying 2 paths to 'lb:50051'... worker2 # [ 84.554333] nix-grpc-daemon[782]: ts=2026-09-22T15:04:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 84.569318] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 84.684277] nix-daemon[850]: accepted connection from pid 1111, user nix-grpc-daemon (trusted) worker2 # [ 84.700717] nix-daemon[850]: reaped child process 1114, status = succeeded worker2 # [ 84.788862] nix-daemon[850]: accepted connection from pid 1116, user nix-grpc-daemon (trusted) worker2 # [ 84.805513] nix-daemon[850]: reaped child process 1119, status = succeeded lb # [ 84.808070] niks3-server[990]: 2026/09/22 15:04:36 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 84.813936] niks3-server[990]: 2026/09/22 15:04:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 84.821489] nix-grpc-daemon[878]: time=2026-09-22T15:04:36.044Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 84.822881] nix-grpc-daemon[878]: time=2026-09-22T15:04:36.044Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker2 # [ 84.824477] nix-grpc-daemon[878]: time=2026-09-22T15:04:36.044Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 84.832669] niks3-server[990]: 2026/09/22 15:04:36 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 84.839376] niks3-server[990]: 2026/09/22 15:04:36 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 84.842621] niks3-server[990]: 2026/09/22 15:04:36 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 84.847304] niks3-server[990]: 2026/09/22 15:04:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 84.850732] niks3-server[990]: 2026/09/22 15:04:36 INFO Signed narinfos id=29 count=2 lb # [ 84.853467] niks3-server[990]: 2026/09/22 15:04:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 84.855174] niks3-server[990]: 2026/09/22 15:04:36 INFO Signed narinfos id=28 count=1 worker2 # [ 84.858782] nix-grpc-daemon[878]: time=2026-09-22T15:04:36.082Z level=INFO msg="Uploading 3 narinfos" lb # [ 84.858657] niks3-server[990]: 2026/09/22 15:04:36 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 84.871877] niks3-server[990]: 2026/09/22 15:04:36 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 84.875296] niks3-server[990]: 2026/09/22 15:04:36 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 84.878118] niks3-server[990]: 2026/09/22 15:04:36 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 84.880308] niks3-server[990]: 2026/09/22 15:04:36 INFO Completed upload id=28 lb # [ 84.881682] niks3-server[990]: 2026/09/22 15:04:36 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 84.884208] niks3-server[990]: 2026/09/22 15:04:36 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 84.886248] niks3-server[990]: 2026/09/22 15:04:36 INFO Completed upload id=29 worker2 # [ 84.888259] nix-grpc-daemon[878]: time=2026-09-22T15:04:36.111Z level=INFO msg="Upload complete. (305ms)" worker2 # [ 84.891707] nix-grpc-daemon[782]: ts=2026-09-22T15:04:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 84.894426] nix-grpc-daemon[782]: ts=2026-09-22T15:04:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 84.902057] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 84.906180] nix-daemon[850]: reaped child process 1109, status = succeeded worker2 # [ 84.913309] nix-grpc-daemon[782]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 84.920132] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 85.757564] nix-daemon[850]: reaped child process 1124, status = succeeded worker2 # [ 85.841588] nix-daemon[850]: accepted connection from pid 1140, user nix-grpc-daemon (trusted) worker2 # [ 85.856882] nix-daemon[850]: reaped child process 1143, status = succeeded lb # [ 85.862673] niks3-server[990]: 2026/09/22 15:04:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.874777] nix-grpc-daemon[878]: time=2026-09-22T15:04:37.098Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 85.896591] niks3-server[990]: 2026/09/22 15:04:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker2 # [ 85.902971] nix-grpc-daemon[878]: time=2026-09-22T15:04:37.126Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.900934] niks3-server[990]: 2026/09/22 15:04:37 INFO Signed narinfos id=30 count=1 lb # [ 85.908572] niks3-server[990]: 2026/09/22 15:04:37 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 85.920112] niks3-server[990]: 2026/09/22 15:04:37 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 85.924863] niks3-server[990]: 2026/09/22 15:04:37 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete worker2 # [ 85.933431] nix-grpc-daemon[878]: time=2026-09-22T15:04:37.157Z level=INFO msg="Upload complete. (204ms)" lb # [ 85.931487] niks3-server[990]: 2026/09/22 15:04:37 INFO Completed upload id=30 worker2 # [ 85.936740] nix-grpc-daemon[782]: ts=2026-09-22T15:04:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 client # copying 1 paths... lb # [ 85.938783] niks3-server[990]: 2026/09/22 15:04:37 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 85.946782] nix-daemon[850]: reaped child process 1121, status = succeeded worker1 # [ 85.938825] nix-grpc-daemon[783]: ts=2026-09-22T15:04:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 85.947351] nix-grpc-daemon[783]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 85.979969] nix-grpc-daemon[782]: ts=2026-09-22T15:04:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 85.982117] nix-grpc-daemon[782]: ts=2026-09-22T15:04:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_out=120 client # [ 86.058979] nix-daemon[1114]: reaped child process 1200, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 1.99 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 86.151096] nix-daemon[1114]: accepted connection from pid 1219, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 86.252842] nix-grpc-daemon[782]: ts=2026-09-22T15:04:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:39548 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 86.258817] nix-grpc-daemon[782]: ts=2026-09-22T15:04:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 86.263743] nix-grpc-daemon[878]: time=2026-09-22T15:04:37.486Z level=INFO msg="All 1 paths already cached" worker1 # [ 86.266891] nix-grpc-daemon[783]: ts=2026-09-22T15:04:37Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 86.273336] nix-grpc-daemon[783]: ts=2026-09-22T15:04:37Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 86.279082] nix-grpc-daemon[783]: ts=2026-09-22T15:04:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 86.290962] nix-grpc-daemon[783]: ts=2026-09-22T15:04:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60898 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 86.309202] nix-grpc-daemon[783]: ts=2026-09-22T15:04:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 86.320379] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 86.336476] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5) worker1 # [ 86.352942] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 2/5) worker1 # [ 86.369455] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 3/5) lb # [ 86.525243] envoy[916]: conn peer=[2001:db8:1::1]:57134 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1197 ms=4806 lb # [ 86.528909] envoy[916]: conn peer=[2001:db8:1::1]:57150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3429 tx=1940 ms=1471 lb # [ 86.532470] envoy[916]: conn peer=[2001:db8:1::1]:57156 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=57 lb # [ 86.535905] envoy[916]: conn peer=[2001:db8:1::1]:57164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=2138 ms=1690 lb # [ 86.539414] envoy[916]: conn peer=[2001:db8:1::1]:57172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=57 lb # [ 86.543677] envoy[916]: conn peer=[2001:db8:1::1]:57180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4299 tx=2395 ms=1448 lb # [ 86.547286] envoy[916]: conn peer=[2001:db8:1::1]:52096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=56 lb # [ 86.550810] envoy[916]: conn peer=[2001:db8:1::1]:52110 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3864 tx=2042 ms=1702 lb # [ 86.554291] envoy[916]: conn peer=[2001:db8:1::1]:52126 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=14 worker1 # [ 86.711899] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 630 ms (attempt 4/5) worker1 # [ 87.345790] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 87.349405] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 87.354648] nix-grpc-daemon[783]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 87.474820] nix-daemon[865]: accepted connection from pid 1332, user nix-grpc-daemon (trusted) worker1 # [ 87.489768] nix-daemon[865]: reaped child process 1335, status = succeeded worker1 # [ 87.574580] nix-daemon[865]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker1 # [ 87.592102] nix-daemon[865]: reaped child process 1340, status = succeeded lb # [ 87.603737] niks3-server[990]: 2026/09/22 15:04:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 87.606863] nix-grpc-daemon[880]: time=2026-09-22T15:04:38.947Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 87.608322] nix-grpc-daemon[880]: time=2026-09-22T15:04:38.947Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 87.628258] niks3-server[990]: 2026/09/22 15:04:38 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 87.646148] niks3-server[990]: 2026/09/22 15:04:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 87.651155] niks3-server[990]: 2026/09/22 15:04:38 INFO Signed narinfos id=31 count=1 worker1 # [ 87.648853] nix-grpc-daemon[880]: time=2026-09-22T15:04:38.990Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.658393] niks3-server[990]: 2026/09/22 15:04:38 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 87.670055] niks3-server[990]: 2026/09/22 15:04:38 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 87.677118] niks3-server[990]: 2026/09/22 15:04:38 INFO Completed upload id=31 worker1 # [ 87.671929] nix-grpc-daemon[880]: time=2026-09-22T15:04:39.013Z level=INFO msg="Upload complete. (298ms)" lb # [ 87.680309] niks3-server[990]: 2026/09/22 15:04:39 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 87.676394] nix-grpc-daemon[783]: ts=2026-09-22T15:04:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=1 paths=1 nar_bytes_in=560 worker1 # [ 87.681535] nix-grpc-daemon[783]: ts=2026-09-22T15:04:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 87.691434] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker1 # [ 87.700099] nix-daemon[865]: reaped child process 1325, status = succeeded client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 87.703080] nix-daemon[865]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 88.718981] nix-daemon[865]: reaped child process 1344, status = succeeded worker1 # [ 88.801859] nix-daemon[865]: accepted connection from pid 1360, user nix-grpc-daemon (trusted) worker1 # [ 88.817333] nix-daemon[865]: reaped child process 1363, status = succeeded lb # [ 88.828812] niks3-server[990]: 2026/09/22 15:04:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 88.827843] nix-grpc-daemon[880]: time=2026-09-22T15:04:40.169Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 88.844063] niks3-server[990]: 2026/09/22 15:04:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 88.847061] niks3-server[990]: 2026/09/22 15:04:40 INFO Signed narinfos id=32 count=1 worker1 # [ 88.843146] nix-grpc-daemon[880]: time=2026-09-22T15:04:40.184Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.849217] niks3-server[990]: 2026/09/22 15:04:40 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 88.853141] niks3-server[990]: 2026/09/22 15:04:40 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 88.858373] niks3-server[990]: 2026/09/22 15:04:40 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 88.861348] niks3-server[990]: 2026/09/22 15:04:40 INFO Completed upload id=32 worker1 # [ 88.855938] nix-grpc-daemon[880]: time=2026-09-22T15:04:40.197Z level=INFO msg="Upload complete. (145ms)" lb # [ 88.863388] niks3-server[990]: 2026/09/22 15:04:40 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker1 # [ 88.858634] nix-grpc-daemon[783]: ts=2026-09-22T15:04:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 client # copying 1 paths... worker1 # [ 88.866936] nix-daemon[865]: reaped child process 1342, status = succeeded worker2 # [ 88.874365] nix-grpc-daemon[782]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 88.880388] nix-grpc-daemon[782]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 88.893344] nix-grpc-daemon[783]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 88.895592] nix-grpc-daemon[783]: ts=2026-09-22T15:04:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_out=120 client # [ 89.019650] nix-daemon[1114]: reaped child process 1222, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.96 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 89.118528] nix-daemon[1114]: accepted connection from pid 1241, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 89.215197] nix-grpc-daemon[783]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60898 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 89.225467] nix-grpc-daemon[782]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 89.231362] nix-grpc-daemon[878]: time=2026-09-22T15:04:40.454Z level=INFO msg="All 1 paths already cached" worker1 # [ 89.235282] nix-grpc-daemon[783]: ts=2026-09-22T15:04:40Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 89.249166] nix-grpc-daemon[782]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker1 # [ 89.240094] nix-grpc-daemon[783]: ts=2026-09-22T15:04:40Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 89.257393] nix-grpc-daemon[782]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 89.265487] nix-grpc-daemon[878]: time=2026-09-22T15:04:40.489Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 89.270213] nix-grpc-daemon[782]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 89.276807] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 89.373836] nix-daemon[850]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker2 # [ 89.388979] nix-daemon[850]: reaped child process 1151, status = succeeded worker2 # [ 89.479955] nix-daemon[850]: accepted connection from pid 1153, user nix-grpc-daemon (trusted) worker2 # [ 89.494602] nix-daemon[850]: reaped child process 1156, status = succeeded lb # [ 89.500865] niks3-server[990]: 2026/09/22 15:04:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.511891] nix-grpc-daemon[878]: time=2026-09-22T15:04:40.735Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 89.513287] nix-grpc-daemon[878]: time=2026-09-22T15:04:40.735Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 89.529530] niks3-server[990]: 2026/09/22 15:04:40 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 89.539332] niks3-server[990]: 2026/09/22 15:04:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 89.546567] niks3-server[990]: 2026/09/22 15:04:40 INFO Signed narinfos id=33 count=1 worker2 # [ 89.551775] nix-grpc-daemon[878]: time=2026-09-22T15:04:40.775Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.551930] niks3-server[990]: 2026/09/22 15:04:40 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 89.564777] niks3-server[990]: 2026/09/22 15:04:40 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 89.571380] niks3-server[990]: 2026/09/22 15:04:40 INFO Completed upload id=33 worker2 # [ 89.575324] nix-grpc-daemon[878]: time=2026-09-22T15:04:40.799Z level=INFO msg="Upload complete. (292ms)" lb # [ 89.573576] niks3-server[990]: 2026/09/22 15:04:40 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 89.577836] nix-grpc-daemon[782]: ts=2026-09-22T15:04:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=0 paths=1 nar_bytes_in=560 worker2 # [ 89.581269] nix-grpc-daemon[782]: ts=2026-09-22T15:04:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 worker2 # [ 89.587146] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 89.595332] nix-daemon[850]: reaped child process 1146, status = succeeded worker2 # [ 89.597966] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 90.633499] nix-daemon[850]: reaped child process 1160, status = succeeded worker2 # [ 90.722887] nix-daemon[850]: accepted connection from pid 1176, user nix-grpc-daemon (trusted) worker2 # [ 90.738804] nix-daemon[850]: reaped child process 1179, status = succeeded lb # [ 90.742844] niks3-server[990]: 2026/09/22 15:04:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.755259] nix-grpc-daemon[878]: time=2026-09-22T15:04:41.978Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 90.776191] niks3-server[990]: 2026/09/22 15:04:42 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 90.784751] niks3-server[990]: 2026/09/22 15:04:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 90.791645] niks3-server[990]: 2026/09/22 15:04:42 INFO Signed narinfos id=34 count=1 worker2 # [ 90.797033] nix-grpc-daemon[878]: time=2026-09-22T15:04:42.020Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.798245] niks3-server[990]: 2026/09/22 15:04:42 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 90.815972] niks3-server[990]: 2026/09/22 15:04:42 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 90.822202] niks3-server[990]: 2026/09/22 15:04:42 INFO Completed upload id=34 worker2 # [ 90.824054] nix-grpc-daemon[878]: time=2026-09-22T15:04:42.047Z level=INFO msg="Upload complete. (217ms)" lb # [ 90.823946] niks3-server[990]: 2026/09/22 15:04:42 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 90.829776] nix-grpc-daemon[782]: ts=2026-09-22T15:04:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39548 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker2 # [ 90.844981] nix-daemon[850]: reaped child process 1158, status = succeeded client # copying 1 paths... worker2 # [ 90.877389] nix-grpc-daemon[782]: ts=2026-09-22T15:04:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39548 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 90.892534] nix-grpc-daemon[783]: ts=2026-09-22T15:04:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 90.903927] nix-grpc-daemon[783]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... worker1 # [ 90.917777] nix-grpc-daemon[783]: ts=2026-09-22T15:04:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60898 duration_s=0 paths=1 nar_bytes_out=120 client # [ 90.998548] nix-daemon[1114]: reaped child process 1244, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.98 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.39 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.22 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.12 seconds) worker2 # [ 91.711310] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 91.777149] nix-grpc-daemon[782]: ts=2026-09-22T15:04:43Z level=info event=signal_exit worker1 # [ 92.946419] nix-grpc-daemon[783]: ts=2026-09-22T15:04:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60894 worker2 # [ 92.948925] nix-grpc-daemon[782]: ts=2026-09-22T15:04:44Z level=info event=scheduler_restarting worker1 # [ 92.947999] nix-grpc-daemon[783]: ts=2026-09-22T15:04:44Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 92.966496] nix-grpc-daemon[782]: ts=2026-09-22T15:04:44Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 92.985981] nix-daemon[850]: reaped child process 852, status = succeeded worker2 # [ 93.907840] nix-grpc-daemon[782]: E0000 00:00:1790089485.131286 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker2 # [ 93.913065] nix-grpc-daemon[782]: E0000 00:00:1790089485.131493 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 94.171871] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 94.174634] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 94.178146] systemd[1]: nix-grpc-daemon.service: Consumed 2.319s CPU time over 1min 17.561s wall clock time, 60.2M memory peak, 79.9K incoming IP traffic, 195.2K outgoing IP traffic. worker2 # [ 94.190883] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 94.195239] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 94.198387] systemd[1]: nix-grpc-daemon.socket: Consumed 312us CPU time over 1min 26.695s wall clock time, 256K memory peak, 90.5K incoming IP traffic, 81.5K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 94.357917] nix-grpc-daemon[783]: ts=2026-09-22T15:04:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60898 worker1 # [ 94.364388] nix-grpc-daemon[783]: ts=2026-09-22T15:04:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60898 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.14 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 94.454117] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 94.491941] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 94.721615] nix-grpc-daemon[783]: ts=2026-09-22T15:04:46Z level=info event=signal_exit lb # [ 94.949936] niks3-server[990]: 2026/09/22 15:04:46 INFO lead: released remote=192.168.1.3:48494 worker2 # [ 95.165527] systemd[1]: Starting scheduler-token.service... worker2 # [ 95.221775] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 95.224970] systemd[1]: Finished scheduler-token.service. worker2 # [ 95.227675] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 58ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 95.235921] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 95.313140] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 95.315109] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 95.318327] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 95.322620] nix-grpc-daemon[1203]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 95.323995] nix-grpc-daemon[1203]: E0000 00:00:1790089486.546189 1203 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 95.330062] nix-grpc-daemon[1203]: E0000 00:00:1790089486.551563 1203 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 95.332195] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 95.333779] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 95.340061] nix-grpc-daemon[1203]: E0000 00:00:1790089486.563694 1244 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 95.343880] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=scheduler_take_over lb # [ 95.340321] niks3-server[990]: 2026/09/22 15:04:46 INFO lead: acquired remote=192.168.1.4:36764 worker2 # [ 95.355853] nix-grpc-daemon[1203]: E0000 00:00:1790089486.579585 1244 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 95.360055] nix-grpc-daemon[1203]: E0000 00:00:1790089486.581896 1244 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 95.369768] nix-grpc-daemon[1203]: E0000 00:00:1790089486.593488 1244 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 95.378547] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.379970] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.581351] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.585215] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.786885] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.790555] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.942734] nix-grpc-daemon[783]: ts=2026-09-22T15:04:47Z level=info event=scheduler_restarting worker1 # [ 95.947251] nix-grpc-daemon[783]: ts=2026-09-22T15:04:47Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 95.948950] nix-grpc-daemon[783]: ts=2026-09-22T15:04:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60894 worker1 # [ 95.950751] nix-grpc-daemon[783]: ts=2026-09-22T15:04:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 95.966635] nix-daemon[865]: reaped child process 867, status = succeeded worker2 # [ 95.991100] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.992904] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.160718] nix-grpc-daemon[783]: ts=2026-09-22T15:04:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 96.193715] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.195542] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.396434] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.402883] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 96.404321] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:33150 worker2 # [ 96.405927] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 96.525752] envoy[916]: conn peer=[2001:db8:1::1]:52132 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3728 tx=2121 ms=2702 lb # [ 96.529444] envoy[916]: conn peer=[2001:db8:1::1]:52148 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=53 lb # [ 96.532833] envoy[916]: conn peer=[2001:db8:1::1]:52150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3742 tx=2100 ms=1714 lb # [ 96.536311] envoy[916]: conn peer=[2001:db8:1::1]:52158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=329 ms=39 lb # [ 96.539640] envoy[916]: conn peer=[2001:db8:1::4]:48558 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=63529 tx=3226 ms=76164 lb # [ 96.543259] envoy[916]: conn peer=[2001:db8:1::1]:48316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=19 lb # [ 96.547445] envoy[916]: conn peer=[2001:db8:1::3]:47162 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17179 tx=3499 ms=79408 worker1 # [ 96.860463] nix-grpc-daemon[783]: E0000 00:00:1790089488.200910 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker1 # [ 96.865330] nix-grpc-daemon[783]: E0000 00:00:1790089488.201897 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 98.123810] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 98.126380] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 98.127377] systemd[1]: nix-grpc-daemon.service: Consumed 3.249s CPU time over 1min 21.606s wall clock time, 70.6M memory peak, 114K incoming IP traffic, 248.3K outgoing IP traffic. worker1 # [ 98.132631] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 98.134563] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 98.136120] systemd[1]: nix-grpc-daemon.socket: Consumed 323us CPU time over 1min 29.702s wall clock time, 256K memory peak, 122.2K incoming IP traffic, 103.5K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 98.337358] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 98.348310] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 98.367131] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 1/5) worker2 # [ 98.440585] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 2/5) worker2 # [ 98.472989] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 331 ms (attempt 3/5) worker2 # [ 98.811778] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 364 ms (attempt 4/5) worker2 # [ 99.184341] nix-grpc-daemon[1203]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 99.187280] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 99.207780] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 99.217691] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 99.240551] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:50Z level=info event=niks3_push_started pid=1263 worker2 # [ 99.343026] nix-grpc-daemon[1263]: time=2026-09-22T15:04:50.566Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 99.431191] nix-daemon[850]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 99.443725] nix-daemon[850]: reaped child process 1278, status = succeeded lb # [ 99.448507] niks3-server[990]: 2026/09/22 15:04:50 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 99.460662] niks3-server[990]: 2026/09/22 15:04:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.470369] nix-grpc-daemon[1263]: time=2026-09-22T15:04:50.694Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 99.471986] nix-grpc-daemon[1263]: time=2026-09-22T15:04:50.695Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 99.474602] nix-grpc-daemon[1263]: time=2026-09-22T15:04:50.695Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 99.502927] niks3-server[990]: 2026/09/22 15:04:50 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 99.521107] niks3-server[990]: 2026/09/22 15:04:50 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 99.530045] niks3-server[990]: 2026/09/22 15:04:50 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 99.536062] niks3-server[990]: 2026/09/22 15:04:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 99.540047] niks3-server[990]: 2026/09/22 15:04:50 INFO Signed narinfos id=35 count=1 lb # [ 99.541229] niks3-server[990]: 2026/09/22 15:04:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 99.543529] niks3-server[990]: 2026/09/22 15:04:50 INFO Signed narinfos id=36 count=2 worker2 # [ 99.546129] nix-grpc-daemon[1263]: time=2026-09-22T15:04:50.769Z level=INFO msg="Uploading 3 narinfos" lb # [ 99.551257] niks3-server[990]: 2026/09/22 15:04:50 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 99.562493] niks3-server[990]: 2026/09/22 15:04:50 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 99.565061] niks3-server[990]: 2026/09/22 15:04:50 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 99.569091] niks3-server[990]: 2026/09/22 15:04:50 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 99.575656] niks3-server[990]: 2026/09/22 15:04:50 INFO Completed upload id=35 lb # [ 99.577163] niks3-server[990]: 2026/09/22 15:04:50 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 99.579730] niks3-server[990]: 2026/09/22 15:04:50 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 99.582710] niks3-server[990]: 2026/09/22 15:04:50 INFO Completed upload id=36 worker2 # [ 99.585104] nix-grpc-daemon[1263]: time=2026-09-22T15:04:50.808Z level=INFO msg="Upload complete. (238ms)" worker2 # [ 99.590825] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 99.604338] nix-daemon[850]: reaped child process 1261, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.42 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 99.678716] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 99.685914] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 99.780269] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 99.785055] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 99.789189] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 99.793258] nix-grpc-daemon[1389]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 99.795553] nix-grpc-daemon[1389]: E0000 00:00:1790089491.129180 1389 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 99.800099] nix-grpc-daemon[1389]: E0000 00:00:1790089491.133286 1389 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 99.804520] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 99.807053] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 99.809102] nix-grpc-daemon[1389]: E0000 00:00:1790089491.149808 1431 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 99.821836] nix-grpc-daemon[1389]: E0000 00:00:1790089491.163281 1431 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 99.825174] nix-grpc-daemon[1389]: E0000 00:00:1790089491.165563 1431 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 99.837232] nix-grpc-daemon[1389]: E0000 00:00:1790089491.178699 1431 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 99.851277] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 99.859932] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:33150 worker2 # [ 99.864702] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.08 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.91 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 100.968220] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:52Z level=info event=scheduler_lock_lost status=200 lb # [ 100.965672] niks3-server[990]: 2026/09/22 15:04:52 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 100.968326] niks3-server[990]: 2026/09/22 15:04:52 INFO lead: released remote=192.168.1.4:36764 worker1 # [ 100.961623] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:52Z level=info event=scheduler_lock_lost status=200 lb # [ 100.972096] systemd[1]: Stopping niks3 server... lb # [ 100.981934] systemd[1]: niks3.service: Deactivated successfully. lb # [ 100.983519] systemd[1]: Stopped niks3 server. lb # [ 100.985070] systemd[1]: niks3.service: Consumed 637ms CPU time over 1min 20.267s wall clock time, 28.7M memory peak, 99.5K incoming IP traffic, 141.4K outgoing IP traffic. lb # [ 100.991750] systemd[1]: Starting niks3 server... lb # [ 101.039813] niks3-server[1129]: 2026/09/22 15:04:52 goose: no migrations to run. current version: 20260920000000 lb # [ 101.045732] niks3-server[1129]: 2026/09/22 15:04:52 OK 1_commit_pending_closure.sql (4.1ms) lb # [ 101.049188] niks3-server[1129]: 2026/09/22 15:04:52 OK 2_object_stats_trigger.sql (1.9ms) lb # [ 101.050230] niks3-server[1129]: 2026/09/22 15:04:52 goose: up to current file version: 2 lb # [ 101.051421] niks3-server[1129]: 2026/09/22 15:04:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 101.061753] niks3-server[1129]: 2026/09/22 15:04:52 INFO Read proxy enabled — serving cache objects from S3 lb # [ 101.063171] niks3-server[1129]: 2026/09/22 15:04:52 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 101.065313] systemd[1]: Started niks3 server. lb # [ 101.067326] niks3-server[1129]: 2026/09/22 15:04:52 INFO systemd watchdog enabled interval=15s lb # [ 101.068732] niks3-server[1129]: 2026/09/22 15:04:52 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 101.371181] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 101.383695] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 101.398511] nix-grpc-daemon[1389]: ts=2026-09-22T15:04:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 101.409123] nix-grpc-daemon[1389]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 1/5) worker1 # [ 101.423144] nix-grpc-daemon[1389]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5) worker1 # [ 101.489650] nix-grpc-daemon[1389]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 379 ms (attempt 3/5) worker1 # [ 101.870982] nix-grpc-daemon[1389]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 270 ms (attempt 4/5) lb # [ 101.972513] niks3-server[1129]: 2026/09/22 15:04:53 INFO lead: acquired remote=192.168.1.4:36802 worker1 # [ 102.143931] nix-grpc-daemon[1389]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 102.148084] nix-grpc-daemon[1389]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 102.195362] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:53Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 102.199573] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:53Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 102.238599] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 102.252942] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33158 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 102.265551] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 102.277625] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 102.376293] nix-daemon[850]: accepted connection from pid 1297, user nix-grpc-daemon (trusted) worker2 # [ 102.392757] nix-daemon[850]: reaped child process 1300, status = succeeded worker2 # [ 102.480381] nix-daemon[850]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 102.496559] nix-daemon[850]: reaped child process 1305, status = succeeded lb # [ 102.499842] niks3-server[1129]: 2026/09/22 15:04:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.514890] nix-grpc-daemon[1263]: time=2026-09-22T15:04:53.738Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 102.516386] nix-grpc-daemon[1263]: time=2026-09-22T15:04:53.738Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 102.537199] niks3-server[1129]: 2026/09/22 15:04:53 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 102.545221] niks3-server[1129]: 2026/09/22 15:04:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 102.565380] niks3-server[1129]: 2026/09/22 15:04:53 INFO Signed narinfos id=37 count=1 worker2 # [ 102.569345] nix-grpc-daemon[1263]: time=2026-09-22T15:04:53.792Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.576636] niks3-server[1129]: 2026/09/22 15:04:53 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 102.578274] niks3-server[1129]: 2026/09/22 15:04:53 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 102.584882] niks3-server[1129]: 2026/09/22 15:04:53 INFO Completed upload id=37 worker2 # [ 102.586929] nix-grpc-daemon[1263]: time=2026-09-22T15:04:53.810Z level=INFO msg="Upload complete. (303ms)" lb # [ 102.587270] niks3-server[1129]: 2026/09/22 15:04:53 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker2 # [ 102.589418] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 102.593811] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 102.601277] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 102.603892] nix-daemon[850]: reaped child process 1295, status = succeeded worker2 # [ 102.609387] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 103.251905] nix-daemon[850]: reaped child process 1309, status = succeeded worker2 # [ 103.333644] nix-daemon[850]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker2 # [ 103.349848] nix-daemon[850]: reaped child process 1328, status = succeeded lb # [ 103.352641] niks3-server[1129]: 2026/09/22 15:04:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 103.364911] nix-grpc-daemon[1263]: time=2026-09-22T15:04:54.588Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 103.368206] nix-grpc-daemon[1263]: time=2026-09-22T15:04:54.590Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 103.399253] niks3-server[1129]: 2026/09/22 15:04:54 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 103.405949] niks3-server[1129]: 2026/09/22 15:04:54 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 103.414582] niks3-server[1129]: 2026/09/22 15:04:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 103.423358] niks3-server[1129]: 2026/09/22 15:04:54 INFO Signed narinfos id=38 count=1 worker2 # [ 103.426275] nix-grpc-daemon[1263]: time=2026-09-22T15:04:54.649Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.432267] niks3-server[1129]: 2026/09/22 15:04:54 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 103.440541] niks3-server[1129]: 2026/09/22 15:04:54 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 103.447987] niks3-server[1129]: 2026/09/22 15:04:54 INFO Completed upload id=38 worker2 # [ 103.450363] nix-grpc-daemon[1263]: time=2026-09-22T15:04:54.674Z level=INFO msg="Upload complete. (233ms)" lb # [ 103.450042] niks3-server[1129]: 2026/09/22 15:04:54 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 103.457719] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 duration_s=0 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 103.474122] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:54Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 103.477302] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:54Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 103.487808] nix-daemon[850]: reaped child process 1307, status = succeeded worker2 # [ 103.516769] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 103.529093] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 103.543460] nix-grpc-daemon[1263]: time=2026-09-22T15:04:54.766Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 103.552145] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 103.562132] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 103.662858] nix-daemon[850]: accepted connection from pid 1334, user nix-grpc-daemon (trusted) worker2 # [ 103.678651] nix-daemon[850]: reaped child process 1337, status = succeeded worker2 # [ 103.764524] nix-daemon[850]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 103.779074] nix-daemon[850]: reaped child process 1342, status = succeeded lb # [ 103.784135] niks3-server[1129]: 2026/09/22 15:04:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 103.791690] nix-grpc-daemon[1263]: time=2026-09-22T15:04:55.015Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 103.793711] nix-grpc-daemon[1263]: time=2026-09-22T15:04:55.017Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 103.801423] niks3-server[1129]: 2026/09/22 15:04:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 103.806828] niks3-server[1129]: 2026/09/22 15:04:55 INFO Signed narinfos id=39 count=1 worker2 # [ 103.808997] nix-grpc-daemon[1263]: time=2026-09-22T15:04:55.032Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.809041] niks3-server[1129]: 2026/09/22 15:04:55 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 103.821201] niks3-server[1129]: 2026/09/22 15:04:55 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 103.824952] niks3-server[1129]: 2026/09/22 15:04:55 INFO Completed upload id=39 worker2 # [ 103.828319] nix-grpc-daemon[1263]: time=2026-09-22T15:04:55.052Z level=INFO msg="Upload complete. (256ms)" lb # [ 103.827941] niks3-server[1129]: 2026/09/22 15:04:55 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 103.830636] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 duration_s=0 paths=1 nar_bytes_in=656 lb # [ 103.831334] niks3-server[1129]: 2026/09/22 15:04:55 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls worker2 # [ 103.837575] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 103.842739] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 103.845314] nix-daemon[850]: reaped child process 1332, status = succeeded worker2 # [ 103.850865] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 104.894329] nix-daemon[850]: reaped child process 1346, status = succeeded worker2 # [ 104.964888] nix-daemon[850]: accepted connection from pid 1363, user nix-grpc-daemon (trusted) worker2 # [ 104.980490] nix-daemon[850]: reaped child process 1366, status = succeeded lb # [ 104.985427] niks3-server[1129]: 2026/09/22 15:04:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 104.997038] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.220Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 104.998707] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.222Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 105.029906] niks3-server[1129]: 2026/09/22 15:04:56 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 105.037306] niks3-server[1129]: 2026/09/22 15:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 105.045865] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.269Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.043540] niks3-server[1129]: 2026/09/22 15:04:56 INFO Signed narinfos id=40 count=1 lb # [ 105.055964] niks3-server[1129]: 2026/09/22 15:04:56 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 105.058379] niks3-server[1129]: 2026/09/22 15:04:56 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 105.062069] niks3-server[1129]: 2026/09/22 15:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 105.065655] niks3-server[1129]: 2026/09/22 15:04:56 INFO Completed upload id=40 worker2 # [ 105.067823] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.291Z level=INFO msg="Upload complete. (208ms)" lb # [ 105.068652] niks3-server[1129]: 2026/09/22 15:04:56 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 105.077420] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 105.084779] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 105.088939] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 105.099273] nix-daemon[850]: reaped child process 1344, status = succeeded worker2 # [ 105.128761] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 105.140967] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 105.156152] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.379Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 105.165300] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 105.173571] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 105.275984] nix-daemon[850]: accepted connection from pid 1372, user nix-grpc-daemon (trusted) worker2 # [ 105.291694] nix-daemon[850]: reaped child process 1375, status = succeeded worker2 # [ 105.381242] nix-daemon[850]: accepted connection from pid 1377, user nix-grpc-daemon (trusted) worker2 # [ 105.396779] nix-daemon[850]: reaped child process 1380, status = succeeded lb # [ 105.400239] niks3-server[1129]: 2026/09/22 15:04:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 105.413862] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.637Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 105.415811] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.639Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 105.430794] niks3-server[1129]: 2026/09/22 15:04:56 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 105.441536] niks3-server[1129]: 2026/09/22 15:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker2 # [ 105.449586] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.673Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.447687] niks3-server[1129]: 2026/09/22 15:04:56 INFO Signed narinfos id=41 count=1 lb # [ 105.455164] niks3-server[1129]: 2026/09/22 15:04:56 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 105.464561] niks3-server[1129]: 2026/09/22 15:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 105.469120] niks3-server[1129]: 2026/09/22 15:04:56 INFO Completed upload id=41 worker2 # [ 105.470787] nix-grpc-daemon[1263]: time=2026-09-22T15:04:56.694Z level=INFO msg="Upload complete. (284ms)" lb # [ 105.470779] niks3-server[1129]: 2026/09/22 15:04:56 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 105.475155] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33158 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 105.480440] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 worker2 # [ 105.488250] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 105.492107] nix-daemon[850]: reaped child process 1370, status = succeeded worker2 # [ 105.495982] nix-daemon[850]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 106.526821] envoy[916]: conn peer=[2001:db8:1::1]:48322 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=282 ms=1266 client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 106.710802] nix-daemon[850]: reaped child process 1384, status = succeeded worker2 # [ 106.785379] nix-daemon[850]: accepted connection from pid 1400, user nix-grpc-daemon (trusted) worker2 # [ 106.799191] nix-daemon[850]: reaped child process 1403, status = succeeded lb # [ 106.803608] niks3-server[1129]: 2026/09/22 15:04:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 106.817968] nix-grpc-daemon[1263]: time=2026-09-22T15:04:58.041Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 106.819460] nix-grpc-daemon[1263]: time=2026-09-22T15:04:58.043Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 106.845111] niks3-server[1129]: 2026/09/22 15:04:58 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 106.854648] niks3-server[1129]: 2026/09/22 15:04:58 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 106.866709] niks3-server[1129]: 2026/09/22 15:04:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 106.872235] niks3-server[1129]: 2026/09/22 15:04:58 INFO Signed narinfos id=42 count=1 worker2 # [ 106.877507] nix-grpc-daemon[1263]: time=2026-09-22T15:04:58.100Z level=INFO msg="Uploading 1 narinfos" lb # [ 106.882791] niks3-server[1129]: 2026/09/22 15:04:58 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 106.889775] niks3-server[1129]: 2026/09/22 15:04:58 INFO Completed upload id=42 worker2 # [ 106.891893] nix-grpc-daemon[1263]: time=2026-09-22T15:04:58.115Z level=INFO msg="Upload complete. (189ms)" lb # [ 106.891403] niks3-server[1129]: 2026/09/22 15:04:58 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 106.894506] niks3-server[1129]: 2026/09/22 15:04:58 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 106.898275] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33158 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 106.913917] nix-daemon[850]: reaped child process 1382, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.70 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.11 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.14 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 107.200563] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 107.333388] nix-grpc-daemon[1203]: ts=2026-09-22T15:04:58Z level=info event=signal_exit lb # [ 107.977067] niks3-server[1129]: 2026/09/22 15:04:59 INFO lead: released remote=192.168.1.4:36802 worker1 # [ 108.973180] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:00Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 108.983448] nix-grpc-daemon[1203]: ts=2026-09-22T15:05:00Z level=info event=scheduler_restarting worker2 # [ 108.987324] nix-grpc-daemon[1203]: ts=2026-09-22T15:05:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33150 worker2 # [ 108.991475] nix-grpc-daemon[1203]: ts=2026-09-22T15:05:00Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 108.994938] nix-grpc-daemon[1203]: ts=2026-09-22T15:05:00Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 108.998295] nix-grpc-daemon[1203]: ts=2026-09-22T15:05:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33150 worker2 # [ 109.001909] nix-grpc-daemon[1203]: ts=2026-09-22T15:05:00Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 109.022887] nix-daemon[850]: reaped child process 1255, status = succeeded worker1 # [ 109.172905] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.177136] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.193681] nix-grpc-daemon[1203]: ts=2026-09-22T15:05:00Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 109.376410] nix-grpc-daemon[1203]: E0000 00:00:1790089500.600049 1248 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 109.378623] nix-grpc-daemon[1203]: E0000 00:00:1790089500.600142 1248 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 109.379148] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.382359] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.580187] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.584352] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.784888] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.787208] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.988221] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.990042] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.190478] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.192294] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.393187] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.395366] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.596138] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.597946] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.798878] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.802988] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.005379] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.008658] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.196283] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 111.200132] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 111.204276] systemd[1]: nix-grpc-daemon.service: Consumed 1.124s CPU time over 15.963s wall clock time, 42.4M memory peak, 45.1K incoming IP traffic, 82.8K outgoing IP traffic. worker1 # [ 111.206367] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.215422] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 111.219453] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 111.210850] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.223360] systemd[1]: nix-grpc-daemon.socket: Consumed 308us CPU time over 16.767s wall clock time, 256K memory peak, 36.9K incoming IP traffic, 27.1K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 111.411786] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.415810] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.617188] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.621287] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.822239] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.826354] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 111.973398] niks3-server[1129]: 2026/09/22 15:05:03 INFO lead: acquired remote=192.168.1.3:48158 worker1 # [ 111.967831] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=scheduler_take_over worker1 # [ 112.028562] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.031627] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.229752] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.237175] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:41984 worker1 # [ 112.240846] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker1 # [ 112.482728] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43240 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 112.491791] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 112.514556] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 112.519619] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 112.557851] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 112.568435] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43240 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 112.578656] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 112.587907] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 112.610138] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:03Z level=info event=niks3_push_started pid=1465 worker1 # [ 112.716867] nix-grpc-daemon[1465]: time=2026-09-22T15:05:04.057Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 112.808887] nix-daemon[865]: accepted connection from pid 1478, user nix-grpc-daemon (trusted) worker1 # [ 112.823344] nix-daemon[865]: reaped child process 1481, status = succeeded worker1 # [ 112.914130] nix-daemon[865]: accepted connection from pid 1483, user nix-grpc-daemon (trusted) worker1 # [ 112.928770] nix-daemon[865]: reaped child process 1486, status = succeeded lb # [ 112.941120] niks3-server[1129]: 2026/09/22 15:05:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.944493] nix-grpc-daemon[1465]: time=2026-09-22T15:05:04.286Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 112.946026] nix-grpc-daemon[1465]: time=2026-09-22T15:05:04.287Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 112.981526] niks3-server[1129]: 2026/09/22 15:05:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 112.992260] niks3-server[1129]: 2026/09/22 15:05:04 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 113.002908] niks3-server[1129]: 2026/09/22 15:05:04 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 113.012943] niks3-server[1129]: 2026/09/22 15:05:04 INFO Signed narinfos id=43 count=1 worker1 # [ 113.008191] nix-grpc-daemon[1465]: time=2026-09-22T15:05:04.349Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.022604] niks3-server[1129]: 2026/09/22 15:05:04 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 113.031255] niks3-server[1129]: 2026/09/22 15:05:04 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo lb # [ 113.034791] niks3-server[1129]: 2026/09/22 15:05:04 INFO Completed upload id=43 worker1 # [ 113.029830] nix-grpc-daemon[1465]: time=2026-09-22T15:05:04.371Z level=INFO msg="Upload complete. (313ms)" worker1 # [ 113.035772] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 113.042431] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 113.053281] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 113.065103] nix-daemon[865]: reaped child process 1463, status = succeeded client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker1 # [ 113.067432] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 114.283731] nix-daemon[865]: reaped child process 1490, status = succeeded worker1 # [ 114.364323] nix-daemon[865]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 114.376391] nix-daemon[865]: reaped child process 1510, status = succeeded lb # [ 114.390705] niks3-server[1129]: 2026/09/22 15:05:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.395788] nix-grpc-daemon[1465]: time=2026-09-22T15:05:05.737Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 114.399057] nix-grpc-daemon[1465]: time=2026-09-22T15:05:05.738Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 114.426226] niks3-server[1129]: 2026/09/22 15:05:05 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 114.442672] niks3-server[1129]: 2026/09/22 15:05:05 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 114.455825] niks3-server[1129]: 2026/09/22 15:05:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 114.455226] nix-grpc-daemon[1465]: time=2026-09-22T15:05:05.796Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.460483] niks3-server[1129]: 2026/09/22 15:05:05 INFO Signed narinfos id=44 count=1 lb # [ 114.465495] niks3-server[1129]: 2026/09/22 15:05:05 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 114.474228] niks3-server[1129]: 2026/09/22 15:05:05 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 114.476969] niks3-server[1129]: 2026/09/22 15:05:05 INFO Completed upload id=44 worker1 # [ 114.473154] nix-grpc-daemon[1465]: time=2026-09-22T15:05:05.814Z level=INFO msg="Upload complete. (198ms)" lb # [ 114.480460] niks3-server[1129]: 2026/09/22 15:05:05 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker1 # [ 114.476083] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker1 # [ 114.484157] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:05Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 114.486238] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:05Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 114.490970] nix-daemon[865]: reaped child process 1488, status = succeeded worker1 # [ 114.527444] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 114.536148] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 114.545790] nix-grpc-daemon[1465]: time=2026-09-22T15:05:05.887Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 114.551483] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 114.556207] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 114.645221] nix-daemon[865]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker1 # [ 114.658806] nix-daemon[865]: reaped child process 1519, status = succeeded worker1 # [ 114.747257] nix-daemon[865]: accepted connection from pid 1521, user nix-grpc-daemon (trusted) worker1 # [ 114.761310] nix-daemon[865]: reaped child process 1524, status = succeeded lb # [ 114.773757] niks3-server[1129]: 2026/09/22 15:05:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.776817] nix-grpc-daemon[1465]: time=2026-09-22T15:05:06.117Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 114.778155] nix-grpc-daemon[1465]: time=2026-09-22T15:05:06.117Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 114.800334] niks3-server[1129]: 2026/09/22 15:05:06 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 114.809562] niks3-server[1129]: 2026/09/22 15:05:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 114.814367] niks3-server[1129]: 2026/09/22 15:05:06 INFO Signed narinfos id=45 count=1 worker1 # [ 114.812425] nix-grpc-daemon[1465]: time=2026-09-22T15:05:06.153Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.829152] niks3-server[1129]: 2026/09/22 15:05:06 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 114.835900] niks3-server[1129]: 2026/09/22 15:05:06 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls worker1 # [ 114.834666] nix-grpc-daemon[1465]: time=2026-09-22T15:05:06.176Z level=INFO msg="Upload complete. (272ms)" lb # [ 114.840122] niks3-server[1129]: 2026/09/22 15:05:06 INFO Completed upload id=45 worker1 # [ 114.836912] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 114.845717] niks3-server[1129]: 2026/09/22 15:05:06 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 114.844120] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 114.845875] nix-daemon[865]: reaped child process 1514, status = succeeded worker1 # [ 114.849798] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 114.855399] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 116.095745] nix-daemon[865]: reaped child process 1528, status = succeeded worker1 # [ 116.177806] nix-daemon[865]: accepted connection from pid 1544, user nix-grpc-daemon (trusted) worker1 # [ 116.190734] nix-daemon[865]: reaped child process 1547, status = succeeded lb # [ 116.203591] niks3-server[1129]: 2026/09/22 15:05:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 116.207484] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.548Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 116.208983] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.550Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 116.240740] niks3-server[1129]: 2026/09/22 15:05:07 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 116.251667] niks3-server[1129]: 2026/09/22 15:05:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 116.258701] niks3-server[1129]: 2026/09/22 15:05:07 INFO Signed narinfos id=46 count=1 worker1 # [ 116.256448] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.597Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.262097] niks3-server[1129]: 2026/09/22 15:05:07 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 116.268649] niks3-server[1129]: 2026/09/22 15:05:07 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 116.274499] niks3-server[1129]: 2026/09/22 15:05:07 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 116.277498] niks3-server[1129]: 2026/09/22 15:05:07 INFO Completed upload id=46 worker1 # [ 116.272237] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.613Z level=INFO msg="Upload complete. (206ms)" lb # [ 116.279948] niks3-server[1129]: 2026/09/22 15:05:07 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 116.281654] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 116.288915] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:07Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 116.293229] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:07Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 116.303074] nix-daemon[865]: reaped child process 1526, status = succeeded worker1 # [ 116.332980] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 116.344721] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 116.358277] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.699Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 116.367147] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 116.377221] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 116.471548] nix-daemon[865]: accepted connection from pid 1553, user nix-grpc-daemon (trusted) worker1 # [ 116.485465] nix-daemon[865]: reaped child process 1556, status = succeeded lb # [ 116.526994] envoy[916]: conn peer=[2001:db8:1::1]:48328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9722 tx=4423 ms=5543 lb # [ 116.530847] envoy[916]: conn peer=[2001:db8:1::4]:53198 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5880 tx=648 ms=13811 worker1 # [ 116.570467] nix-daemon[865]: accepted connection from pid 1558, user nix-grpc-daemon (trusted) worker1 # [ 116.584043] nix-daemon[865]: reaped child process 1561, status = succeeded lb # [ 116.596531] niks3-server[1129]: 2026/09/22 15:05:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 116.600108] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.941Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 116.601717] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.943Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 116.631675] niks3-server[1129]: 2026/09/22 15:05:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 116.636518] niks3-server[1129]: 2026/09/22 15:05:07 INFO Signed narinfos id=47 count=1 worker1 # [ 116.633785] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.975Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.640191] niks3-server[1129]: 2026/09/22 15:05:07 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 116.650197] niks3-server[1129]: 2026/09/22 15:05:07 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 116.658739] niks3-server[1129]: 2026/09/22 15:05:07 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 116.661512] niks3-server[1129]: 2026/09/22 15:05:07 INFO Completed upload id=47 worker1 # [ 116.656260] nix-grpc-daemon[1465]: time=2026-09-22T15:05:07.997Z level=INFO msg="Upload complete. (269ms)" lb # [ 116.664141] niks3-server[1129]: 2026/09/22 15:05:07 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 116.658837] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 116.663800] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 116.674186] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 116.676150] nix-daemon[865]: reaped child process 1551, status = succeeded worker1 # [ 116.681441] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 117.912134] nix-daemon[865]: reaped child process 1565, status = succeeded worker1 # [ 117.982737] nix-daemon[865]: accepted connection from pid 1581, user nix-grpc-daemon (trusted) worker1 # [ 117.996341] nix-daemon[865]: reaped child process 1584, status = succeeded lb # [ 118.008340] niks3-server[1129]: 2026/09/22 15:05:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 118.011721] nix-grpc-daemon[1465]: time=2026-09-22T15:05:09.353Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 118.014067] nix-grpc-daemon[1465]: time=2026-09-22T15:05:09.354Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 118.051090] niks3-server[1129]: 2026/09/22 15:05:09 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 118.056716] niks3-server[1129]: 2026/09/22 15:05:09 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 118.061715] niks3-server[1129]: 2026/09/22 15:05:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker1 # [ 118.062548] nix-grpc-daemon[1465]: time=2026-09-22T15:05:09.403Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.067459] niks3-server[1129]: 2026/09/22 15:05:09 INFO Signed narinfos id=48 count=1 lb # [ 118.074556] niks3-server[1129]: 2026/09/22 15:05:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 118.082968] niks3-server[1129]: 2026/09/22 15:05:09 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 118.086434] niks3-server[1129]: 2026/09/22 15:05:09 INFO Completed upload id=48 lb # [ 118.087805] niks3-server[1129]: 2026/09/22 15:05:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 118.081336] nix-grpc-daemon[1465]: time=2026-09-22T15:05:09.422Z level=INFO msg="Upload complete. (192ms)" worker1 # [ 118.089320] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 118.103290] nix-daemon[865]: reaped child process 1563, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.76 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.09 seconds) worker2 # [ 118.256699] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 118.264152] systemd[1]: Starting scheduler-token.service... worker2 # [ 118.307972] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 118.309681] systemd[1]: Finished scheduler-token.service. worker2 # [ 118.312217] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 46ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 118.315980] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 118.386495] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 118.393113] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 118.399937] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 118.404043] nix-grpc-daemon[1424]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 118.406097] nix-grpc-daemon[1424]: E0000 00:00:1790089509.615995 1424 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 118.411205] nix-grpc-daemon[1424]: E0000 00:00:1790089509.619133 1424 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.414116] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 118.418102] nix-grpc-daemon[1424]: E0000 00:00:1790089509.627791 1465 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 118.421120] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 118.426045] nix-grpc-daemon[1424]: E0000 00:00:1790089509.649551 1465 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.428140] nix-grpc-daemon[1424]: E0000 00:00:1790089509.649808 1465 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 118.440606] nix-grpc-daemon[1424]: E0000 00:00:1790089509.664378 1465 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.452807] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.455172] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:09Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 118.458934] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:41984 worker1 # [ 118.462983] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.57 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 118.647492] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 0d72554b15ca4cbf9194387c358536cf client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.03 seconds) worker1 # [ 118.741468] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43240 client # [ 118.762893] nix[1368]: don't know how to build these paths: client # [ 118.763954] nix[1368]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 118.754246] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 118.759421] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 118.797870] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 118.810308] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43240 client # [ 118.834929] nix[1368]: copying 1 paths to 'lb:50051'... client # [ 118.836021] nix[1368]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 118.821139] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 118.830336] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 118.930652] nix-daemon[865]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 118.945560] nix-daemon[865]: reaped child process 1600, status = succeeded worker1 # [ 119.024422] nix-daemon[865]: accepted connection from pid 1602, user nix-grpc-daemon (trusted) worker1 # [ 119.037504] nix-daemon[865]: reaped child process 1605, status = succeeded lb # [ 119.050376] niks3-server[1129]: 2026/09/22 15:05:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 119.053132] nix-grpc-daemon[1465]: time=2026-09-22T15:05:10.394Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 119.054731] nix-grpc-daemon[1465]: time=2026-09-22T15:05:10.396Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 119.077498] niks3-server[1129]: 2026/09/22 15:05:10 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 119.088551] niks3-server[1129]: 2026/09/22 15:05:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 119.090895] nix-grpc-daemon[1465]: time=2026-09-22T15:05:10.432Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.096734] niks3-server[1129]: 2026/09/22 15:05:10 INFO Signed narinfos id=49 count=1 lb # [ 119.103312] niks3-server[1129]: 2026/09/22 15:05:10 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 119.116977] niks3-server[1129]: 2026/09/22 15:05:10 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete worker1 # [ 119.117131] nix-grpc-daemon[1465]: time=2026-09-22T15:05:10.458Z level=INFO msg="Upload complete. (274ms)" lb # [ 119.122829] niks3-server[1129]: 2026/09/22 15:05:10 INFO Completed upload id=49 lb # [ 119.125894] niks3-server[1129]: 2026/09/22 15:05:10 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 119.119969] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 119.125853] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 worker1 # [ 119.136925] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) worker1 # [ 119.140898] nix-daemon[865]: reaped child process 1595, status = succeeded client # [ 119.160148] nix[1368]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... worker1 # [ 119.145669] nix-daemon[865]: accepted connection from pid 1389, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 121.186314] systemd-journald[283]: Received client request to rotate journal, rotating. worker2 # [ 121.196696] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/179d1bf382724742a5c58e5b48c89102. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.03 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 121.089995] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker1 # [ 121.803377] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:13Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 126.370271] nix-daemon[865]: reaped child process 1609, status = succeeded worker1 # [ 126.442971] nix-daemon[865]: accepted connection from pid 1650, user nix-grpc-daemon (trusted) worker1 # [ 126.456672] nix-daemon[865]: reaped child process 1653, status = succeeded lb # [ 126.468101] niks3-server[1129]: 2026/09/22 15:05:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 126.467203] nix-grpc-daemon[1465]: time=2026-09-22T15:05:17.808Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 126.468779] nix-grpc-daemon[1465]: time=2026-09-22T15:05:17.810Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 126.490522] niks3-server[1129]: 2026/09/22 15:05:17 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 126.495502] niks3-server[1129]: 2026/09/22 15:05:17 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 126.497797] niks3-server[1129]: 2026/09/22 15:05:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 126.499685] niks3-server[1129]: 2026/09/22 15:05:17 INFO Signed narinfos id=50 count=1 worker1 # [ 126.495843] nix-grpc-daemon[1465]: time=2026-09-22T15:05:17.837Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.503451] niks3-server[1129]: 2026/09/22 15:05:17 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 126.509053] niks3-server[1129]: 2026/09/22 15:05:17 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 126.512717] niks3-server[1129]: 2026/09/22 15:05:17 INFO Completed upload id=50 lb # [ 126.514289] niks3-server[1129]: 2026/09/22 15:05:17 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 126.509235] nix-grpc-daemon[1465]: time=2026-09-22T15:05:17.850Z level=INFO msg="Upload complete. (149ms)" worker1 # [ 126.513079] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43240 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 126.519910] nix-daemon[865]: reaped child process 1607, status = succeeded lb # [ 126.526742] envoy[916]: conn peer=[2001:db8:1::1]:48222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9547 tx=4344 ms=5615 lb # [ 126.528314] envoy[916]: conn peer=[2001:db8:1::1]:57572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2973 tx=1539 ms=7782 client # [ 126.546292] systemd[1]: rs.service: Deactivated successfully. client # [ 126.548065] systemd[1]: rs.service: Consumed 105ms CPU time over 7.900s wall clock time, 41.4M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 126.805276] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:18Z level=info event=signal_exit lb # [ 126.975244] niks3-server[1129]: 2026/09/22 15:05:18 INFO lead: released remote=192.168.1.3:48158 worker1 # [ 127.969504] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:19Z level=info event=scheduler_restarting worker1 # [ 127.973614] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:19Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 127.979788] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 127.975171] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41984 worker1 # [ 127.976732] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:19Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 127.978908] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41984 worker1 # [ 127.982674] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:19Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 127.999399] nix-daemon[865]: reaped child process 1441, status = succeeded worker2 # [ 128.180344] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.184644] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.182344] nix-grpc-daemon[1389]: E0000 00:00:1790089519.523739 1434 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker1 # [ 128.190956] nix-grpc-daemon[1389]: E0000 00:00:1790089519.529113 1434 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 128.196299] nix-grpc-daemon[1389]: ts=2026-09-22T15:05:19Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 128.385987] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.390317] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 128.402681] niks3-server[1129]: 2026/09/22 15:05:19 INFO lead: acquired remote=192.168.1.4:35924 worker2 # [ 128.404457] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_take_over worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.10 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 128.562661] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 128.565570] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 128.568365] systemd[1]: nix-grpc-daemon.service: Consumed 1.311s CPU time over 28.877s wall clock time, 39M memory peak, 47.8K incoming IP traffic, 100.5K outgoing IP traffic. worker2 # [ 128.588371] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.583842] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 128.592306] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.672719] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 128.674740] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 128.677932] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 128.683058] nix-grpc-daemon[1660]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 128.684412] nix-grpc-daemon[1660]: E0000 00:00:1790089520.024092 1660 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.690323] nix-grpc-daemon[1660]: E0000 00:00:1790089520.029032 1660 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.693544] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 128.696208] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 128.698064] nix-grpc-daemon[1660]: E0000 00:00:1790089520.039130 1701 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.709816] nix-grpc-daemon[1660]: E0000 00:00:1790089520.051252 1701 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.714142] nix-grpc-daemon[1660]: E0000 00:00:1790089520.053568 1701 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.724118] nix-grpc-daemon[1660]: E0000 00:00:1790089520.065608 1701 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.733389] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.734975] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.793389] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.797370] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.935959] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.939930] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.003548] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.006797] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.140703] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.144598] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.204775] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.208657] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.345618] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.358196] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54298 worker2 # [ 129.362733] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 129.409535] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.419139] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 129.422744] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54298 worker2 # [ 129.426719] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 11.00 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 129.669902] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: e92f5200ab374597b510a6c20456fc07 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker2 # [ 129.793671] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54314 worker2 # [ 129.805781] nix-daemon[850]: accepted connection from pid 1424, user nix-grpc-daemon (trusted) client # [ 129.825611] nix[1404]: don't know how to build these paths: client # [ 129.826523] nix[1404]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 129.824505] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:21Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 129.829311] nix-grpc-daemon[1424]: ts=2026-09-22T15:05:21Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 129.871469] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45498 worker1 # [ 129.876448] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1 # [ 129.883907] nix-grpc-daemon[1660]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 1/5) worker1 # [ 129.980390] nix-grpc-daemon[1660]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 114 ms (attempt 2/5) worker1 # [ 130.096596] nix-grpc-daemon[1660]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 3/5) worker1 # [ 130.249758] nix-grpc-daemon[1660]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 339 ms (attempt 4/5) worker1 # [ 130.590881] nix-grpc-daemon[1660]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 130.594395] nix-grpc-daemon[1660]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 130.611362] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45498 client # [ 130.635982] nix[1404]: copying 1 paths to 'lb:50051'... client # [ 130.639915] nix[1404]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 130.626061] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45498 worker1 # [ 130.634352] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1 # [ 130.656193] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:21Z level=info event=niks3_push_started pid=1724 worker1 # [ 130.761913] nix-grpc-daemon[1724]: time=2026-09-22T15:05:22.102Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 130.854877] nix-daemon[865]: accepted connection from pid 1740, user nix-grpc-daemon (trusted) worker1 # [ 130.868994] nix-daemon[865]: reaped child process 1743, status = succeeded worker1 # [ 130.951244] nix-daemon[865]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 130.965112] nix-daemon[865]: reaped child process 1748, status = succeeded lb # [ 130.976667] niks3-server[1129]: 2026/09/22 15:05:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 130.980065] nix-grpc-daemon[1724]: time=2026-09-22T15:05:22.320Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 130.981505] nix-grpc-daemon[1724]: time=2026-09-22T15:05:22.321Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 131.010893] niks3-server[1129]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 131.017904] niks3-server[1129]: 2026/09/22 15:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 131.020159] nix-grpc-daemon[1724]: time=2026-09-22T15:05:22.361Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.025367] niks3-server[1129]: 2026/09/22 15:05:22 INFO Signed narinfos id=51 count=1 lb # [ 131.036494] niks3-server[1129]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 131.046218] niks3-server[1129]: 2026/09/22 15:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 131.053347] niks3-server[1129]: 2026/09/22 15:05:22 INFO Completed upload id=51 worker1 # [ 131.047672] nix-grpc-daemon[1724]: time=2026-09-22T15:05:22.389Z level=INFO msg="Upload complete. (282ms)" lb # [ 131.056430] niks3-server[1129]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 131.052485] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45498 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 131.058354] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45498 worker1 # [ 131.068264] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1 # [ 131.073106] nix-daemon[865]: reaped child process 1722, status = succeeded client # [ 131.091143] nix[1404]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 131.076352] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 133.225966] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1424 (nix-grpc-daemon) on client request. worker2 # [ 133.239813] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 133.246880] niks3-server[1129]: 2026/09/22 15:05:24 INFO lead: released remote=192.168.1.4:35924 worker1 # [ 133.246325] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" client # [ 133.261988] nix[1404]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 133.256598] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 133.263499] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 133.268336] systemd[1]: nix-grpc-daemon.service: Consumed 202ms CPU time over 14.940s wall clock time, 13.4M memory peak, 10.6K incoming IP traffic, 22K outgoing IP traffic. worker2 # [ 133.285156] systemd[1]: Starting scheduler-token.service... worker2 # [ 133.289695] nix-daemon[850]: reaped child process 1533, status = succeeded worker2 # [ 133.319709] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 133.322326] systemd[1]: Finished scheduler-token.service. worker2 # [ 133.323276] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 36ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 133.325762] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 133.329522] systemd[1]: Starting scheduler-token.service... worker2 # [ 133.360838] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 133.362678] systemd[1]: Finished scheduler-token.service. worker2 # [ 133.364139] systemd[1]: scheduler-token.service: Consumed 15ms CPU time over 33ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 133.369161] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 133.439215] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 133.441430] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 133.444885] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 133.450051] nix-grpc-daemon[1567]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 133.451565] nix-grpc-daemon[1567]: E0000 00:00:1790089524.673325 1567 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 133.446605] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 133.459567] nix-grpc-daemon[1567]: E0000 00:00:1790089524.679040 1567 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 133.463936] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 133.469972] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 133.468683] niks3-server[1129]: 2026/09/22 15:05:24 INFO lead: acquired remote=192.168.1.4:52976 worker2 # [ 133.472173] nix-grpc-daemon[1567]: E0000 00:00:1790089524.692603 1608 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 133.467153] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 133.478175] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=scheduler_take_over worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds) client: must succeed: sleep 5.0 worker2 # [ 133.487280] nix-grpc-daemon[1567]: E0000 00:00:1790089524.711052 1608 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 133.491125] nix-grpc-daemon[1567]: E0000 00:00:1790089524.713612 1608 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 133.502365] nix-grpc-daemon[1567]: E0000 00:00:1790089524.726097 1608 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 133.511891] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 133.517392] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 133.518943] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37546 worker2 # [ 133.520777] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 133.667701] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 133.677465] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37546 worker2 # [ 133.682138] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=1 lb # [ 136.527910] envoy[916]: conn peer=[2001:db8:1::3]:51500 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4581 tx=1106 ms=28334 lb # [ 136.532367] envoy[916]: conn peer=[2001:db8:1::4]:54846 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6953 tx=546 ms=14807 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 138.700396] nix-daemon[865]: reaped child process 1752, status = succeeded worker1 # [ 138.772389] nix-daemon[865]: accepted connection from pid 1789, user nix-grpc-daemon (trusted) worker1 # [ 138.785757] nix-daemon[865]: reaped child process 1792, status = succeeded lb # [ 138.798506] niks3-server[1129]: 2026/09/22 15:05:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.801040] nix-grpc-daemon[1724]: time=2026-09-22T15:05:30.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.802977] nix-grpc-daemon[1724]: time=2026-09-22T15:05:30.144Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 138.860807] niks3-server[1129]: 2026/09/22 15:05:30 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 138.868928] niks3-server[1129]: 2026/09/22 15:05:30 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 138.874974] niks3-server[1129]: 2026/09/22 15:05:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 138.880878] niks3-server[1129]: 2026/09/22 15:05:30 INFO Signed narinfos id=52 count=1 worker1 # [ 138.875592] nix-grpc-daemon[1724]: time=2026-09-22T15:05:30.217Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.884960] niks3-server[1129]: 2026/09/22 15:05:30 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 138.890776] niks3-server[1129]: 2026/09/22 15:05:30 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 138.897326] niks3-server[1129]: 2026/09/22 15:05:30 INFO Completed upload id=52 worker1 # [ 138.892304] nix-grpc-daemon[1724]: time=2026-09-22T15:05:30.233Z level=INFO msg="Upload complete. (203ms)" lb # [ 138.900163] niks3-server[1129]: 2026/09/22 15:05:30 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 138.898985] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45498 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 138.913473] nix-daemon[865]: reaped child process 1750, status = succeeded client # [ 138.945971] systemd[1]: mid.service: Deactivated successfully. client # [ 138.949868] systemd[1]: mid.service: Consumed 127ms CPU time over 9.276s wall clock time, 43.4M memory peak, 7.8K incoming IP traffic, 8.8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.18 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 139.832337] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 5875aa67c10444e89cab18a49ee188b2 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker2 # [ 139.950439] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 139.961237] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # [ 139.980887] nix[1440]: don't know how to build these paths: client # [ 139.981837] nix[1440]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 139.979332] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:31Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 139.982879] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:31Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 140.030835] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 140.041991] nix-grpc-daemon[1567]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5) worker2 # [ 140.144935] nix-grpc-daemon[1567]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5) worker2 # [ 140.272094] nix-grpc-daemon[1567]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 3/5) worker2 # [ 140.464247] nix-grpc-daemon[1567]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 146 ms (attempt 4/5) worker2 # [ 140.613872] nix-grpc-daemon[1567]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 140.617435] nix-grpc-daemon[1567]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 140.632057] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 client # [ 140.648587] nix[1440]: copying 1 paths to 'lb:50051'... client # [ 140.652127] nix[1440]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 140.644379] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 140.654156] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 140.674158] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:31Z level=info event=niks3_push_started pid=1641 worker2 # [ 140.776583] nix-grpc-daemon[1641]: time=2026-09-22T15:05:32.000Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 140.862391] nix-daemon[850]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 140.875933] nix-daemon[850]: reaped child process 1657, status = succeeded worker2 # [ 140.955840] nix-daemon[850]: accepted connection from pid 1659, user nix-grpc-daemon (trusted) worker2 # [ 140.969123] nix-daemon[850]: reaped child process 1662, status = succeeded lb # [ 140.976073] niks3-server[1129]: 2026/09/22 15:05:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 140.985734] nix-grpc-daemon[1641]: time=2026-09-22T15:05:32.208Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 140.987233] nix-grpc-daemon[1641]: time=2026-09-22T15:05:32.208Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 141.005858] niks3-server[1129]: 2026/09/22 15:05:32 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 141.016374] niks3-server[1129]: 2026/09/22 15:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 141.022294] niks3-server[1129]: 2026/09/22 15:05:32 INFO Signed narinfos id=53 count=1 worker2 # [ 141.027404] nix-grpc-daemon[1641]: time=2026-09-22T15:05:32.250Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.034539] niks3-server[1129]: 2026/09/22 15:05:32 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 141.044209] niks3-server[1129]: 2026/09/22 15:05:32 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 141.052224] niks3-server[1129]: 2026/09/22 15:05:32 INFO Completed upload id=53 worker2 # [ 141.054299] nix-grpc-daemon[1641]: time=2026-09-22T15:05:32.278Z level=INFO msg="Upload complete. (274ms)" lb # [ 141.054458] niks3-server[1129]: 2026/09/22 15:05:32 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 141.057069] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 141.060678] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 141.067309] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 141.069595] nix-daemon[850]: reaped child process 1639, status = succeeded worker2 # [ 141.074556] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # [ 141.082601] nix[1440]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 143.185902] systemd[1]: intr.service: Sent signal SIGINT to main process 1440 (nix) on client request. client # [ 143.187851] nix[1440]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 143.190561] nix[1440]: error: interrupted by the user worker2 # [ 143.182221] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:34Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client: (finished: must succeed: systemctl kill -s INT intr, in 0.02 seconds) client # [ 143.207149] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 143.208739] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 143.210545] systemd[1]: intr.service: Consumed 113ms CPU time over 3.376s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 143.293553] nix-daemon[1670]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 143.296322] nix-daemon[850]: reaped child process 1668, status = succeeded worker2 # [ 143.299680] nix-daemon[850]: reaped child process 1670, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.56 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 144.399615] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 28f221e03d314d9eb5f3ef4852a89028 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.04 seconds) worker2 # [ 144.522405] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37564 client # [ 144.531503] nix[1461]: don't know how to build these paths: client # [ 144.532367] nix[1461]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 144.528801] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:35Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 144.530509] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:35Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 144.567245] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45498 worker1 # [ 144.580430] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45498 client # [ 144.606128] nix[1461]: copying 1 paths to 'lb:50051'... client # [ 144.607193] nix[1461]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 144.592127] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45498 worker1 # [ 144.604248] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1 # [ 144.705185] nix-daemon[865]: accepted connection from pid 1824, user nix-grpc-daemon (trusted) worker1 # [ 144.718987] nix-daemon[865]: reaped child process 1827, status = succeeded worker1 # [ 144.799826] nix-daemon[865]: accepted connection from pid 1829, user nix-grpc-daemon (trusted) worker1 # [ 144.813532] nix-daemon[865]: reaped child process 1832, status = succeeded lb # [ 144.825233] niks3-server[1129]: 2026/09/22 15:05:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.828347] nix-grpc-daemon[1724]: time=2026-09-22T15:05:36.169Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.829774] nix-grpc-daemon[1724]: time=2026-09-22T15:05:36.169Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 144.851752] niks3-server[1129]: 2026/09/22 15:05:36 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 144.862955] niks3-server[1129]: 2026/09/22 15:05:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 144.864433] nix-grpc-daemon[1724]: time=2026-09-22T15:05:36.205Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.869564] niks3-server[1129]: 2026/09/22 15:05:36 INFO Signed narinfos id=54 count=1 lb # [ 144.874217] niks3-server[1129]: 2026/09/22 15:05:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 144.888441] niks3-server[1129]: 2026/09/22 15:05:36 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 144.890023] nix-grpc-daemon[1724]: time=2026-09-22T15:05:36.231Z level=INFO msg="Upload complete. (274ms)" lb # [ 144.895343] niks3-server[1129]: 2026/09/22 15:05:36 INFO Completed upload id=54 worker1 # [ 144.892127] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45498 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 144.899668] niks3-server[1129]: 2026/09/22 15:05:36 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 144.896871] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45498 worker1 # [ 144.906927] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1 # [ 144.909268] nix-daemon[865]: reaped child process 1822, status = succeeded client # [ 144.928761] nix[1461]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1 # [ 144.914484] nix-daemon[865]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 145.647234] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 145.673607] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1 # [ 145.695323] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:37Z level=info event=draining worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 145.842903] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 145.850154] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 145.870254] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 145.875919] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 145.919908] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 145.933137] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 client # copying 1 paths to 'lb:50051'... worker2 # [ 145.948596] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 145.976496] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 146.081807] nix-daemon[850]: accepted connection from pid 1722, user nix-grpc-daemon (trusted) worker2 # [ 146.095177] nix-daemon[850]: reaped child process 1725, status = succeeded worker2 # [ 146.178230] nix-daemon[850]: accepted connection from pid 1727, user nix-grpc-daemon (trusted) worker2 # [ 146.191566] nix-daemon[850]: reaped child process 1730, status = succeeded lb # [ 146.197106] niks3-server[1129]: 2026/09/22 15:05:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 146.206161] nix-grpc-daemon[1641]: time=2026-09-22T15:05:37.429Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 146.207723] nix-grpc-daemon[1641]: time=2026-09-22T15:05:37.429Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 146.221411] niks3-server[1129]: 2026/09/22 15:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker2 # [ 146.228422] nix-grpc-daemon[1641]: time=2026-09-22T15:05:37.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.226313] niks3-server[1129]: 2026/09/22 15:05:37 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 146.228167] niks3-server[1129]: 2026/09/22 15:05:37 INFO Signed narinfos id=55 count=1 lb # [ 146.244086] niks3-server[1129]: 2026/09/22 15:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 146.247516] niks3-server[1129]: 2026/09/22 15:05:37 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 146.250091] niks3-server[1129]: 2026/09/22 15:05:37 INFO Completed upload id=55 worker2 # [ 146.251996] nix-grpc-daemon[1641]: time=2026-09-22T15:05:37.475Z level=INFO msg="Upload complete. (263ms)" worker2 # [ 146.254088] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 paths=1 nar_bytes_in=528 lb # [ 146.253073] niks3-server[1129]: 2026/09/22 15:05:37 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 146.257705] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 146.264707] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 146.267160] nix-daemon[850]: reaped child process 1720, status = succeeded worker2 # [ 146.272488] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 146.527753] envoy[916]: conn peer=[2001:db8:1::1]:44280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3087 tx=1606 ms=9132 lb # [ 146.529392] envoy[916]: conn peer=[2001:db8:1::1]:41392 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3006 tx=829 ms=3248 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 147.722722] nix-daemon[850]: reaped child process 1734, status = succeeded worker2 # [ 147.785088] nix-daemon[850]: accepted connection from pid 1750, user nix-grpc-daemon (trusted) worker2 # [ 147.797529] nix-daemon[850]: reaped child process 1753, status = succeeded lb # [ 147.800510] niks3-server[1129]: 2026/09/22 15:05:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 147.807987] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.031Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 147.812440] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.033Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 147.819813] niks3-server[1129]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 147.830510] niks3-server[1129]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 147.841652] niks3-server[1129]: 2026/09/22 15:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 147.845106] niks3-server[1129]: 2026/09/22 15:05:39 INFO Signed narinfos id=56 count=1 worker2 # [ 147.848770] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.072Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.847509] niks3-server[1129]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 147.853959] niks3-server[1129]: 2026/09/22 15:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 147.859700] niks3-server[1129]: 2026/09/22 15:05:39 INFO Completed upload id=56 worker2 # [ 147.861671] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.085Z level=INFO msg="Upload complete. (181ms)" lb # [ 147.861498] niks3-server[1129]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 147.864521] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=1 worker2 # [ 147.871170] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 147.873563] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 147.878436] nix-daemon[850]: reaped child process 1732, status = succeeded worker2 # [ 147.915274] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 147.926419] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 147.938791] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.162Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 147.946883] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 147.965132] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 148.062464] nix-daemon[850]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker2 # [ 148.075605] nix-daemon[850]: reaped child process 1762, status = succeeded worker2 # [ 148.159748] nix-daemon[850]: accepted connection from pid 1764, user nix-grpc-daemon (trusted) worker2 # [ 148.173738] nix-daemon[850]: reaped child process 1767, status = succeeded lb # [ 148.175651] niks3-server[1129]: 2026/09/22 15:05:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.190085] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.413Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 148.191518] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.413Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 148.212845] niks3-server[1129]: 2026/09/22 15:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 148.219110] niks3-server[1129]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst worker2 # [ 148.225345] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.448Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.223703] niks3-server[1129]: 2026/09/22 15:05:39 INFO Signed narinfos id=57 count=1 lb # [ 148.230135] niks3-server[1129]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 148.241906] niks3-server[1129]: 2026/09/22 15:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 148.248090] niks3-server[1129]: 2026/09/22 15:05:39 INFO Completed upload id=57 worker2 # [ 148.250038] nix-grpc-daemon[1641]: time=2026-09-22T15:05:39.473Z level=INFO msg="Upload complete. (274ms)" lb # [ 148.251253] niks3-server[1129]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 148.254121] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 148.258810] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 148.269943] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 148.276122] nix-daemon[850]: reaped child process 1757, status = succeeded worker2 # [ 148.279178] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 149.095943] nix-daemon[850]: reaped child process 1771, status = succeeded worker2 # [ 149.170851] nix-daemon[850]: accepted connection from pid 1787, user nix-grpc-daemon (trusted) worker2 # [ 149.184072] nix-daemon[850]: reaped child process 1790, status = succeeded lb # [ 149.189258] niks3-server[1129]: 2026/09/22 15:05:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.195487] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.419Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 149.197633] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.420Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 149.207412] niks3-server[1129]: 2026/09/22 15:05:40 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 149.212238] niks3-server[1129]: 2026/09/22 15:05:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 149.218253] niks3-server[1129]: 2026/09/22 15:05:40 INFO Signed narinfos id=58 count=1 worker2 # [ 149.223186] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.446Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.224872] niks3-server[1129]: 2026/09/22 15:05:40 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 149.230667] niks3-server[1129]: 2026/09/22 15:05:40 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 149.234685] niks3-server[1129]: 2026/09/22 15:05:40 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 149.237319] niks3-server[1129]: 2026/09/22 15:05:40 INFO Completed upload id=58 worker2 # [ 149.239315] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.463Z level=INFO msg="Upload complete. (153ms)" lb # [ 149.239325] niks3-server[1129]: 2026/09/22 15:05:40 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 149.242192] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=1 worker2 # [ 149.249472] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 149.251651] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 149.255922] nix-daemon[850]: reaped child process 1769, status = succeeded worker2 # [ 149.292995] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 149.304270] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 149.315348] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.539Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 149.323302] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 149.342117] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 149.437063] nix-daemon[850]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker2 # [ 149.450460] nix-daemon[850]: reaped child process 1799, status = succeeded worker2 # [ 149.535985] nix-daemon[850]: accepted connection from pid 1801, user nix-grpc-daemon (trusted) worker2 # [ 149.549491] nix-daemon[850]: reaped child process 1804, status = succeeded lb # [ 149.554524] niks3-server[1129]: 2026/09/22 15:05:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.563727] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.787Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 149.565514] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.789Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 149.585683] niks3-server[1129]: 2026/09/22 15:05:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker2 # [ 149.595283] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.818Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.593145] niks3-server[1129]: 2026/09/22 15:05:40 INFO Signed narinfos id=59 count=1 lb # [ 149.599753] niks3-server[1129]: 2026/09/22 15:05:40 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 149.614123] niks3-server[1129]: 2026/09/22 15:05:40 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 149.619534] niks3-server[1129]: 2026/09/22 15:05:40 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 149.625739] niks3-server[1129]: 2026/09/22 15:05:40 INFO Completed upload id=59 worker2 # [ 149.627880] nix-grpc-daemon[1641]: time=2026-09-22T15:05:40.851Z level=INFO msg="Upload complete. (275ms)" lb # [ 149.629182] niks3-server[1129]: 2026/09/22 15:05:40 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 149.632158] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 149.637404] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 149.646692] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 149.654850] nix-daemon[850]: reaped child process 1794, status = succeeded worker2 # [ 149.659808] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 150.073509] nix-daemon[850]: reaped child process 1808, status = succeeded worker2 # [ 150.142546] nix-daemon[850]: accepted connection from pid 1824, user nix-grpc-daemon (trusted) worker2 # [ 150.156609] nix-daemon[850]: reaped child process 1827, status = succeeded lb # [ 150.158666] niks3-server[1129]: 2026/09/22 15:05:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 150.166498] nix-grpc-daemon[1641]: time=2026-09-22T15:05:41.390Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 150.168044] nix-grpc-daemon[1641]: time=2026-09-22T15:05:41.391Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 150.190983] niks3-server[1129]: 2026/09/22 15:05:41 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 150.205301] niks3-server[1129]: 2026/09/22 15:05:41 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 150.211296] niks3-server[1129]: 2026/09/22 15:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker2 # [ 150.221988] nix-grpc-daemon[1641]: time=2026-09-22T15:05:41.445Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.219723] niks3-server[1129]: 2026/09/22 15:05:41 INFO Signed narinfos id=60 count=1 lb # [ 150.225437] niks3-server[1129]: 2026/09/22 15:05:41 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 150.235889] niks3-server[1129]: 2026/09/22 15:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 150.238745] niks3-server[1129]: 2026/09/22 15:05:41 INFO Completed upload id=60 worker2 # [ 150.240776] nix-grpc-daemon[1641]: time=2026-09-22T15:05:41.464Z level=INFO msg="Upload complete. (175ms)" lb # [ 150.240784] niks3-server[1129]: 2026/09/22 15:05:41 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 150.243498] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=1 worker2 # [ 150.250993] nix-daemon[850]: reaped child process 1806, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.60 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 150.536428] nix-daemon[865]: reaped child process 1836, status = succeeded worker1 # [ 150.612457] nix-daemon[865]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker1 # [ 150.626048] nix-daemon[865]: reaped child process 1876, status = succeeded lb # [ 150.638521] niks3-server[1129]: 2026/09/22 15:05:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.640985] nix-grpc-daemon[1724]: time=2026-09-22T15:05:41.982Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.642531] nix-grpc-daemon[1724]: time=2026-09-22T15:05:41.984Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 150.675482] niks3-server[1129]: 2026/09/22 15:05:41 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 150.685109] niks3-server[1129]: 2026/09/22 15:05:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 150.690715] niks3-server[1129]: 2026/09/22 15:05:42 INFO Signed narinfos id=61 count=1 worker1 # [ 150.688147] nix-grpc-daemon[1724]: time=2026-09-22T15:05:42.029Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.698769] niks3-server[1129]: 2026/09/22 15:05:42 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 150.710895] niks3-server[1129]: 2026/09/22 15:05:42 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 150.716303] niks3-server[1129]: 2026/09/22 15:05:42 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 150.723675] niks3-server[1129]: 2026/09/22 15:05:42 INFO Completed upload id=61 worker1 # [ 150.718535] nix-grpc-daemon[1724]: time=2026-09-22T15:05:42.059Z level=INFO msg="Upload complete. (193ms)" lb # [ 150.725516] niks3-server[1129]: 2026/09/22 15:05:42 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 150.725713] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45498 duration_s=5 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=1 worker1 # [ 150.739780] nix-daemon[865]: reaped child process 1834, status = succeeded client # [ 150.769708] systemd[1]: sw.service: Deactivated successfully. client # [ 150.774181] systemd[1]: sw.service: Consumed 119ms CPU time over 6.372s wall clock time, 43.4M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.04 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 151.697183] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:43Z level=info event=signal_exit lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 152.714548] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37546 worker2 # [ 152.716291] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:43Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 152.707978] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:44Z level=info event=scheduler_restarting worker1 # [ 152.722535] nix-grpc-daemon[1660]: ts=2026-09-22T15:05:44Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 152.744193] nix-daemon[865]: reaped child process 1716, status = succeeded worker1 # [ 153.613742] nix-grpc-daemon[1660]: E0000 00:00:1790089544.955000 1705 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 153.619072] nix-grpc-daemon[1660]: E0000 00:00:1790089544.955523 1705 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 154.723528] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 154.727370] systemd[1]: nix-grpc-daemon.service: Consumed 762ms CPU time over 26.139s wall clock time, 37M memory peak, 24.7K incoming IP traffic, 34.7K outgoing IP traffic. lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 155.719427] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 155.823354] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 155.825473] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 155.829111] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 155.833082] nix-grpc-daemon[1888]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 155.834851] nix-grpc-daemon[1888]: E0000 00:00:1790089547.174367 1888 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.841069] nix-grpc-daemon[1888]: E0000 00:00:1790089547.180007 1888 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.843188] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 155.847283] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 155.852065] nix-grpc-daemon[1888]: E0000 00:00:1790089547.192639 1927 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.865863] nix-grpc-daemon[1888]: E0000 00:00:1790089547.207337 1927 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.871054] nix-grpc-daemon[1888]: E0000 00:00:1790089547.209739 1927 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.880231] nix-grpc-daemon[1888]: E0000 00:00:1790089547.221716 1927 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.889303] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.898853] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37546 worker2 # [ 155.903369] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 156.528384] envoy[916]: conn peer=[2001:db8:1::1]:51744 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9568 tx=4410 ms=4459 lb # [ 156.529874] envoy[916]: conn peer=[2001:db8:1::1]:51736 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2988 tx=1516 ms=6219 lb # [ 156.531280] envoy[916]: conn peer=[2001:db8:1::3]:44296 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2012 tx=583 ms=23982 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 5.26 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.56 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 157.066780] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 157.074207] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 157.116822] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:48Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 157.120982] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:48Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 157.125450] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:48Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 157.129388] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:48Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 157.157601] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 157.169211] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 157.185596] nix-grpc-daemon[1888]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker1 # [ 157.216184] nix-grpc-daemon[1888]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 2/5) worker1 # [ 157.339239] nix-grpc-daemon[1888]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 3/5) worker1 # [ 157.471484] nix-grpc-daemon[1888]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 394 ms (attempt 4/5) worker1 # [ 157.868237] nix-grpc-daemon[1888]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 157.871212] nix-grpc-daemon[1888]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 157.885476] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 157.898304] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 157.906700] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 157.928147] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:49Z level=info event=niks3_push_started pid=1948 worker1 # [ 158.026439] nix-grpc-daemon[1948]: time=2026-09-22T15:05:49.367Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 158.110673] nix-daemon[865]: accepted connection from pid 1961, user nix-grpc-daemon (trusted) worker1 # [ 158.123706] nix-daemon[865]: reaped child process 1964, status = succeeded worker1 # [ 158.203326] nix-daemon[865]: accepted connection from pid 1966, user nix-grpc-daemon (trusted) worker1 # [ 158.216710] nix-daemon[865]: reaped child process 1969, status = succeeded lb # [ 158.229315] niks3-server[1129]: 2026/09/22 15:05:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.234067] nix-grpc-daemon[1948]: time=2026-09-22T15:05:49.574Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.235495] nix-grpc-daemon[1948]: time=2026-09-22T15:05:49.575Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 158.264626] niks3-server[1129]: 2026/09/22 15:05:49 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 158.279098] niks3-server[1129]: 2026/09/22 15:05:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 158.279633] nix-grpc-daemon[1948]: time=2026-09-22T15:05:49.620Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.284666] niks3-server[1129]: 2026/09/22 15:05:49 INFO Signed narinfos id=62 count=1 lb # [ 158.301065] niks3-server[1129]: 2026/09/22 15:05:49 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 158.305479] niks3-server[1129]: 2026/09/22 15:05:49 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 158.310166] niks3-server[1129]: 2026/09/22 15:05:49 INFO Completed upload id=62 worker1 # [ 158.305200] nix-grpc-daemon[1948]: time=2026-09-22T15:05:49.646Z level=INFO msg="Upload complete. (275ms)" lb # [ 158.312503] niks3-server[1129]: 2026/09/22 15:05:49 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 158.309949] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 158.316321] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 158.326101] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 158.332133] nix-daemon[865]: reaped child process 1946, status = succeeded worker1 # [ 158.335370] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 158.948691] nix-daemon[865]: reaped child process 1973, status = succeeded worker1 # [ 159.028479] nix-daemon[865]: accepted connection from pid 1989, user nix-grpc-daemon (trusted) worker1 # [ 159.040218] nix-daemon[865]: reaped child process 1992, status = succeeded lb # [ 159.054391] niks3-server[1129]: 2026/09/22 15:05:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.060797] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.402Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.062816] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.403Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 159.098162] niks3-server[1129]: 2026/09/22 15:05:50 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 159.102678] niks3-server[1129]: 2026/09/22 15:05:50 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 159.110620] niks3-server[1129]: 2026/09/22 15:05:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 159.114886] niks3-server[1129]: 2026/09/22 15:05:50 INFO Signed narinfos id=63 count=1 worker1 # [ 159.111799] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.453Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.122611] niks3-server[1129]: 2026/09/22 15:05:50 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 159.127059] niks3-server[1129]: 2026/09/22 15:05:50 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 159.130613] niks3-server[1129]: 2026/09/22 15:05:50 INFO Completed upload id=63 worker1 # [ 159.126595] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.468Z level=INFO msg="Upload complete. (185ms)" lb # [ 159.133535] niks3-server[1129]: 2026/09/22 15:05:50 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 159.131350] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=1 worker2 # [ 159.140435] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:50Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.144241] nix-daemon[865]: reaped child process 1971, status = succeeded worker2 # [ 159.150418] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:50Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 159.184842] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 159.196097] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 159.208333] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 159.218524] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 159.315982] nix-daemon[865]: accepted connection from pid 1996, user nix-grpc-daemon (trusted) worker1 # [ 159.329300] nix-daemon[865]: reaped child process 1999, status = succeeded worker1 # [ 159.414939] nix-daemon[865]: accepted connection from pid 2001, user nix-grpc-daemon (trusted) worker1 # [ 159.428827] nix-daemon[865]: reaped child process 2004, status = succeeded lb # [ 159.441590] niks3-server[1129]: 2026/09/22 15:05:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.445135] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.786Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.446711] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.788Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 159.473963] niks3-server[1129]: 2026/09/22 15:05:50 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 159.484085] niks3-server[1129]: 2026/09/22 15:05:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 159.484770] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.826Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.489910] niks3-server[1129]: 2026/09/22 15:05:50 INFO Signed narinfos id=64 count=1 lb # [ 159.497972] niks3-server[1129]: 2026/09/22 15:05:50 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 159.508726] niks3-server[1129]: 2026/09/22 15:05:50 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 159.513062] niks3-server[1129]: 2026/09/22 15:05:50 INFO Completed upload id=64 lb # [ 159.515058] niks3-server[1129]: 2026/09/22 15:05:50 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 159.508087] nix-grpc-daemon[1948]: time=2026-09-22T15:05:50.849Z level=INFO msg="Upload complete. (278ms)" worker1 # [ 159.512533] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 159.517627] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 159.526904] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 159.533875] nix-daemon[865]: reaped child process 1994, status = succeeded worker1 # [ 159.537546] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 160.579211] nix-daemon[865]: reaped child process 2008, status = succeeded worker1 # [ 160.656959] nix-daemon[865]: accepted connection from pid 2025, user nix-grpc-daemon (trusted) worker1 # [ 160.670477] nix-daemon[865]: reaped child process 2028, status = succeeded lb # [ 160.683896] niks3-server[1129]: 2026/09/22 15:05:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.687165] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.028Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.688773] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.030Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 160.721205] niks3-server[1129]: 2026/09/22 15:05:52 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 160.731249] niks3-server[1129]: 2026/09/22 15:05:52 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 160.743202] niks3-server[1129]: 2026/09/22 15:05:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 160.749700] niks3-server[1129]: 2026/09/22 15:05:52 INFO Signed narinfos id=65 count=1 worker1 # [ 160.747067] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.755471] niks3-server[1129]: 2026/09/22 15:05:52 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 160.765455] niks3-server[1129]: 2026/09/22 15:05:52 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 160.768559] niks3-server[1129]: 2026/09/22 15:05:52 INFO Completed upload id=65 worker1 # [ 160.763335] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.104Z level=INFO msg="Upload complete. (219ms)" lb # [ 160.770939] niks3-server[1129]: 2026/09/22 15:05:52 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker2 # [ 160.777687] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:52Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 160.769570] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=1 worker2 # [ 160.782474] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:52Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 160.778314] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 160.789479] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 160.797620] nix-daemon[865]: reaped child process 2006, status = succeeded worker1 # [ 160.800535] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 160.805843] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 160.891652] nix-daemon[865]: accepted connection from pid 2032, user nix-grpc-daemon (trusted) worker1 # [ 160.904782] nix-daemon[865]: reaped child process 2035, status = succeeded worker1 # [ 160.982673] nix-daemon[865]: accepted connection from pid 2037, user nix-grpc-daemon (trusted) worker1 # [ 160.996088] nix-daemon[865]: reaped child process 2040, status = succeeded lb # [ 161.007649] niks3-server[1129]: 2026/09/22 15:05:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.010359] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.351Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 161.012245] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.353Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 161.038753] niks3-server[1129]: 2026/09/22 15:05:52 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 161.047574] niks3-server[1129]: 2026/09/22 15:05:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker1 # [ 161.047893] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.389Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.053256] niks3-server[1129]: 2026/09/22 15:05:52 INFO Signed narinfos id=66 count=1 lb # [ 161.059613] niks3-server[1129]: 2026/09/22 15:05:52 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 161.072524] niks3-server[1129]: 2026/09/22 15:05:52 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 161.079262] niks3-server[1129]: 2026/09/22 15:05:52 INFO Completed upload id=66 worker1 # [ 161.073981] nix-grpc-daemon[1948]: time=2026-09-22T15:05:52.415Z level=INFO msg="Upload complete. (262ms)" lb # [ 161.082537] niks3-server[1129]: 2026/09/22 15:05:52 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 161.077961] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 161.082944] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 161.092105] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 161.099185] nix-daemon[865]: reaped child process 2030, status = succeeded worker1 # [ 161.104140] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 161.946416] nix-daemon[865]: reaped child process 2044, status = succeeded worker1 # [ 162.021769] nix-daemon[865]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker1 # [ 162.035593] nix-daemon[865]: reaped child process 2063, status = succeeded lb # [ 162.048403] niks3-server[1129]: 2026/09/22 15:05:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.050777] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 162.053055] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.393Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 162.082242] niks3-server[1129]: 2026/09/22 15:05:53 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 162.097347] niks3-server[1129]: 2026/09/22 15:05:53 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 162.102335] niks3-server[1129]: 2026/09/22 15:05:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 162.106762] niks3-server[1129]: 2026/09/22 15:05:53 INFO Signed narinfos id=67 count=1 worker1 # [ 162.107672] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.448Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.118151] niks3-server[1129]: 2026/09/22 15:05:53 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 162.125852] niks3-server[1129]: 2026/09/22 15:05:53 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 162.130056] niks3-server[1129]: 2026/09/22 15:05:53 INFO Completed upload id=67 worker1 # [ 162.124835] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.466Z level=INFO msg="Upload complete. (213ms)" lb # [ 162.132769] niks3-server[1129]: 2026/09/22 15:05:53 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 162.130883] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=1 worker2 # [ 162.139482] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:53Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.139470] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker2 # [ 162.148986] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:53Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 162.149586] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 162.158475] nix-daemon[865]: reaped child process 2042, status = succeeded worker1 # [ 162.160250] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.501Z level=INFO msg="All 1 paths already cached" worker1 # [ 162.164435] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 162.168936] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 162.256024] nix-daemon[865]: accepted connection from pid 2067, user nix-grpc-daemon (trusted) worker1 # [ 162.269504] nix-daemon[865]: reaped child process 2070, status = succeeded worker1 # [ 162.355179] nix-daemon[865]: accepted connection from pid 2072, user nix-grpc-daemon (trusted) worker1 # [ 162.368721] nix-daemon[865]: reaped child process 2075, status = succeeded lb # [ 162.380650] niks3-server[1129]: 2026/09/22 15:05:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.380030] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.721Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.381644] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.723Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 162.408609] niks3-server[1129]: 2026/09/22 15:05:53 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 162.417360] niks3-server[1129]: 2026/09/22 15:05:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker1 # [ 162.420157] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.761Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.425297] niks3-server[1129]: 2026/09/22 15:05:53 INFO Signed narinfos id=68 count=1 lb # [ 162.433374] niks3-server[1129]: 2026/09/22 15:05:53 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 162.444852] niks3-server[1129]: 2026/09/22 15:05:53 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 162.450793] niks3-server[1129]: 2026/09/22 15:05:53 INFO Completed upload id=68 worker1 # [ 162.445515] nix-grpc-daemon[1948]: time=2026-09-22T15:05:53.786Z level=INFO msg="Upload complete. (271ms)" lb # [ 162.453894] niks3-server[1129]: 2026/09/22 15:05:53 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 162.449534] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 162.454408] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 162.464539] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 162.468747] nix-daemon[865]: reaped child process 2065, status = succeeded worker1 # [ 162.473298] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 163.712579] nix-daemon[865]: reaped child process 2079, status = succeeded worker1 # [ 163.796742] nix-daemon[865]: accepted connection from pid 2095, user nix-grpc-daemon (trusted) worker1 # [ 163.809938] nix-daemon[865]: reaped child process 2098, status = succeeded lb # [ 163.824451] niks3-server[1129]: 2026/09/22 15:05:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.827761] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.169Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.829883] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.170Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 163.851163] niks3-server[1129]: 2026/09/22 15:05:55 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 163.855787] niks3-server[1129]: 2026/09/22 15:05:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 163.857505] niks3-server[1129]: 2026/09/22 15:05:55 INFO Signed narinfos id=69 count=1 worker1 # [ 163.854571] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.195Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.861719] niks3-server[1129]: 2026/09/22 15:05:55 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 163.865543] niks3-server[1129]: 2026/09/22 15:05:55 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 163.869844] niks3-server[1129]: 2026/09/22 15:05:55 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 163.873494] niks3-server[1129]: 2026/09/22 15:05:55 INFO Completed upload id=69 worker1 # [ 163.868033] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.209Z level=INFO msg="Upload complete. (184ms)" lb # [ 163.875662] niks3-server[1129]: 2026/09/22 15:05:55 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 163.870693] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=1 worker2 # [ 163.880789] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:55Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.878363] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker2 # [ 163.886796] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:55Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 163.882375] nix-daemon[865]: reaped child process 2077, status = succeeded worker1 # [ 163.885757] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 163.891417] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.232Z level=INFO msg="All 1 paths already cached" worker1 # [ 163.895339] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 163.898990] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 163.986636] nix-daemon[865]: accepted connection from pid 2102, user nix-grpc-daemon (trusted) worker1 # [ 164.000122] nix-daemon[865]: reaped child process 2105, status = succeeded worker1 # [ 164.085826] nix-daemon[865]: accepted connection from pid 2107, user nix-grpc-daemon (trusted) worker1 # [ 164.099190] nix-daemon[865]: reaped child process 2110, status = succeeded lb # [ 164.111548] niks3-server[1129]: 2026/09/22 15:05:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.111177] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.452Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.112638] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.452Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 164.125946] niks3-server[1129]: 2026/09/22 15:05:55 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 164.130510] niks3-server[1129]: 2026/09/22 15:05:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 164.133176] niks3-server[1129]: 2026/09/22 15:05:55 INFO Signed narinfos id=70 count=1 worker1 # [ 164.127891] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.469Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.136595] niks3-server[1129]: 2026/09/22 15:05:55 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 164.141918] niks3-server[1129]: 2026/09/22 15:05:55 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 164.145981] niks3-server[1129]: 2026/09/22 15:05:55 INFO Completed upload id=70 worker1 # [ 164.140760] nix-grpc-daemon[1948]: time=2026-09-22T15:05:55.482Z level=INFO msg="Upload complete. (235ms)" worker1 # [ 164.142781] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 164.149080] niks3-server[1129]: 2026/09/22 15:05:55 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 164.146764] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 164.152767] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 164.155076] nix-daemon[865]: reaped child process 2100, status = succeeded worker1 # [ 164.160197] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 164.776361] nix-daemon[865]: reaped child process 2114, status = succeeded worker1 # [ 164.853834] nix-daemon[865]: accepted connection from pid 2130, user nix-grpc-daemon (trusted) worker1 # [ 164.867341] nix-daemon[865]: reaped child process 2133, status = succeeded lb # [ 164.878269] niks3-server[1129]: 2026/09/22 15:05:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.878358] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.219Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.879896] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.221Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 164.896872] niks3-server[1129]: 2026/09/22 15:05:56 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 164.901679] niks3-server[1129]: 2026/09/22 15:05:56 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 164.906692] niks3-server[1129]: 2026/09/22 15:05:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 164.908966] niks3-server[1129]: 2026/09/22 15:05:56 INFO Signed narinfos id=71 count=1 worker1 # [ 164.903863] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.913768] niks3-server[1129]: 2026/09/22 15:05:56 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 164.918802] niks3-server[1129]: 2026/09/22 15:05:56 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 164.922239] niks3-server[1129]: 2026/09/22 15:05:56 INFO Completed upload id=71 worker1 # [ 164.916791] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.258Z level=INFO msg="Upload complete. (150ms)" lb # [ 164.925533] niks3-server[1129]: 2026/09/22 15:05:56 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 164.919506] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=1 worker2 # [ 164.927859] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:56Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.925390] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 164.930107] nix-daemon[865]: reaped child process 2112, status = succeeded worker2 # [ 164.935519] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:56Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 164.933335] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 164.938987] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.280Z level=INFO msg="All 1 paths already cached" worker1 # [ 164.941571] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 164.945321] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 165.027524] nix-daemon[865]: accepted connection from pid 2137, user nix-grpc-daemon (trusted) worker1 # [ 165.041576] nix-daemon[865]: reaped child process 2140, status = succeeded worker1 # [ 165.120479] nix-daemon[865]: accepted connection from pid 2142, user nix-grpc-daemon (trusted) worker1 # [ 165.134187] nix-daemon[865]: reaped child process 2145, status = succeeded lb # [ 165.145501] niks3-server[1129]: 2026/09/22 15:05:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.149220] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.490Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 165.150800] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.492Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 165.179822] niks3-server[1129]: 2026/09/22 15:05:56 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 165.187864] niks3-server[1129]: 2026/09/22 15:05:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 165.192632] niks3-server[1129]: 2026/09/22 15:05:56 INFO Signed narinfos id=72 count=1 worker1 # [ 165.189784] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.531Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.204257] niks3-server[1129]: 2026/09/22 15:05:56 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 165.208033] niks3-server[1129]: 2026/09/22 15:05:56 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 165.211427] niks3-server[1129]: 2026/09/22 15:05:56 INFO Completed upload id=72 worker1 # [ 165.206250] nix-grpc-daemon[1948]: time=2026-09-22T15:05:56.547Z level=INFO msg="Upload complete. (255ms)" lb # [ 165.214284] niks3-server[1129]: 2026/09/22 15:05:56 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 165.209429] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 165.215121] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 165.223270] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 165.228059] nix-daemon[865]: reaped child process 2135, status = succeeded worker1 # [ 165.233717] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 166.477130] nix-daemon[865]: reaped child process 2149, status = succeeded worker1 # [ 166.555765] nix-daemon[865]: accepted connection from pid 2165, user nix-grpc-daemon (trusted) worker1 # [ 166.569964] nix-daemon[865]: reaped child process 2168, status = succeeded lb # [ 166.581894] niks3-server[1129]: 2026/09/22 15:05:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.585264] nix-grpc-daemon[1948]: time=2026-09-22T15:05:57.926Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 166.588143] nix-grpc-daemon[1948]: time=2026-09-22T15:05:57.928Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 166.622754] niks3-server[1129]: 2026/09/22 15:05:57 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 166.630279] niks3-server[1129]: 2026/09/22 15:05:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign worker1 # [ 166.629079] nix-grpc-daemon[1948]: time=2026-09-22T15:05:57.970Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.634246] niks3-server[1129]: 2026/09/22 15:05:57 INFO Signed narinfos id=73 count=1 lb # [ 166.641481] niks3-server[1129]: 2026/09/22 15:05:57 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 166.646137] niks3-server[1129]: 2026/09/22 15:05:57 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 166.655246] niks3-server[1129]: 2026/09/22 15:05:57 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 166.659542] niks3-server[1129]: 2026/09/22 15:05:57 INFO Completed upload id=73 worker1 # [ 166.654433] nix-grpc-daemon[1948]: time=2026-09-22T15:05:57.995Z level=INFO msg="Upload complete. (213ms)" lb # [ 166.661103] niks3-server[1129]: 2026/09/22 15:05:57 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker2 # [ 166.668163] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:57Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 166.673406] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:57Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 166.662128] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=1 worker1 # [ 166.670097] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 166.682529] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 166.689438] nix-daemon[865]: reaped child process 2147, status = succeeded worker1 # [ 166.691853] nix-grpc-daemon[1948]: time=2026-09-22T15:05:58.033Z level=INFO msg="All 2 paths already cached" worker1 # [ 166.695807] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 166.699582] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 166.784359] nix-daemon[865]: accepted connection from pid 2172, user nix-grpc-daemon (trusted) worker1 # [ 166.797781] nix-daemon[865]: reaped child process 2175, status = succeeded worker1 # [ 166.882836] nix-daemon[865]: accepted connection from pid 2177, user nix-grpc-daemon (trusted) worker1 # [ 166.895611] nix-daemon[865]: reaped child process 2180, status = succeeded lb # [ 166.906582] niks3-server[1129]: 2026/09/22 15:05:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.909565] nix-grpc-daemon[1948]: time=2026-09-22T15:05:58.251Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.911173] nix-grpc-daemon[1948]: time=2026-09-22T15:05:58.252Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 166.939630] niks3-server[1129]: 2026/09/22 15:05:58 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 166.947741] niks3-server[1129]: 2026/09/22 15:05:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 166.952824] niks3-server[1129]: 2026/09/22 15:05:58 INFO Signed narinfos id=74 count=1 worker1 # [ 166.950821] nix-grpc-daemon[1948]: time=2026-09-22T15:05:58.292Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.964223] niks3-server[1129]: 2026/09/22 15:05:58 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 166.972900] niks3-server[1129]: 2026/09/22 15:05:58 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 166.978239] niks3-server[1129]: 2026/09/22 15:05:58 INFO Completed upload id=74 worker1 # [ 166.973115] nix-grpc-daemon[1948]: time=2026-09-22T15:05:58.314Z level=INFO msg="Upload complete. (267ms)" worker1 # [ 166.977327] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 166.982315] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 166.991354] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 166.997554] nix-daemon[865]: reaped child process 2170, status = succeeded worker1 # [ 167.001971] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 168.241466] nix-daemon[865]: reaped child process 2184, status = succeeded worker1 # [ 168.324604] nix-daemon[865]: accepted connection from pid 2200, user nix-grpc-daemon (trusted) worker1 # [ 168.337384] nix-daemon[865]: reaped child process 2203, status = succeeded lb # [ 168.349750] niks3-server[1129]: 2026/09/22 15:05:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.354902] nix-grpc-daemon[1948]: time=2026-09-22T15:05:59.696Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.357952] nix-grpc-daemon[1948]: time=2026-09-22T15:05:59.697Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 168.385691] niks3-server[1129]: 2026/09/22 15:05:59 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 168.401253] niks3-server[1129]: 2026/09/22 15:05:59 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 168.409730] niks3-server[1129]: 2026/09/22 15:05:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 168.413822] niks3-server[1129]: 2026/09/22 15:05:59 INFO Signed narinfos id=75 count=1 worker1 # [ 168.411909] nix-grpc-daemon[1948]: time=2026-09-22T15:05:59.753Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.419494] niks3-server[1129]: 2026/09/22 15:05:59 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 168.428472] niks3-server[1129]: 2026/09/22 15:05:59 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 168.432229] niks3-server[1129]: 2026/09/22 15:05:59 INFO Completed upload id=75 worker1 # [ 168.427053] nix-grpc-daemon[1948]: time=2026-09-22T15:05:59.768Z level=INFO msg="Upload complete. (216ms)" lb # [ 168.433824] niks3-server[1129]: 2026/09/22 15:05:59 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 168.430264] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=1 worker2 # [ 168.440351] nix-grpc-daemon[1567]: ts=2026-09-22T15:05:59Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 168.439484] nix-daemon[865]: reaped child process 2182, status = succeeded worker1 # [ 168.475469] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 168.482791] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 168.491581] nix-grpc-daemon[1948]: time=2026-09-22T15:05:59.833Z level=INFO msg="All 2 paths already cached" worker1 # [ 168.495900] nix-grpc-daemon[1888]: ts=2026-09-22T15:05:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 168.500134] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 168.587477] nix-daemon[865]: accepted connection from pid 2207, user nix-grpc-daemon (trusted) worker1 # [ 168.601880] nix-daemon[865]: reaped child process 2210, status = succeeded worker1 # [ 168.682109] nix-daemon[865]: accepted connection from pid 2212, user nix-grpc-daemon (trusted) worker1 # [ 168.695293] nix-daemon[865]: reaped child process 2215, status = succeeded lb # [ 168.707316] niks3-server[1129]: 2026/09/22 15:06:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.709630] nix-grpc-daemon[1948]: time=2026-09-22T15:06:00.051Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.711539] nix-grpc-daemon[1948]: time=2026-09-22T15:06:00.052Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 168.738257] niks3-server[1129]: 2026/09/22 15:06:00 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 168.746447] niks3-server[1129]: 2026/09/22 15:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 168.746978] nix-grpc-daemon[1948]: time=2026-09-22T15:06:00.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.752371] niks3-server[1129]: 2026/09/22 15:06:00 INFO Signed narinfos id=76 count=1 lb # [ 168.758401] niks3-server[1129]: 2026/09/22 15:06:00 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 168.771864] niks3-server[1129]: 2026/09/22 15:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete worker1 # [ 168.772024] nix-grpc-daemon[1948]: time=2026-09-22T15:06:00.113Z level=INFO msg="Upload complete. (264ms)" lb # [ 168.777628] niks3-server[1129]: 2026/09/22 15:06:00 INFO Completed upload id=76 worker1 # [ 168.774214] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 168.782519] niks3-server[1129]: 2026/09/22 15:06:00 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 168.781505] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 168.783201] nix-daemon[865]: reaped child process 2205, status = succeeded worker1 # [ 168.786210] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 168.792889] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 170.010409] nix-daemon[865]: reaped child process 2219, status = succeeded worker1 # [ 170.082955] nix-daemon[865]: accepted connection from pid 2235, user nix-grpc-daemon (trusted) worker1 # [ 170.096546] nix-daemon[865]: reaped child process 2238, status = succeeded lb # [ 170.107147] niks3-server[1129]: 2026/09/22 15:06:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.106518] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.447Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.108548] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.449Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 170.126190] niks3-server[1129]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 170.129421] niks3-server[1129]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 170.135094] niks3-server[1129]: 2026/09/22 15:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 170.140626] niks3-server[1129]: 2026/09/22 15:06:01 INFO Signed narinfos id=77 count=1 worker1 # [ 170.138192] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.479Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.145602] niks3-server[1129]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 170.151782] niks3-server[1129]: 2026/09/22 15:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 170.155762] niks3-server[1129]: 2026/09/22 15:06:01 INFO Completed upload id=77 worker1 # [ 170.150424] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.491Z level=INFO msg="Upload complete. (149ms)" lb # [ 170.157909] niks3-server[1129]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 170.153132] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=1 worker2 # [ 170.163732] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:01Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 170.161164] nix-daemon[865]: reaped child process 2217, status = succeeded worker1 # [ 170.200742] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 170.212270] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 170.225501] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.566Z level=INFO msg="All 2 paths already cached" worker1 # [ 170.233708] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 170.243277] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 170.331317] nix-daemon[865]: accepted connection from pid 2242, user nix-grpc-daemon (trusted) worker1 # [ 170.351507] nix-daemon[865]: reaped child process 2245, status = succeeded worker1 # [ 170.424026] nix-daemon[865]: accepted connection from pid 2247, user nix-grpc-daemon (trusted) worker1 # [ 170.437191] nix-daemon[865]: reaped child process 2250, status = succeeded lb # [ 170.449340] niks3-server[1129]: 2026/09/22 15:06:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.451919] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.793Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.453285] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.793Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 170.477628] niks3-server[1129]: 2026/09/22 15:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 170.483729] niks3-server[1129]: 2026/09/22 15:06:01 INFO Signed narinfos id=78 count=1 worker1 # [ 170.481363] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.822Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.491565] niks3-server[1129]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 170.505769] niks3-server[1129]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 170.512448] niks3-server[1129]: 2026/09/22 15:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete lb # [ 170.518152] niks3-server[1129]: 2026/09/22 15:06:01 INFO Completed upload id=78 worker1 # [ 170.515161] nix-grpc-daemon[1948]: time=2026-09-22T15:06:01.856Z level=INFO msg="Upload complete. (261ms)" lb # [ 170.521472] niks3-server[1129]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 170.519540] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 170.524599] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 worker1 # [ 170.534966] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 170.542095] nix-daemon[865]: reaped child process 2240, status = succeeded worker1 # [ 170.544947] nix-daemon[865]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 171.371728] nix-daemon[865]: reaped child process 2254, status = succeeded worker1 # [ 171.442708] nix-daemon[865]: accepted connection from pid 2270, user nix-grpc-daemon (trusted) worker1 # [ 171.455744] nix-daemon[865]: reaped child process 2273, status = succeeded lb # [ 171.469872] niks3-server[1129]: 2026/09/22 15:06:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.470901] nix-grpc-daemon[1948]: time=2026-09-22T15:06:02.812Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 171.473056] nix-grpc-daemon[1948]: time=2026-09-22T15:06:02.814Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 171.508220] niks3-server[1129]: 2026/09/22 15:06:02 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 171.516400] niks3-server[1129]: 2026/09/22 15:06:02 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 171.530546] niks3-server[1129]: 2026/09/22 15:06:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 171.534260] niks3-server[1129]: 2026/09/22 15:06:02 INFO Signed narinfos id=79 count=1 worker1 # [ 171.531626] nix-grpc-daemon[1948]: time=2026-09-22T15:06:02.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.540834] niks3-server[1129]: 2026/09/22 15:06:02 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 171.549160] niks3-server[1129]: 2026/09/22 15:06:02 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 171.552505] niks3-server[1129]: 2026/09/22 15:06:02 INFO Completed upload id=79 worker1 # [ 171.547275] nix-grpc-daemon[1948]: time=2026-09-22T15:06:02.888Z level=INFO msg="Upload complete. (195ms)" lb # [ 171.554457] niks3-server[1129]: 2026/09/22 15:06:02 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 171.553456] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35454 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=1 worker1 # [ 171.568072] nix-daemon[865]: reaped child process 2252, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 14.72 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 171.747982] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 37bd0bad5a644c6bb6d8f0f07a99a37b client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 171.874133] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37564 client # [ 171.882866] nix[1541]: don't know how to build these paths: client # [ 171.883708] nix[1541]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 171.878046] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 171.889706] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:03Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 171.898223] nix[1541]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 176.530588] envoy[916]: conn peer=[2001:db8:1::1]:41526 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27038 tx=12297 ms=14549 client # [ 201.898940] nix[1541]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 201.904789] nix[1541]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 201.919273] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 201.921123] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 201.922759] systemd[1]: gpu.service: Consumed 121ms CPU time over 30.173s wall clock time, 37.6M memory peak, 5.2K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.06 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.17 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.91 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 203.856670] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:35Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 204.245075] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37564 worker1 # [ 204.243481] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35454 worker2 # [ 204.273886] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 204.279215] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 204.317735] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 204.329864] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 204.342401] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 204.353494] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 204.453723] nix-daemon[850]: accepted connection from pid 1861, user nix-grpc-daemon (trusted) worker2 # [ 204.468548] nix-daemon[850]: reaped child process 1864, status = succeeded worker2 # [ 204.549188] nix-daemon[850]: accepted connection from pid 1866, user nix-grpc-daemon (trusted) worker2 # [ 204.563053] nix-daemon[850]: reaped child process 1869, status = succeeded lb # [ 204.566510] niks3-server[1129]: 2026/09/22 15:06:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 204.577064] nix-grpc-daemon[1641]: time=2026-09-22T15:06:35.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 204.578897] nix-grpc-daemon[1641]: time=2026-09-22T15:06:35.802Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 204.601600] niks3-server[1129]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 204.612230] niks3-server[1129]: 2026/09/22 15:06:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign worker2 # [ 204.619086] nix-grpc-daemon[1641]: time=2026-09-22T15:06:35.842Z level=INFO msg="Uploading 1 narinfos" lb # [ 204.617621] niks3-server[1129]: 2026/09/22 15:06:35 INFO Signed narinfos id=80 count=1 lb # [ 204.638154] niks3-server[1129]: 2026/09/22 15:06:35 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 204.641483] niks3-server[1129]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 204.644643] niks3-server[1129]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo lb # [ 204.646759] niks3-server[1129]: 2026/09/22 15:06:35 INFO Completed upload id=80 worker2 # [ 204.648782] nix-grpc-daemon[1641]: time=2026-09-22T15:06:35.872Z level=INFO msg="Upload complete. (284ms)" worker2 # [ 204.650885] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 204.655083] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 204.661567] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 204.664116] nix-daemon[850]: reaped child process 1859, status = succeeded worker2 # [ 204.668868] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 206.087447] nix-daemon[850]: reaped child process 1873, status = succeeded worker2 # [ 206.166579] nix-daemon[850]: accepted connection from pid 1889, user nix-grpc-daemon (trusted) worker2 # [ 206.181082] nix-daemon[850]: reaped child process 1892, status = succeeded lb # [ 206.183809] niks3-server[1129]: 2026/09/22 15:06:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.194316] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.417Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 206.196348] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.419Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 206.222052] niks3-server[1129]: 2026/09/22 15:06:37 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 206.232848] niks3-server[1129]: 2026/09/22 15:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 206.238937] niks3-server[1129]: 2026/09/22 15:06:37 INFO Signed narinfos id=81 count=1 worker2 # [ 206.243665] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.467Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.244172] niks3-server[1129]: 2026/09/22 15:06:37 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 206.247395] niks3-server[1129]: 2026/09/22 15:06:37 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 206.254647] niks3-server[1129]: 2026/09/22 15:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 206.259171] niks3-server[1129]: 2026/09/22 15:06:37 INFO Completed upload id=81 worker2 # [ 206.261311] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.485Z level=INFO msg="Upload complete. (184ms)" lb # [ 206.261690] niks3-server[1129]: 2026/09/22 15:06:37 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 206.266969] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=1 worker2 # [ 206.277509] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 206.281628] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 206.289304] nix-daemon[850]: reaped child process 1871, status = succeeded worker2 # [ 206.320848] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 206.330612] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 206.341060] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.564Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 206.348840] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 206.357283] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 206.456212] nix-daemon[850]: accepted connection from pid 1898, user nix-grpc-daemon (trusted) worker2 # [ 206.473384] nix-daemon[850]: reaped child process 1901, status = succeeded lb # [ 206.532353] envoy[916]: conn peer=[2001:db8:1::1]:50766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=561 ms=30033 worker2 # [ 206.557901] nix-daemon[850]: accepted connection from pid 1903, user nix-grpc-daemon (trusted) worker2 # [ 206.572995] nix-daemon[850]: reaped child process 1906, status = succeeded lb # [ 206.576811] niks3-server[1129]: 2026/09/22 15:06:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.587091] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.810Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 206.588585] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.810Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 206.603992] niks3-server[1129]: 2026/09/22 15:06:37 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 206.613322] niks3-server[1129]: 2026/09/22 15:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign worker2 # [ 206.622581] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.846Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.620282] niks3-server[1129]: 2026/09/22 15:06:37 INFO Signed narinfos id=82 count=1 lb # [ 206.627871] niks3-server[1129]: 2026/09/22 15:06:37 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 206.641078] niks3-server[1129]: 2026/09/22 15:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 206.649181] niks3-server[1129]: 2026/09/22 15:06:37 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo lb # [ 206.652058] niks3-server[1129]: 2026/09/22 15:06:37 INFO Completed upload id=82 worker2 # [ 206.654114] nix-grpc-daemon[1641]: time=2026-09-22T15:06:37.877Z level=INFO msg="Upload complete. (286ms)" worker2 # [ 206.657575] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 206.662426] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 206.671874] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 206.681195] nix-daemon[850]: reaped child process 1896, status = succeeded worker2 # [ 206.686584] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 207.528443] nix-daemon[850]: reaped child process 1910, status = succeeded worker2 # [ 207.597741] nix-daemon[850]: accepted connection from pid 1926, user nix-grpc-daemon (trusted) worker2 # [ 207.611952] nix-daemon[850]: reaped child process 1929, status = succeeded lb # [ 207.614843] niks3-server[1129]: 2026/09/22 15:06:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.625440] nix-grpc-daemon[1641]: time=2026-09-22T15:06:38.848Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 207.626959] nix-grpc-daemon[1641]: time=2026-09-22T15:06:38.850Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 207.656948] niks3-server[1129]: 2026/09/22 15:06:38 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 207.668184] niks3-server[1129]: 2026/09/22 15:06:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign worker2 # [ 207.678363] nix-grpc-daemon[1641]: time=2026-09-22T15:06:38.901Z level=INFO msg="Uploading 1 narinfos" lb # [ 207.676497] niks3-server[1129]: 2026/09/22 15:06:38 INFO Signed narinfos id=83 count=1 lb # [ 207.682110] niks3-server[1129]: 2026/09/22 15:06:39 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 207.687640] niks3-server[1129]: 2026/09/22 15:06:39 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 207.699146] niks3-server[1129]: 2026/09/22 15:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 207.702620] niks3-server[1129]: 2026/09/22 15:06:39 INFO Completed upload id=83 worker2 # [ 207.704772] nix-grpc-daemon[1641]: time=2026-09-22T15:06:38.928Z level=INFO msg="Upload complete. (210ms)" lb # [ 207.704528] niks3-server[1129]: 2026/09/22 15:06:39 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 207.715234] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=1 worker2 # [ 207.724384] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:38Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 207.728289] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:38Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 207.731746] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 207.743285] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 207.745522] nix-daemon[850]: reaped child process 1908, status = succeeded worker2 # [ 207.750059] nix-grpc-daemon[1641]: time=2026-09-22T15:06:38.973Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 207.754480] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 207.758490] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 207.855658] nix-daemon[850]: accepted connection from pid 1935, user nix-grpc-daemon (trusted) worker2 # [ 207.872172] nix-daemon[850]: reaped child process 1938, status = succeeded worker2 # [ 207.957691] nix-daemon[850]: accepted connection from pid 1940, user nix-grpc-daemon (trusted) worker2 # [ 207.973407] nix-daemon[850]: reaped child process 1943, status = succeeded lb # [ 207.975637] niks3-server[1129]: 2026/09/22 15:06:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.982058] nix-grpc-daemon[1641]: time=2026-09-22T15:06:39.205Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 207.983397] nix-grpc-daemon[1641]: time=2026-09-22T15:06:39.205Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 207.989490] niks3-server[1129]: 2026/09/22 15:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign lb # [ 207.992368] niks3-server[1129]: 2026/09/22 15:06:39 INFO Signed narinfos id=84 count=1 worker2 # [ 207.994657] nix-grpc-daemon[1641]: time=2026-09-22T15:06:39.218Z level=INFO msg="Uploading 1 narinfos" lb # [ 207.994771] niks3-server[1129]: 2026/09/22 15:06:39 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 207.997651] niks3-server[1129]: 2026/09/22 15:06:39 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 208.002878] niks3-server[1129]: 2026/09/22 15:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 208.005780] niks3-server[1129]: 2026/09/22 15:06:39 INFO Completed upload id=84 worker2 # [ 208.007851] nix-grpc-daemon[1641]: time=2026-09-22T15:06:39.231Z level=INFO msg="Upload complete. (242ms)" worker2 # [ 208.010080] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 208.009061] niks3-server[1129]: 2026/09/22 15:06:39 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 208.013238] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 worker2 # [ 208.018321] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 208.024506] nix-daemon[850]: reaped child process 1933, status = succeeded client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 208.028928] nix-daemon[850]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 209.047225] nix-daemon[850]: reaped child process 1947, status = succeeded worker2 # [ 209.124482] nix-daemon[850]: accepted connection from pid 1963, user nix-grpc-daemon (trusted) worker2 # [ 209.140874] nix-daemon[850]: reaped child process 1966, status = succeeded lb # [ 209.142391] niks3-server[1129]: 2026/09/22 15:06:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 209.148682] nix-grpc-daemon[1641]: time=2026-09-22T15:06:40.372Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 209.150312] nix-grpc-daemon[1641]: time=2026-09-22T15:06:40.374Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 209.161654] niks3-server[1129]: 2026/09/22 15:06:40 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 209.166387] niks3-server[1129]: 2026/09/22 15:06:40 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 209.168470] niks3-server[1129]: 2026/09/22 15:06:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign lb # [ 209.170595] niks3-server[1129]: 2026/09/22 15:06:40 INFO Signed narinfos id=85 count=1 worker2 # [ 209.172667] nix-grpc-daemon[1641]: time=2026-09-22T15:06:40.396Z level=INFO msg="Uploading 1 narinfos" lb # [ 209.174396] niks3-server[1129]: 2026/09/22 15:06:40 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 209.178700] niks3-server[1129]: 2026/09/22 15:06:40 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 209.181785] niks3-server[1129]: 2026/09/22 15:06:40 INFO Completed upload id=85 worker2 # [ 209.183862] nix-grpc-daemon[1641]: time=2026-09-22T15:06:40.407Z level=INFO msg="Upload complete. (147ms)" lb # [ 209.184314] niks3-server[1129]: 2026/09/22 15:06:40 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 209.186683] nix-grpc-daemon[1567]: ts=2026-09-22T15:06:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37564 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=1 worker2 # [ 209.195076] nix-daemon[850]: reaped child process 1945, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.12 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.12 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.09 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 209.860616] nix-grpc-daemon[1888]: ts=2026-09-22T15:06:41Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.47 seconds) (finished: run the VM test script, in 211.50 seconds) test script finished in 211.67s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T15:06:42Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T15:06:42Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T15:06:42Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T15:06:43Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.13 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh