tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb: QEMU running (pid 49) lb # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.qml3liuXEP', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done client # Disk image does not exist, creating the virtualisation disk image... lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # Formatting '/build/vm-state-client/tmp.g9Qg20BDIv', fmt=raw size=1073741824 lb # Filesystem UUID: 9235bbd0-5e56-4e7e-9705-a7600a7783e4 client: QEMU running (pid 50) client # mke2fs 1.47.4 (6-Mar-2025) lb # Superblock backups stored on blocks: worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 52) client # Discarding device blocks: 0/262144 done worker2 # Formatting '/build/vm-state-worker2/tmp.emgRknR60X', fmt=raw size=1073741824 lb # 32768, 98304, 163840, 229376 client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # client # Filesystem UUID: aa7e6a8b-accf-4dca-8a13-28c620627c15 worker2 # Discarding device blocks: 0/262144 done lb # Allocating group tables: 0/8 done client # Superblock backups stored on blocks: worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Writing inode tables: 0/8 done worker1: QEMU running (pid 51) worker2 # Filesystem UUID: 05fdbd80-b498-48ce-95d5-8c5958458133 lb # Creating journal (8192 blocks): done client # 32768, 98304, 163840, 229376 worker1 # Disk image does not exist, creating the virtualisation disk image... worker2 # Superblock backups stored on blocks: lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Formatting '/build/vm-state-worker1/tmp.2kUnJk98D3', fmt=raw size=1073741824 worker2 # 32768, 98304, 163840, 229376 lb # worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # lb # Virtualisation disk image created. worker1 # Discarding device blocks: 0/262144 done worker2 # Allocating group tables: 0/8 done lb # Starting virtiofs daemons... worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Writing inode tables: 0/8 done lb # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # Filesystem UUID: 12f3882e-0173-4aba-8b26-dc31b8bf8bf3 worker2 # Creating journal (8192 blocks): done lb # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # Superblock backups stored on blocks: worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # 32768, 98304, 163840, 229376 (finished: start all VMs, in 0.31 seconds) client # worker1 # client: waiting for unit network-addresses-eth1.service client # Allocating group tables: 0/8 done worker1 # Allocating group tables: 0/8 done client: waiting for the VM to finish booting client # Writing inode tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker2 # worker1 # Creating journal (8192 blocks): done worker2 # Virtualisation disk image created. client # Creating journal (8192 blocks): done lb # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Starting virtiofs daemons... worker2 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Virtualisation disk image created. worker1 # worker2 # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Starting virtiofs daemons... worker1 # Virtualisation disk image created. worker2 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # Starting virtiofs daemons... worker2 # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T04:41:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T04:41:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T04:41:31Z INFO virtiofsd] Client connected, servicing requests client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # lb # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # worker2 # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Booting from ROM... lb # Booting from ROM... worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # worker2 # Booting from ROM... worker1 # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ggsnp37phfgq4b11zirffk4vxgicg7h8-nixos-system-lb-test/init regInfo=/nix/store/94h72crvqzbw5sjsl7v7v31gd90khbjb-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] NX (Execute Disable) protection: active worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9ddfrc7c8w69kr1zczx1vf02afx7i8bp-nixos-system-worker2-test/init regInfo=/nix/store/liiyg21dddxspzy1m75waqzhgqq549bm-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] kvm-clock: using sched offset of 454883244 cycles worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test/init regInfo=/nix/store/fcb5v5vxajs7m326m62jh72759wys78k-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000834] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000836] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.002726] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.002738] Using GB pages for direct mapping worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.002894] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.002902] ACPI: Early table checksum verification disabled worker2 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.002905] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.002910] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.002925] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.002933] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.002935] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.000000] kvm-clock: using sched offset of 462476387 cycles client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.002936] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.002938] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.002939] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.000001] kvm-clock: using sched offset of 468719606 cycles worker2 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.002941] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.002726] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002942] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002738] Using GB pages for direct mapping client # [ 0.000006] tsc: Detected 2400.012 MHz processor worker2 # [ 0.002898] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002943] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002906] ACPI: Early table checksum verification disabled lb # [ 0.002944] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.002910] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.002944] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002914] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002739] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002945] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002918] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002752] Using GB pages for direct mapping lb # [ 0.002945] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.002891] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.002926] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002900] ACPI: Early table checksum verification disabled worker2 # [ 0.002928] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.002946] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.003174] No NUMA configuration found client # [ 0.002903] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002929] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003175] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002907] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002931] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003177] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005399] Zone ranges: client # [ 0.002912] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002933] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005400] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002934] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002919] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005401] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.002921] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.005402] Normal empty worker2 # [ 0.002935] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.005403] Device empty worker2 # [ 0.002937] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.005404] Movable zone start for each node client # [ 0.002923] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005405] Early memory node ranges worker2 # [ 0.002937] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002925] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005405] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.002938] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002926] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005406] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.002938] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.005407] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.002939] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.002928] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.005427] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.002939] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.002929] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.003162] No NUMA configuration found lb # [ 0.005688] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.002930] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.031750] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.003162] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.032216] ACPI: PM-Timer IO Port: 0x608 client # [ 0.002931] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.003165] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.005536] Zone ranges: lb # [ 0.032230] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.002931] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.005537] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/iw1slifxbpr8i9q8sa6lz50n4d12ifxq-nixos-system-worker1-test/init regInfo=/nix/store/dwxwx816vd5bhxzb3g8qmghndnh53gjs-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.032254] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.002932] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.005539] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.005540] Normal empty lb # [ 0.032257] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.005541] Device empty worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.002932] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.032259] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.005542] Movable zone start for each node worker2 # [ 0.005543] Early memory node ranges client # [ 0.002933] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.032260] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.003201] No NUMA configuration found worker2 # [ 0.005543] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.005544] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.032261] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.003202] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.003204] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.032262] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.005545] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.005759] Zone ranges: worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.005565] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.032264] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.005761] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.005983] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.032265] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.005762] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.034752] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.032270] TSC deadline timer available worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.005763] Normal empty worker2 # [ 0.035208] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.032274] CPU topo: Max. logical packages: 1 client # [ 0.005764] Device empty worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.005765] Movable zone start for each node lb # [ 0.032275] CPU topo: Max. logical dies: 1 worker2 # [ 0.035220] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.005766] Early memory node ranges lb # [ 0.032275] CPU topo: Max. dies per package: 1 worker2 # [ 0.035245] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.005766] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.032278] CPU topo: Max. threads per core: 1 worker2 # [ 0.035249] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.032279] CPU topo: Num. cores per package: 1 client # [ 0.005767] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.035250] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.032279] CPU topo: Num. threads per package: 1 worker1 # [ 0.000000] APIC: Static calls initialized client # [ 0.005768] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.035251] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.032280] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.005793] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.035252] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.032302] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.006094] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.035253] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.032335] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.036095] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.035255] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.036573] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.035257] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.032337] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.036586] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.035261] TSC deadline timer available worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.032338] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.035265] CPU topo: Max. logical packages: 1 client # [ 0.036617] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.000001] kvm-clock: using sched offset of 497981280 cycles lb # [ 0.032340] Booting paravirtualized kernel on KVM worker2 # [ 0.035266] CPU topo: Max. logical dies: 1 client # [ 0.036620] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.035266] CPU topo: Max. dies per package: 1 worker2 # [ 0.035269] CPU topo: Max. threads per core: 1 worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.032343] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.036621] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.035270] CPU topo: Num. cores per package: 1 worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.036817] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.035270] CPU topo: Num. threads per package: 1 client # [ 0.036623] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.035271] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.036624] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.038938] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.038982] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.035290] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.036624] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.035324] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.036627] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.036628] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.002748] Using GB pages for direct mapping worker2 # [ 0.035325] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.036632] TSC deadline timer available worker2 # [ 0.035327] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.002893] RAMDISK: [mem 0x5e370000-0x5ffcffff] client # [ 0.036636] CPU topo: Max. logical packages: 1 worker1 # [ 0.002902] ACPI: Early table checksum verification disabled worker2 # [ 0.035329] Booting paravirtualized kernel on KVM client # [ 0.036637] CPU topo: Max. logical dies: 1 worker1 # [ 0.002905] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.036637] CPU topo: Max. dies per package: 1 lb # [ 0.038984] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ggsnp37phfgq4b11zirffk4vxgicg7h8-nixos-system-lb-test/init regInfo=/nix/store/94h72crvqzbw5sjsl7v7v31gd90khbjb-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.035332] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.036641] CPU topo: Max. threads per core: 1 worker1 # [ 0.002909] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036641] CPU topo: Num. cores per package: 1 worker2 # [ 0.039830] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.036641] CPU topo: Num. threads per package: 1 lb # [ 0.039078] Unknown kernel command line parameters "regInfo=/nix/store/94h72crvqzbw5sjsl7v7v31gd90khbjb-closure-info/registration", will be passed to user space. worker2 # [ 0.042117] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.002913] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.039091] random: crng init done worker2 # [ 0.042160] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.036642] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.002919] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.039092] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.036661] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.002921] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.041167] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.036693] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.002923] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.042470] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.036695] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.042503] Fallback order for Node 0: 0 worker1 # [ 0.002924] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036696] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.042162] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9ddfrc7c8w69kr1zczx1vf02afx7i8bp-nixos-system-worker2-test/init regInfo=/nix/store/liiyg21dddxspzy1m75waqzhgqq549bm-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.042506] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.036698] Booting paravirtualized kernel on KVM worker1 # [ 0.002926] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.042507] Policy zone: DMA32 worker2 # [ 0.042260] Unknown kernel command line parameters "regInfo=/nix/store/liiyg21dddxspzy1m75waqzhgqq549bm-closure-info/registration", will be passed to user space. lb # [ 0.045061] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.002927] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.036701] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.042272] random: crng init done lb # [ 0.048259] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.002929] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.041194] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.042273] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.051522] allocated 3145728 bytes of page_ext worker1 # [ 0.002930] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.043499] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.061539] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.044534] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.043546] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.002931] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.061541] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.045672] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.062387] Dynamic Preempt: lazy worker2 # [ 0.045704] Fallback order for Node 0: 0 worker1 # [ 0.002931] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.062547] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.045707] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.002932] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.062548] rcu: RCU event tracing is enabled. worker2 # [ 0.045708] Policy zone: DMA32 worker1 # [ 0.002932] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.062548] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.048338] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.062550] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.002933] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.052136] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.003188] No NUMA configuration found lb # [ 0.062550] Rude variant of Tasks RCU enabled. worker2 # [ 0.055668] allocated 3145728 bytes of page_ext client # [ 0.043548] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test/init regInfo=/nix/store/fcb5v5vxajs7m326m62jh72759wys78k-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.062551] Tracing variant of Tasks RCU enabled. worker2 # [ 0.065956] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.003189] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.065958] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.003191] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.062551] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.066836] Dynamic Preempt: lazy client # [ 0.043645] Unknown kernel command line parameters "regInfo=/nix/store/fcb5v5vxajs7m326m62jh72759wys78k-closure-info/registration", will be passed to user space. worker1 # [ 0.005976] Zone ranges: client # [ 0.043660] random: crng init done lb # [ 0.062552] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.066986] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.005977] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.066986] rcu: RCU event tracing is enabled. client # [ 0.043660] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.005979] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.062579] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.066987] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.005980] Normal empty client # [ 0.045929] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.005981] Device empty worker2 # [ 0.066988] Trampoline variant of Tasks RCU enabled. lb # [ 0.062581] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.005981] Movable zone start for each node worker2 # [ 0.066989] Rude variant of Tasks RCU enabled. client # [ 0.047063] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.005982] Early memory node ranges worker2 # [ 0.066989] Tracing variant of Tasks RCU enabled. client # [ 0.047097] Fallback order for Node 0: 0 lb # [ 0.062582] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.005982] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.066990] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.047100] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.066980] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.005983] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.047101] Policy zone: DMA32 worker2 # [ 0.066991] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.067592] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.005984] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.050051] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.067050] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.006004] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.053531] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.067598] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.006293] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.067051] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.057071] allocated 3145728 bytes of page_ext worker1 # [ 0.035229] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.067318] ftrace: allocating 48787 entries in 192 pages lb # [ 0.067708] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.067052] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.035733] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.071478] Console: colour VGA+ 80x25 client # [ 0.067320] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.071498] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.068204] Dynamic Preempt: lazy worker1 # [ 0.035745] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.071481] printk: legacy console [tty0] enabled client # [ 0.068352] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.071776] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.102435] printk: legacy console [ttyS0] enabled worker1 # [ 0.035773] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.068353] rcu: RCU event tracing is enabled. lb # [ 0.208463] ACPI: Core revision 20250807 worker1 # [ 0.035776] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.071781] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.068353] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.035778] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.068355] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.071897] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.068355] Rude variant of Tasks RCU enabled. worker1 # [ 0.035779] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.209450] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.075422] Console: colour VGA+ 80x25 client # [ 0.068356] Tracing variant of Tasks RCU enabled. worker2 # [ 0.075426] printk: legacy console [tty0] enabled worker1 # [ 0.035780] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.211147] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.104875] printk: legacy console [ttyS0] enabled client # [ 0.068356] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.212183] x2apic enabled worker1 # [ 0.035780] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.199860] ACPI: Core revision 20250807 client # [ 0.068357] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.035783] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.212982] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.035784] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.200700] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.068424] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.035787] TSC deadline timer available worker1 # [ 0.035791] CPU topo: Max. logical packages: 1 worker2 # [ 0.202179] APIC: Switch to symmetric I/O mode setup client # [ 0.068426] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.035792] CPU topo: Max. logical dies: 1 lb # [ 0.214973] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.203104] x2apic enabled worker1 # [ 0.035792] CPU topo: Max. dies per package: 1 client # [ 0.068427] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.035796] CPU topo: Max. threads per core: 1 worker2 # [ 0.203840] APIC: Switched APIC routing to: physical x2apic client # [ 0.072837] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.035797] CPU topo: Num. cores per package: 1 lb # [ 0.215980] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.035797] CPU topo: Num. threads per package: 1 client # [ 0.073125] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.035797] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.205690] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.217723] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.073132] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.035816] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.218820] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.206669] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.035847] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.073244] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.077153] Console: colour VGA+ 80x25 lb # [ 0.219870] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.035849] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.208330] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.077156] printk: legacy console [tty0] enabled worker1 # [ 0.035850] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.220721] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.107705] printk: legacy console [ttyS0] enabled worker2 # [ 0.209414] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.035852] Booting paravirtualized kernel on KVM client # [ 0.211227] ACPI: Core revision 20250807 worker2 # [ 0.210471] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.221724] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.035854] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.211327] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.212123] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.040357] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.222721] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.213702] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.042711] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.214749] x2apic enabled worker2 # [ 0.212332] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.042756] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.223721] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.224720] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.215491] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.214327] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.226436] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.215328] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.217380] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.216327] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.042758] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/iw1slifxbpr8i9q8sa6lz50n4d12ifxq-nixos-system-worker1-test/init regInfo=/nix/store/dwxwx816vd5bhxzb3g8qmghndnh53gjs-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.217327] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.218457] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.042851] Unknown kernel command line parameters "regInfo=/nix/store/dwxwx816vd5bhxzb3g8qmghndnh53gjs-closure-info/registration", will be passed to user space. worker1 # [ 0.042864] random: crng init done client # [ 0.220279] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.227513] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.228728] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.042865] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.222365] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.218327] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.045201] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.223400] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.229519] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.220334] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.046364] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.230721] active return thunk: srso_alias_return_thunk worker1 # [ 0.046400] Fallback order for Node 0: 0 client # [ 0.224277] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.221328] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.046403] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.231746] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.046404] Policy zone: DMA32 worker2 # [ 0.222329] active return thunk: srso_alias_return_thunk client # [ 0.225280] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.049376] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.232720] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.223356] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.052728] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.226276] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.233720] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.056367] allocated 3145728 bytes of page_ext worker2 # [ 0.224327] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.066599] ftrace: allocating 48787 entries in 192 pages client # [ 0.227277] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.234720] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.225327] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.066601] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.067499] Dynamic Preempt: lazy client # [ 0.228276] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.235720] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.226327] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.067643] rcu: Preemptible hierarchical RCU implementation. client # [ 0.229276] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.067643] rcu: RCU event tracing is enabled. worker2 # [ 0.227327] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.237524] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.067644] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.228327] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.238553] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.067646] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.067646] Rude variant of Tasks RCU enabled. worker2 # [ 0.229327] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.239721] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.067646] Tracing variant of Tasks RCU enabled. worker2 # [ 0.230328] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.240720] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.067647] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.230276] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.231327] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.067648] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.241720] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.232284] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.232327] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.067707] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.242720] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.233327] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.233832] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.067710] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.243721] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.234327] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.234277] active return thunk: srso_alias_return_thunk worker1 # [ 0.067710] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.244720] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.235163] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.235327] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.072208] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.072501] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.236276] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.237276] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.072509] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.238276] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.072618] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.076413] Console: colour VGA+ 80x25 client # [ 0.239276] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.076415] printk: legacy console [tty0] enabled worker1 # [ 0.108595] printk: legacy console [ttyS0] enabled client # [ 0.240276] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.210805] ACPI: Core revision 20250807 client # [ 0.241276] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.242276] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.211736] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.213333] APIC: Switch to symmetric I/O mode setup client # [ 0.243276] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.214373] x2apic enabled client # [ 0.244276] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.215117] APIC: Switched APIC routing to: physical x2apic client # [ 0.245276] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.246276] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.217041] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.247276] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.218075] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.219792] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.220877] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.222918] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.223789] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.224793] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.225789] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.226789] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.227788] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.228789] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.229788] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.231797] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.232789] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.233790] active return thunk: srso_alias_return_thunk worker1 # [ 0.234685] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.279192] Freeing SMP alternatives memory: 44K lb # [ 0.279723] pid_max: default: 32768 minimum: 301 worker2 # [ 0.271368] Freeing SMP alternatives memory: 44K worker1 # [ 0.235788] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.272144] pid_max: default: 32768 minimum: 301 lb # [ 0.280810] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.236788] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.281835] landlock: Up and running. worker2 # [ 0.272950] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.237788] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.282721] Yama: becoming mindful. worker2 # [ 0.273435] landlock: Up and running. worker2 # [ 0.274328] Yama: becoming mindful. worker1 # [ 0.238788] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.283558] LSM support for eBPF active worker2 # [ 0.275449] LSM support for eBPF active worker1 # [ 0.239788] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.284286] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.276179] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.240789] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.284759] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.277370] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.241789] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.243788] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.288071] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.244788] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.279667] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.245788] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.289291] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.280906] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.246788] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.289730] ... version: 2 worker2 # [ 0.281336] ... version: 2 lb # [ 0.290490] ... bit width: 48 worker2 # [ 0.282024] ... bit width: 48 worker1 # [ 0.247789] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.282331] ... generic counters: 6 lb # [ 0.290724] ... generic counters: 6 client # [ 0.283734] Freeing SMP alternatives memory: 44K worker2 # [ 0.283014] ... generic bitmap: 000000000000003f lb # [ 0.291456] ... generic bitmap: 000000000000003f worker2 # [ 0.283329] ... fixed-purpose counters: 0 client # [ 0.284281] pid_max: default: 32768 minimum: 301 lb # [ 0.291723] ... fixed-purpose counters: 0 worker2 # [ 0.283996] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.292488] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.285382] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.284329] ... value mask: 0000ffffffffffff lb # [ 0.292724] ... value mask: 0000ffffffffffff client # [ 0.286413] landlock: Up and running. worker2 # [ 0.285186] ... max period: 00007fffffffffff lb # [ 0.293659] ... max period: 00007fffffffffff client # [ 0.287820] Yama: becoming mindful. worker2 # [ 0.285984] ... global_ctrl mask: 000000000000003f lb # [ 0.294447] ... global_ctrl mask: 000000000000003f worker2 # [ 0.286433] signal: max sigframe size: 3376 client # [ 0.288531] LSM support for eBPF active lb # [ 0.294820] signal: max sigframe size: 3376 worker2 # [ 0.287223] rcu: Hierarchical SRCU implementation. lb # [ 0.295657] rcu: Hierarchical SRCU implementation. worker2 # [ 0.287902] rcu: Max phase no-delay instances is 400. client # [ 0.289455] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.296354] rcu: Max phase no-delay instances is 400. client # [ 0.291326] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.294703] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.293017] smp: Bringing up secondary CPUs ... worker2 # [ 0.293345] smp: Brought up 1 node, 1 CPU lb # [ 0.301364] smp: Bringing up secondary CPUs ... client # [ 0.295969] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.301737] smp: Brought up 1 node, 1 CPU worker2 # [ 0.293991] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.296283] ... version: 2 lb # [ 0.302456] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.297072] ... bit width: 48 client # [ 0.297279] ... generic counters: 6 worker2 # [ 0.294549] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) client # [ 0.298036] ... generic bitmap: 000000000000003f worker2 # [ 0.295636] devtmpfs: initialized lb # [ 0.302898] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) client # [ 0.298339] ... fixed-purpose counters: 0 lb # [ 0.303961] devtmpfs: initialized worker2 # [ 0.296468] x86/mm: Memory block size: 128MB client # [ 0.299121] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.304743] x86/mm: Memory block size: 128MB client # [ 0.300028] ... value mask: 0000ffffffffffff worker2 # [ 0.298273] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.300279] ... max period: 00007fffffffffff lb # [ 0.306606] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.301260] ... global_ctrl mask: 000000000000003f worker2 # [ 0.299224] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.302153] signal: max sigframe size: 3376 worker2 # [ 0.300447] pinctrl core: initialized pinctrl subsystem lb # [ 0.307648] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.302896] rcu: Hierarchical SRCU implementation. worker2 # [ 0.301515] PM: RTC time: 04:41:31, date: 2026-09-23 lb # [ 0.308817] pinctrl core: initialized pinctrl subsystem client # [ 0.303282] rcu: Max phase no-delay instances is 400. lb # [ 0.309993] PM: RTC time: 04:41:31, date: 2026-09-23 worker2 # [ 0.305570] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.313441] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.306850] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.308909] smp: Bringing up secondary CPUs ... lb # [ 0.314233] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.309293] smp: Brought up 1 node, 1 CPU worker2 # [ 0.307356] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.314745] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.310039] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.308618] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.309340] audit: initializing netlink subsys (disabled) lb # [ 0.315997] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.283612] Freeing SMP alternatives memory: 44K lb # [ 0.316733] audit: initializing netlink subsys (disabled) client # [ 0.310490] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.310483] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.284364] pid_max: default: 32768 minimum: 301 client # [ 0.311562] devtmpfs: initialized worker2 # [ 0.310486] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.317940] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.284880] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.311331] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.312499] x86/mm: Memory block size: 128MB lb # [ 0.317942] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.285898] landlock: Up and running. worker2 # [ 0.312237] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.287262] Yama: becoming mindful. lb # [ 0.318724] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.313025] audit: type=2000 audit(1790138492.663:1): state=initialized audit_enabled=0 res=1 client # [ 0.314307] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.288004] LSM support for eBPF active lb # [ 0.319711] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.314332] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.288897] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.314349] cpuidle: using governor menu lb # [ 0.320516] audit: type=2000 audit(1790138492.646:1): state=initialized audit_enabled=0 res=1 client # [ 0.315307] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.316380] pinctrl core: initialized pinctrl subsystem lb # [ 0.322725] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.289833] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.316531] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.322739] cpuidle: using governor menu client # [ 0.317551] PM: RTC time: 04:41:31, date: 2026-09-23 worker2 # [ 0.317622] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.325084] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.292776] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.318333] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.319345] PCI: Using configuration type 1 for base access lb # [ 0.325990] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.293373] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.293793] ... version: 2 client # [ 0.321226] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.326726] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.320470] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.294512] ... bit width: 48 lb # [ 0.327735] PCI: Using configuration type 1 for base access worker1 # [ 0.294791] ... generic counters: 6 client # [ 0.322579] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.295529] ... generic bitmap: 000000000000003f lb # [ 0.328878] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.323305] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.295802] ... fixed-purpose counters: 0 worker1 # [ 0.296534] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.324579] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.296791] ... value mask: 0000ffffffffffff client # [ 0.325290] audit: initializing netlink subsys (disabled) worker1 # [ 0.297691] ... max period: 00007fffffffffff worker2 # [ 0.325613] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.298438] ... global_ctrl mask: 000000000000003f client # [ 0.326280] audit: type=2000 audit(1790138492.669:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.326331] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.298904] signal: max sigframe size: 3376 client # [ 0.327502] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.333978] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.299729] rcu: Hierarchical SRCU implementation. worker1 # [ 0.300394] rcu: Max phase no-delay instances is 400. client # [ 0.327504] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.334725] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.328280] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.329280] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.331331] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.330278] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.331292] cpuidle: using governor menu worker2 # [ 0.332330] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.339724] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.333526] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.305755] smp: Bringing up secondary CPUs ... lb # [ 0.340723] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.306388] smp: Brought up 1 node, 1 CPU client # [ 0.334539] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.306792] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.335282] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.336290] PCI: Using configuration type 1 for base access worker1 # [ 0.307999] Memory: 1454628K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker1 # [ 0.309055] devtmpfs: initialized client # [ 0.337407] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.309943] x86/mm: Memory block size: 128MB worker2 # [ 0.342696] ACPI: Added _OSI(Module Device) worker1 # [ 0.311765] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.343331] ACPI: Added _OSI(Processor Device) worker1 # [ 0.312696] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.344083] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.342532] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.313862] pinctrl core: initialized pinctrl subsystem lb # [ 0.351142] ACPI: Added _OSI(Module Device) client # [ 0.343280] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.351725] ACPI: Added _OSI(Processor Device) worker1 # [ 0.314984] PM: RTC time: 04:41:31, date: 2026-09-23 lb # [ 0.352534] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.318670] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.348280] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.320078] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.349279] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.320815] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.352399] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.359653] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.322090] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.322802] audit: initializing netlink subsys (disabled) worker1 # [ 0.323966] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.356759] ACPI: Interpreter enabled worker1 # [ 0.323969] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.357347] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.324792] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.358073] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.325735] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.365694] ACPI: Interpreter enabled lb # [ 0.366217] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.326537] audit: type=2000 audit(1790138492.700:1): state=initialized audit_enabled=0 res=1 lb # [ 0.366724] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.327794] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.359703] ACPI: Added _OSI(Module Device) worker2 # [ 0.360370] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.327806] cpuidle: using governor menu client # [ 0.360280] ACPI: Added _OSI(Processor Device) worker2 # [ 0.361330] PCI: Using E820 reservations for host bridge windows lb # [ 0.367644] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.361041] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.330041] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.331029] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.364395] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.331794] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.332803] PCI: Using configuration type 1 for base access lb # [ 0.372724] PCI: Using E820 reservations for host bridge windows lb # [ 0.373861] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.333963] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.369486] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.371973] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.372336] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.373408] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.381391] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.341102] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.373698] ACPI: Interpreter enabled worker2 # [ 0.374453] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.374294] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.341792] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.381731] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.375001] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.375714] PCI host bridge to bus 0000:00 lb # [ 0.382801] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.376335] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.383847] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.377330] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.385092] PCI host bridge to bus 0000:00 worker2 # [ 0.378330] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.377331] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.385727] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.346793] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.378279] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.379330] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.347792] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.386723] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.380330] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.387723] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.381330] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.381416] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.388723] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.382330] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.389723] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.383280] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.390723] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.384794] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.391724] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.392725] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.357119] ACPI: Added _OSI(Module Device) lb # [ 0.394182] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.388756] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.357792] ACPI: Added _OSI(Processor Device) worker1 # [ 0.358550] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.389285] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.390358] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.391409] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.392649] PCI host bridge to bus 0000:00 client # [ 0.393283] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.387430] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.394279] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.396912] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.388484] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.365383] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.395278] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.397740] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.389355] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.398791] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.396279] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.390734] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.397278] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.400048] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.398279] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.369211] ACPI: Interpreter enabled worker2 # [ 0.392134] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.369806] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.399284] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.370551] ACPI: Using IOAPIC for interrupt routing lb # [ 0.401528] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.400330] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.395368] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.401838] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.396268] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.404760] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.372836] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.405677] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.397080] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.373792] PCI: Using E820 reservations for host bridge windows lb # [ 0.406496] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.398190] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.407595] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.376915] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.399702] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.409784] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.402379] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.403295] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.412689] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.404123] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.404360] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.413400] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.405294] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.413745] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.406303] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.405874] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.385016] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.415304] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.407463] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.385798] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.408276] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.386870] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.409020] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.409020] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.387919] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.409352] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.418708] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.389139] PCI host bridge to bus 0000:00 lb # [ 0.419435] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.389795] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.411309] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.410891] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.419748] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.390791] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.412205] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.391791] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.421370] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.413139] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.392791] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.414284] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.393791] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.413367] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.422754] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.415858] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.414962] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.394791] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.423664] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.395791] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.415352] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.416336] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.417308] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.396781] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.424754] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.418203] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.425730] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.417877] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.398253] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.419099] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.427323] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.419342] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.420826] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.420273] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.428759] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.429745] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.422323] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.421818] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.423231] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.431353] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.424112] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.423342] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.424335] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.425764] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.400934] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.433390] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.425910] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.401805] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.433752] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.402818] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.427372] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.404137] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.428315] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.428352] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.436239] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.429287] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.405583] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.430301] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.430429] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.438743] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.431286] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.439747] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.432916] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.407800] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.432382] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.408655] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.433352] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.442073] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.434267] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.409575] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.434909] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.435080] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.410798] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.443737] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.444749] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.412385] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.436834] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.437306] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.446294] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.439280] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.413800] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.438003] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.440284] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.414648] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.438352] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.415538] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.448690] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.441871] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.439874] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.416395] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.449723] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.443293] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.441338] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.450745] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.442187] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.444294] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.443117] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.418800] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.452309] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.419654] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.446321] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.420552] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.454404] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.444795] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.448148] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.454731] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.422250] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.446052] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.449102] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.455748] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.446529] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.450760] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.423798] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.448015] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.424654] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.457314] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.448532] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.452315] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.425546] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.458558] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.450013] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.425799] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.453251] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.459630] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.454303] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.427370] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.461465] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.455928] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.428641] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.461931] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.429549] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.457313] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.463419] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.458252] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.431279] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.459099] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.432779] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.460863] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.433817] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.461874] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.435452] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.450586] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.462495] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.437606] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.463858] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.438585] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.464516] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.440242] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.465832] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.453382] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.441805] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.464022] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.454578] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.442816] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.455652] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.444353] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.467512] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.456592] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.468792] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.445812] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.446716] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.470080] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.459346] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.447579] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.460238] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.471030] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.449256] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.461661] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.473496] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.463058] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.466536] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.450799] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.474408] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.451716] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.452555] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.475860] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.466379] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.454280] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.477650] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.469939] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.467434] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.455425] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.468432] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.470595] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.469646] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.456013] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.471615] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.470427] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.481864] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.471428] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.457810] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.472569] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.482834] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.472430] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.458875] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.484081] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.473457] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.460327] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.474364] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.484825] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.475231] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.475273] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.485830] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.475960] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.476076] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.486825] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.476345] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.476623] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.487831] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.477316] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.488840] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.477912] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.478072] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.489765] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.479079] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.479344] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.490739] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.491738] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.481288] iommu: Default domain type: Translated client # [ 0.481613] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.492739] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.481930] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.482388] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.493738] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.482601] ACPI: bus type USB registered lb # [ 0.494735] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.483387] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.483351] usbcore: registered new interface driver usbfs lb # [ 0.495734] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.484238] usbcore: registered new interface driver hub client # [ 0.484380] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.461020] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.484997] usbcore: registered new device driver usb lb # [ 0.496734] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.485378] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.463335] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.486246] NetLabel: Initializing client # [ 0.486384] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.498834] iommu: Default domain type: Translated worker2 # [ 0.486774] NetLabel: domain hash size = 128 client # [ 0.487381] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.499680] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.464099] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.487330] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.500751] ACPI: bus type USB registered worker2 # [ 0.488324] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.465112] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.488379] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.489248] PCI: Using ACPI for IRQ routing lb # [ 0.501535] usbcore: registered new interface driver usbfs client # [ 0.490150] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.502655] usbcore: registered new interface driver hub worker1 # [ 0.466062] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.491100] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.503500] usbcore: registered new device driver usb worker1 # [ 0.467640] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.492076] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.505301] NetLabel: Initializing worker1 # [ 0.468507] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.505724] NetLabel: domain hash size = 128 client # [ 0.493296] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.494293] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.469124] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.495294] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.506535] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.507766] NetLabel: unlabeled traffic allowed by default client # [ 0.496291] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.508736] PCI: Using ACPI for IRQ routing client # [ 0.497293] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.472811] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.499379] iommu: Default domain type: Translated client # [ 0.500253] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.501357] ACPI: bus type USB registered client # [ 0.502151] usbcore: registered new interface driver usbfs worker1 # [ 0.477301] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.503172] usbcore: registered new interface driver hub client # [ 0.504061] usbcore: registered new device driver usb worker1 # [ 0.477901] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.478894] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.506119] NetLabel: Initializing worker1 # [ 0.479891] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.506762] NetLabel: domain hash size = 128 client # [ 0.507278] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.480902] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.508330] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.481898] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.509292] PCI: Using ACPI for IRQ routing worker1 # [ 0.482898] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.483895] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.484832] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.485806] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.486806] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.487806] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.488802] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.489805] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.490803] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.491803] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.493907] iommu: Default domain type: Translated worker1 # [ 0.494799] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.496104] ACPI: bus type USB registered worker1 # [ 0.496863] usbcore: registered new interface driver usbfs worker1 # [ 0.497804] usbcore: registered new interface driver hub worker1 # [ 0.498800] usbcore: registered new device driver usb worker1 # [ 0.500700] NetLabel: Initializing worker1 # [ 0.501240] NetLabel: domain hash size = 128 worker1 # [ 0.501791] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.502827] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.503859] PCI: Using ACPI for IRQ routing worker2 # [ 0.533609] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.534326] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.534326] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.534334] vgaarb: loaded worker2 # [ 0.535052] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.535331] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.538418] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.541977] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.542700] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.544018] pnp: PnP ACPI init worker2 # [ 0.544904] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.561466] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.545936] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.561719] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.547424] pnp: PnP ACPI: found 5 devices lb # [ 0.561719] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.561727] vgaarb: loaded lb # [ 0.562607] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.563411] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.555030] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.566820] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.556630] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.557641] NET: Registered PF_INET protocol family client # [ 0.560643] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.561275] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.558808] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.570610] VFS: Disk quotas dquot_6.6.0 client # [ 0.561275] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.571440] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.561284] vgaarb: loaded lb # [ 0.572922] pnp: PnP ACPI init client # [ 0.562060] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.573777] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.562930] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.574890] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.576597] pnp: PnP ACPI: found 5 devices client # [ 0.565492] clocksource: Switched to clocksource kvm-clock client # [ 0.569581] VFS: Disk quotas dquot_6.6.0 client # [ 0.570324] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.571828] pnp: PnP ACPI init client # [ 0.572773] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.584343] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.585916] clocksource: Switched to clocksource acpi_pm client # [ 0.573879] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.575464] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.586990] NET: Registered PF_INET protocol family worker1 # [ 0.550837] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.575598] pnp: PnP ACPI: found 5 devices worker1 # [ 0.551787] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.577014] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.588219] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.551787] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.578271] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.551795] vgaarb: loaded worker2 # [ 0.579590] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.552556] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.580797] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.552793] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.581895] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.583298] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.583376] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.584587] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.555880] clocksource: Switched to clocksource kvm-clock client # [ 0.584928] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.585967] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.586037] NET: Registered PF_INET protocol family worker2 # [ 0.587053] NET: Registered PF_XDP protocol family worker2 # [ 0.588066] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.559429] VFS: Disk quotas dquot_6.6.0 client # [ 0.587342] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.589217] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.560218] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.561636] pnp: PnP ACPI init worker2 # [ 0.590403] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.562476] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.591758] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.563481] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.592982] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.565037] pnp: PnP ACPI: found 5 devices worker2 # [ 0.594235] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.604998] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.595971] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.606574] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.607879] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.598294] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.609216] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.610446] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.600730] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.611532] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.612761] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.572730] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.602819] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.613919] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.574238] clocksource: Switched to clocksource acpi_pm lb # [ 0.615161] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.604581] PCI: CLS 0 bytes, default 64 worker1 # [ 0.575308] NET: Registered PF_INET protocol family lb # [ 0.616113] NET: Registered PF_XDP protocol family lb # [ 0.616969] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.605488] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.576560] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.604873] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.607166] Trying to unpack rootfs image as initramfs... lb # [ 0.618029] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.606552] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.619096] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.607970] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.620292] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.621476] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.609554] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.622632] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.610917] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.624405] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.612227] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.613575] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.626716] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.614735] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.616082] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.628674] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.617134] NET: Registered PF_XDP protocol family client # [ 0.618050] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.630687] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.619167] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.632406] PCI: CLS 0 bytes, default 64 client # [ 0.620225] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.621431] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.633338] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.622631] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.635108] Trying to unpack rootfs image as initramfs... worker1 # [ 0.594211] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.623805] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.595794] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.625671] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.597177] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.598581] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.628139] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.599914] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.601035] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.630166] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.602304] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.632076] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.603339] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.604544] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.633809] PCI: CLS 0 bytes, default 64 worker1 # [ 0.605569] NET: Registered PF_XDP protocol family worker1 # [ 0.606375] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.634810] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.607370] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.636655] Trying to unpack rootfs image as initramfs... worker1 # [ 0.608383] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.609529] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.610646] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.611776] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.613600] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.615701] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.617695] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.619662] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.621396] PCI: CLS 0 bytes, default 64 worker1 # [ 0.622429] Trying to unpack rootfs image as initramfs... worker2 # [ 0.654018] Initialise system trusted keyrings worker1 # [ 0.624433] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.656653] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.679315] Initialise system trusted keyrings lb # [ 0.682198] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.681524] Key type asymmetric registered worker2 # [ 0.682374] Asymmetric key parser 'x509' registered client # [ 0.682740] Initialise system trusted keyrings worker2 # [ 0.685635] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.687127] io scheduler mq-deadline registered client # [ 0.686223] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.688035] io scheduler kyber registered lb # [ 0.703495] Key type asymmetric registered worker2 # [ 0.692260] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.704243] Asymmetric key parser 'x509' registered worker2 # [ 0.693577] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.705104] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.665721] Initialise system trusted keyrings worker2 # [ 0.697252] Linux agpgart interface v0.103 worker2 # [ 0.698049] ACPI: bus type drm_connector registered worker1 # [ 0.669358] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.710282] io scheduler mq-deadline registered lb # [ 0.711042] io scheduler kyber registered worker2 # [ 0.703075] usbcore: registered new interface driver usbserial_generic lb # [ 0.714745] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.704143] usbserial: USB Serial support registered for generic lb # [ 0.716092] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.705245] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.705245] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.707658] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.707702] Key type asymmetric registered lb # [ 0.719938] Linux agpgart interface v0.103 lb # [ 0.720762] ACPI: bus type drm_connector registered client # [ 0.710181] Asymmetric key parser 'x509' registered client # [ 0.711096] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.713748] drop_monitor: Initializing network drop monitor service lb # [ 0.725573] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.714899] NET: Registered PF_INET6 protocol family client # [ 0.714307] io scheduler mq-deadline registered lb # [ 0.726687] usbserial: USB Serial support registered for generic client # [ 0.715091] io scheduler kyber registered worker2 # [ 0.718238] Segment Routing with IPv6 lb # [ 0.730156] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.690800] Key type asymmetric registered client # [ 0.719391] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.730156] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.721599] In-situ OAM (IOAM) with IPv6 lb # [ 0.732493] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.720788] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.722668] IPI shorthand broadcast: enabled worker1 # [ 0.693315] Asymmetric key parser 'x509' registered worker1 # [ 0.694180] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.736285] drop_monitor: Initializing network drop monitor service lb # [ 0.737522] NET: Registered PF_INET6 protocol family worker1 # [ 0.697426] io scheduler mq-deadline registered client # [ 0.726367] Linux agpgart interface v0.103 worker1 # [ 0.698193] io scheduler kyber registered client # [ 0.727172] ACPI: bus type drm_connector registered lb # [ 0.740603] Segment Routing with IPv6 worker1 # [ 0.700967] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.730611] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.731349] sched_clock: Marking stable (598020458, 132545167)->(809289733, -78724108) client # [ 0.731852] usbserial: USB Serial support registered for generic lb # [ 0.744177] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.704315] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.745321] IPI shorthand broadcast: enabled worker2 # [ 0.734947] registered taskstats version 1 worker2 # [ 0.736095] Loading compiled-in X.509 certificates client # [ 0.735177] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.707951] Linux agpgart interface v0.103 client # [ 0.735177] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.708745] ACPI: bus type drm_connector registered client # [ 0.737587] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.711866] usbcore: registered new interface driver usbserial_generic client # [ 0.741357] drop_monitor: Initializing network drop monitor service worker1 # [ 0.713007] usbserial: USB Serial support registered for generic lb # [ 0.753724] sched_clock: Marking stable (608014288, 145121710)->(833257524, -80121526) client # [ 0.742635] NET: Registered PF_INET6 protocol family lb # [ 0.757226] registered taskstats version 1 worker1 # [ 0.716322] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.716322] Please enable it if your BIOS has the CPPC option. lb # [ 0.758203] Loading compiled-in X.509 certificates worker1 # [ 0.718605] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.747775] Segment Routing with IPv6 client # [ 0.751214] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.723472] drop_monitor: Initializing network drop monitor service client # [ 0.752383] IPI shorthand broadcast: enabled worker1 # [ 0.724664] NET: Registered PF_INET6 protocol family worker1 # [ 0.726777] Segment Routing with IPv6 worker2 # [ 0.756203] Demotion targets for Node 0: null worker2 # [ 0.758628] Key type .fscrypt registered worker1 # [ 0.729328] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.759382] Key type fscrypt-provisioning registered worker1 # [ 0.730460] IPI shorthand broadcast: enabled worker2 # [ 0.760422] ima: No TPM chip found, activating TPM-bypass! client # [ 0.760781] sched_clock: Marking stable (618016795, 142143084)->(840591887, -80432008) worker2 # [ 0.765573] ima: Allocated hash algorithm: sha1 lb # [ 0.777153] Demotion targets for Node 0: null worker2 # [ 0.766329] ima: No architecture policies found lb # [ 0.778023] Key type .fscrypt registered client # [ 0.766318] registered taskstats version 1 client # [ 0.767360] Loading compiled-in X.509 certificates worker2 # [ 0.768571] PM: Magic number: 10:302:667 worker1 # [ 0.738838] sched_clock: Marking stable (596014620, 142278353)->(813041135, -74748162) lb # [ 0.781142] Key type fscrypt-provisioning registered worker2 # [ 0.770197] RAS: Correctable Errors collector initialized. lb # [ 0.782073] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.782988] ima: Allocated hash algorithm: sha1 worker1 # [ 0.744504] registered taskstats version 1 lb # [ 0.785173] ima: No architecture policies found worker1 # [ 0.745515] Loading compiled-in X.509 certificates lb # [ 0.786153] PM: Magic number: 10:302:667 lb # [ 0.787689] RAS: Correctable Errors collector initialized. worker2 # [ 0.781961] clk: Disabling unused clocks worker2 # [ 0.782797] PM: genpd: Disabling unused power domains lb # [ 0.797838] clk: Disabling unused clocks client # [ 0.786310] Demotion targets for Node 0: null client # [ 0.787317] Key type .fscrypt registered client # [ 0.788024] Key type fscrypt-provisioning registered lb # [ 0.800163] PM: genpd: Disabling unused power domains client # [ 0.791309] ima: No TPM chip found, activating TPM-bypass! client # [ 0.792285] ima: Allocated hash algorithm: sha1 worker1 # [ 0.764308] Demotion targets for Node 0: null worker1 # [ 0.765207] Key type .fscrypt registered client # [ 0.795175] ima: No architecture policies found worker1 # [ 0.767304] Key type fscrypt-provisioning registered client # [ 0.796269] PM: Magic number: 10:302:667 worker1 # [ 0.768271] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.769223] ima: Allocated hash algorithm: sha1 client # [ 0.798067] RAS: Correctable Errors collector initialized. worker1 # [ 0.773332] ima: No architecture policies found worker1 # [ 0.774353] PM: Magic number: 10:302:667 worker1 # [ 0.776054] RAS: Correctable Errors collector initialized. client # [ 0.809014] clk: Disabling unused clocks client # [ 0.811193] PM: genpd: Disabling unused power domains worker1 # [ 0.785092] clk: Disabling unused clocks worker1 # [ 0.788324] PM: genpd: Disabling unused power domains lb # [ 0.963623] Freeing initrd memory: 29064K lb # [ 0.966902] Freeing unused decrypted memory: 2028K lb # [ 0.970433] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.971664] Write protecting the kernel read-only data: 32768k lb # [ 0.973740] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.975403] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.980940] Freeing initrd memory: 29060K client # [ 0.982346] Freeing initrd memory: 29056K worker2 # [ 0.984695] Freeing unused decrypted memory: 2028K client # [ 0.985870] Freeing unused decrypted memory: 2028K worker2 # [ 0.987477] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.988640] Write protecting the kernel read-only data: 32768k client # [ 0.988865] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.990719] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.990014] Write protecting the kernel read-only data: 32768k worker1 # [ 0.962725] Freeing initrd memory: 29056K worker2 # [ 0.992267] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.991990] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.993582] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.965962] Freeing unused decrypted memory: 2028K worker1 # [ 0.968703] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.969803] Write protecting the kernel read-only data: 32768k worker1 # [ 0.971707] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.973222] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 1.026670] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.027869] Run /init as init process lb # [ 1.040727] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.045049] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 1.044506] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.046257] Run /init as init process client # [ 1.045648] Run /init as init process lb # [ 1.061616] fuse: init (API version 7.45) worker1 # [ 1.025268] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.026409] Run /init as init process client # [ 1.057387] systemd[1]: Inserted module 'autofs4' lb # [ 1.069465] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.058661] systemd[1]: Inserted module 'autofs4' lb # [ 1.072395] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.075691] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.037523] systemd[1]: Inserted module 'autofs4' lb # [ 1.077938] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.083808] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.085475] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.077514] fuse: init (API version 7.45) worker2 # [ 1.078643] fuse: init (API version 7.45) lb # [ 1.093540] virtiofs virtio6: discovered new tag: shared lb # [ 1.095342] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.084987] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.086092] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.057351] fuse: init (API version 7.45) client # [ 1.087658] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.088613] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.099517] virtiofs virtio7: discovered new tag: xchg lb # [ 1.101293] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.092221] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.091645] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.064737] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.094392] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.093812] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.067184] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.099401] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.070207] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.099633] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.101102] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.072308] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.101566] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.077558] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.108026] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.079075] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.109872] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.111419] virtiofs virtio6: discovered new tag: shared client # [ 1.113073] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.114699] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.085408] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.086871] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.116319] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.127484] systemd[1]: Successfully made /usr/ read-only. client # [ 1.118045] virtiofs virtio7: discovered new tag: xchg client # [ 1.119680] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.091812] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.093452] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.139346] systemd[1]: Successfully made /usr/ read-only. client # [ 1.142202] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.115154] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.464332] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.476412] systemd[1]: Detected virtualization kvm. lb # [ 1.478623] systemd[1]: Detected architecture x86-64. lb # [ 1.480781] systemd[1]: Running in initrd. lb # [ 1.483364] systemd[1]: Initializing machine ID from random generator. lb # [ 1.486281] systemd[1]: Hostname set to . worker2 # [ 1.475082] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.481034] systemd[1]: Detected virtualization kvm. worker2 # [ 1.482078] systemd[1]: Detected architecture x86-64. client # [ 1.477822] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.483121] systemd[1]: Running in initrd. client # [ 1.482827] systemd[1]: Detected virtualization kvm. worker1 # [ 1.450698] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.483721] systemd[1]: Detected architecture x86-64. worker1 # [ 1.455344] systemd[1]: Detected virtualization kvm. worker2 # [ 1.484436] systemd[1]: Initializing machine ID from random generator. client # [ 1.484612] systemd[1]: Running in initrd. worker1 # [ 1.456172] systemd[1]: Detected architecture x86-64. worker2 # [ 1.485908] systemd[1]: Hostname set to . worker1 # [ 1.456999] systemd[1]: Running in initrd. client # [ 1.485711] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.458108] systemd[1]: Initializing machine ID from random generator. client # [ 1.486913] systemd[1]: Hostname set to . worker1 # [ 1.459271] systemd[1]: Hostname set to . client # [ 1.682775] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.656817] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.687056] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.710286] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.721202] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.694661] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.724486] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.725428] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.725639] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.727018] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.698639] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.728081] systemd[1]: Reached target Path Units. worker1 # [ 1.699742] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.728918] systemd[1]: Reached target Slice Units. worker2 # [ 1.729844] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.729823] systemd[1]: Reached target Swaps. worker1 # [ 1.701071] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.730608] systemd[1]: Reached target Timer Units. worker2 # [ 1.731022] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.702113] systemd[1]: Reached target Path Units. worker1 # [ 1.702942] systemd[1]: Reached target Slice Units. worker2 # [ 1.732383] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.731544] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.703767] systemd[1]: Reached target Swaps. worker2 # [ 1.733448] systemd[1]: Reached target Path Units. client # [ 1.732702] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.704524] systemd[1]: Reached target Timer Units. worker2 # [ 1.734304] systemd[1]: Reached target Slice Units. client # [ 1.733821] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.705442] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.735174] systemd[1]: Reached target Swaps. client # [ 1.734788] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.735979] systemd[1]: Reached target Timer Units. worker1 # [ 1.706575] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.735767] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.707697] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.736948] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.736688] systemd[1]: Reached target Socket Units. worker1 # [ 1.708644] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.738154] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.709599] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.739316] systemd[1]: Listening on Journal Sockets. client # [ 1.738433] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.710503] systemd[1]: Reached target Socket Units. worker2 # [ 1.740286] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.741343] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.712172] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.742289] systemd[1]: Reached target Socket Units. client # [ 1.743228] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.744138] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.716364] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.748630] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.763785] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.768545] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.769931] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.771462] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.772672] systemd[1]: Reached target Path Units. lb # [ 1.773663] systemd[1]: Reached target Slice Units. client # [ 1.751230] systemd[1]: Starting Journal Service... lb # [ 1.774623] systemd[1]: Reached target Swaps. lb # [ 1.775500] systemd[1]: Reached target Timer Units. worker1 # [ 1.724903] systemd[1]: Starting Journal Service... lb # [ 1.776580] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.777867] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.779071] systemd[1]: Listening on Journal Sockets. lb # [ 1.780061] systemd[1]: Listening on udev Control Socket. lb # [ 1.781158] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.759632] systemd[1]: Starting Journal Service... lb # [ 1.782161] systemd[1]: Reached target Socket Units. lb # [ 1.784053] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.788024] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.776804] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.750491] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.782155] systemd[1]: Starting Load Kernel Modules... client # [ 1.781288] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.754438] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.786692] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.789230] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.762483] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.793741] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.797859] systemd[1]: Starting Journal Service... client # [ 1.801589] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.773829] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.803271] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.775637] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.807110] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.808979] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.780890] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.809656] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.823775] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.814059] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.787690] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.816636] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.828278] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.820970] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.793724] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.822603] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.837332] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.827009] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.804378] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.834243] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.848603] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.839698] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.852206] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.842510] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.815697] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.857800] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.849777] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.822326] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.863678] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.853395] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.857632] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.870556] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.882200] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.844859] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.887953] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.881250] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.882190] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.853490] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.900334] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.892092] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.891363] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.865395] systemd[1]: Finished Load Kernel Modules. client # [ 1.901227] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.902131] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.873381] systemd[1]: Starting Apply Kernel Variables... client # [ 1.908364] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.910632] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.923851] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.892465] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.923725] systemd[1]: Started Journal Service. lb # [ 1.936452] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.780671] systemd-modules-load[67]: Inserted module 'dm_mod' worker1 # [ 1.897493] systemd[1]: Started Journal Service. worker1 # [ 1.752918] systemd-modules-load[68]: Inserted module 'dm_mod' client # [ 1.784596] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.756946] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.785607] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.796212] systemd-modules-load[67]: Inserted module 'dm_mod'[ 1.930758] systemd[1]: Started Journal Service. worker1 # [ 1.759449] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # worker2 # [ 1.800332] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.801380] systemd-modules-load[67]: Inserted module 'virtio_gpu' client # [ 1.791065] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.807083] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.768900] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.952312] systemd[1]: Finished Load Kernel Modules. client # [ 1.799106] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.770775] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.802085] systemd[1]: Reached target Local File Systems. worker2 # [ 1.812665] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.773955] systemd[1]: Reached target Local File Systems. worker1 # [ 1.775261] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.815095] systemd[1]: Reached target Local File Systems. client # [ 1.805063] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.818845] systemd[1]: Starting Create System Files and Directories... lb # [ 1.964240] systemd[1]: Starting Apply Kernel Variables... client # [ 1.811623] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.784073] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.815177] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.825637] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.831140] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.987682] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.808309] systemd[1]: Finished Create System Files and Directories. lb # [ 1.846311] systemd-modules-load[67]: Inserted module 'dm_mod'[ 1.992692] systemd[1]: Started Journal Service. lb # lb # [ 1.848635] systemd-modules-load[67]: Inserted module 'virtio_balloon' client # [ 1.842480] systemd[1]: Finished Create System Files and Directories. lb # [ 1.852352] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.854989] systemd[1]: Finished Create System Files and Directories. lb # [ 1.861186] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.864085] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.866089] systemd[1]: Reached target Local File Systems. worker1 # [ 1.828959] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.869084] systemd[1]: Starting Create System Files and Directories... client # [ 1.861913] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.874764] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.876073] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.852726] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.887284] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.900472] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.901650] systemd[1]: Finished Create System Files and Directories. lb # [ 1.922796] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker1 # [ 1.908152] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.946741] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.910116] systemd[1]: Reached target System Initialization. worker1 # [ 1.910921] systemd[1]: Reached target Basic System. client # [ 1.940676] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.942781] systemd[1]: Reached target System Initialization. worker2 # [ 1.953958] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.943703] systemd[1]: Reached target Basic System. worker2 # [ 1.954815] systemd[1]: Reached target System Initialization. worker2 # [ 1.955740] systemd[1]: Reached target Basic System. lb # [ 2.001172] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.003218] systemd[1]: Reached target System Initialization. lb # [ 2.004168] systemd[1]: Reached target Basic System. worker1 # [ 2.236145] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.272097] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.274268] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.246671] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.278093] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.251144] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.281796] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.254979] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.255682] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.285505] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.286381] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.294403] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.295112] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.296944] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.297958] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.303234] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.303187] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.304012] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.275576] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.304039] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.276349] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.305981] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.305585] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.278170] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.306688] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.308456] usb usb1: Product: EHCI Host Controller client # [ 2.309132] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.312245] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.311679] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.313035] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.313019] hub 1-0:1.0: USB hub found worker1 # [ 2.284320] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.314185] hub 1-0:1.0: 6 ports detected worker1 # [ 2.285184] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.315176] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.316303] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.287227] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.288710] usb usb1: Product: EHCI Host Controller worker1 # [ 2.290571] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.320278] usb usb1: Product: EHCI Host Controller worker1 # [ 2.292040] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.321684] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.322561] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.323340] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.322499] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.294532] hub 1-0:1.0: USB hub found worker1 # [ 2.295078] hub 1-0:1.0: 6 ports detected worker2 # [ 2.324735] hub 1-0:1.0: USB hub found worker2 # [ 2.326068] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.326931] hub 1-0:1.0: 6 ports detected worker2 # [ 2.329671] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.330377] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.302700] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.343683] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.335223] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.335992] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.311240] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.352831] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.345210] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.346354] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.321808] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.351582] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.352348] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.365135] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.366059] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.368022] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.329264] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.372047] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.375160] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.364363] usb usb2: Product: UHCI Host Controller worker2 # [ 2.364929] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.376071] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.365080] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.366072] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.379083] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.338352] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.379806] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.339552] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.380818] usb usb1: Product: EHCI Host Controller lb # [ 2.384136] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.384885] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.373171] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.386321] hub 1-0:1.0: USB hub found worker1 # [ 2.346720] SCSI subsystem initialized lb # [ 2.388283] hub 1-0:1.0: 6 ports detected worker2 # [ 2.247184] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.391939] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.381239] hub 2-0:1.0: USB hub found worker1 # [ 2.210497] systemd[1]: Starting Virtual Console Setup... client # [ 2.383167] hub 2-0:1.0: 2 ports detected worker2 # [ 2.253062] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.390740] usb usb2: Product: UHCI Host Controller client # [ 2.247228] (udev-worker)[84]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.391503] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.403218] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.220672] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.250071] systemd[1]: Starting Virtual Console Setup... lb # [ 2.403955] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.393965] SCSI subsystem initialized client # [ 2.394829] SCSI subsystem initialized worker1 # [ 2.369444] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.412850] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.263046] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.418633] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.235648] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.237755] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.382349] usb usb2: Product: UHCI Host Controller worker1 # [ 2.383053] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.281135] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.283229] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.427823] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.274315] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.421584] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.250059] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.421182] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.290543] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.254759] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.294188] systemd[1]: Finished Virtual Console Setup. client # [ 2.285892] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.441162] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.401370] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.430209] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.432067] hub 2-0:1.0: USB hub found client # [ 2.430918] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.431971] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.292060] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.436740] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.438047] hub 2-0:1.0: 2 ports detected worker1 # [ 2.409850] hub 2-0:1.0: USB hub found lb # [ 2.452901] usb usb2: Product: UHCI Host Controller lb # [ 2.453711] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.413913] hub 2-0:1.0: 2 ports detected lb # [ 2.460920] SCSI subsystem initialized worker1 # [ 2.421003] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.463210] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.452372] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.454173] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.320316] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.454930] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.458262] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.288073] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.459400] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.288931] systemd[1]: Reached target Initrd Root Device. lb # [ 2.326268] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.431995] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.433040] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.319943] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.321055] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.293292] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.333689] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.477511] hub 2-0:1.0: USB hub found worker1 # [ 2.437423] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.334767] systemd[1]: Reached target Initrd Root Device. client # [ 2.325068] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.469003] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.337656] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.471763] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.442718] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.471953] usb usb3: Product: UHCI Host Controller worker1 # [ 2.443869] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.472796] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.473648] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.341282] (udev-worker)[90]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.476485] hub 3-0:1.0: USB hub found worker2 # [ 2.477147] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.344176] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.490503] hub 2-0:1.0: 2 ports detected worker2 # [ 2.480582] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.452328] usb usb3: Product: UHCI Host Controller worker1 # [ 2.453029] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.482239] hub 3-0:1.0: 2 ports detected worker1 # [ 2.456331] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.486575] usb usb3: Product: UHCI Host Controller worker2 # [ 2.487245] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.458398] hub 3-0:1.0: USB hub found worker1 # [ 2.460324] hub 3-0:1.0: 2 ports detected client # [ 2.489389] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.490229] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.492116] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.493729] hub 3-0:1.0: USB hub found client # [ 2.493453] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.495599] hub 3-0:1.0: 2 ports detected worker1 # [ 2.468683] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.497963] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.470378] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.501178] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.329704] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.358500] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.512738] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.502682] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.501813] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.369074] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.502991] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.334685] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.507685] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.518604] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.508447] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.365409] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.376076] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.377566] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.481334] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.482105] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.511163] usb usb4: Product: UHCI Host Controller client # [ 2.511838] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.483832] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.513457] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.514212] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.486526] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.515764] hub 4-0:1.0: USB hub found worker2 # [ 2.384396] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.518780] hub 4-0:1.0: 2 ports detected worker1 # [ 2.490348] usb usb4: Product: UHCI Host Controller worker1 # [ 2.491104] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.492324] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.522674] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.494695] hub 4-0:1.0: USB hub found worker2 # [ 2.523965] usb usb4: Product: UHCI Host Controller worker1 # [ 2.496357] hub 4-0:1.0: 2 ports detected worker2 # [ 2.525616] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.526447] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.537164] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.498790] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.529811] hub 4-0:1.0: USB hub found lb # [ 2.542166] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.531612] hub 4-0:1.0: 2 ports detected lb # [ 2.542947] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.400734] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.401807] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.539351] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.406132] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.511170] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.512036] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.553293] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.558183] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.561389] usb usb3: Product: UHCI Host Controller worker2 # [ 2.550354] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.552631] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.552197] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.567223] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.567971] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.556468] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.528999] scsi host0: ahci client # [ 2.557665] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.570477] hub 3-0:1.0: USB hub found worker1 # [ 2.531696] scsi host1: ahci client # [ 2.560527] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.534421] scsi host2: ahci lb # [ 2.574597] hub 3-0:1.0: 2 ports detected client # [ 2.564419] scsi host0: ahci worker2 # [ 2.565583] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.566103] scsi host1: ahci worker1 # [ 2.537313] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.567639] scsi host0: ahci client # [ 2.567530] scsi host2: ahci worker1 # [ 2.539727] scsi host3: ahci lb # [ 2.580180] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.569228] scsi host3: ahci lb # [ 2.580963] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.570595] scsi host1: ahci worker1 # [ 2.541436] scsi host4: ahci worker2 # [ 2.571391] scsi host2: ahci client # [ 2.570975] scsi host4: ahci lb # [ 2.583242] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.543084] scsi host5: ahci lb # [ 2.584031] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.572680] scsi host5: ahci worker1 # [ 2.544226] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.573748] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.546052] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.576818] scsi host3: ahci client # [ 2.575580] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.547228] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.588442] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.576826] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.548455] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.578592] scsi host4: ahci client # [ 2.578082] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.549655] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.580598] scsi host5: ahci client # [ 2.579313] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.550856] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.591281] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.581118] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.580536] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.583335] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.584604] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.450756] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.585814] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.587014] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.588220] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.455446] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.605244] usb usb4: Product: UHCI Host Controller lb # [ 2.605971] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.606931] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.608575] hub 4-0:1.0: USB hub found lb # [ 2.611822] hub 4-0:1.0: 2 ports detected lb # [ 2.629162] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.632946] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.645158] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.646037] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.654240] scsi host0: ahci lb # [ 2.656536] scsi host1: ahci lb # [ 2.657892] scsi host2: ahci lb # [ 2.659692] scsi host3: ahci lb # [ 2.661568] scsi host4: ahci lb # [ 2.663174] scsi host5: ahci lb # [ 2.663705] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.665839] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.667045] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.668261] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.669463] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.670653] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.682061] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.683349] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.684701] usb 1-1: Product: QEMU USB Tablet client # [ 2.685413] usb 1-1: Manufacturer: QEMU client # [ 2.685961] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.694885] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.666716] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.697755] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.669545] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.700971] usb 1-1: Product: QEMU USB Tablet client # [ 2.701669] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.672848] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.702742] usb 1-1: Manufacturer: QEMU worker1 # [ 2.674603] usb 1-1: Manufacturer: QEMU worker2 # [ 2.704459] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.676401] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.733192] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.708401] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.758387] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.759544] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.760862] usb 1-1: Product: QEMU USB Tablet lb # [ 2.761645] usb 1-1: Manufacturer: QEMU lb # [ 2.762322] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.776546] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.628637] systemd[1]: Mounting /sysroot... client # [ 2.661372] systemd[1]: Mounting /sysroot... worker2 # [ 2.673150] systemd[1]: Mounting /sysroot... lb # [ 2.704980] systemd[1]: Mounting /sysroot... client # [ 2.889554] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.863243] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.865855] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.868104] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.897823] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.870507] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.900106] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.901236] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.872587] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.902533] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.903655] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.874884] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.904918] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.906269] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.877248] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.907048] ata3.00: applying bridge limits worker1 # [ 2.879337] ata3.00: applying bridge limits worker2 # [ 2.908805] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.881011] ata3.00: configured for UDMA/100 client # [ 2.909180] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.910798] ata3.00: applying bridge limits client # [ 2.911484] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.882840] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.912841] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.913573] ata3.00: configured for UDMA/100 worker2 # [ 2.914957] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.917412] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.916041] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.919731] ata3.00: configured for UDMA/100 worker2 # [ 2.922173] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.982659] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.983655] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.984809] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.985761] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.986840] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.987653] ata3.00: applying bridge limits lb # [ 2.988441] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.989405] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.990325] ata3.00: configured for UDMA/100 lb # [ 2.991370] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.955541] usbcore: registered new interface driver usbhid worker1 # [ 2.959010] usbhid: USB HID core driver client # [ 2.992287] usbcore: registered new interface driver usbhid client # [ 2.993043] usbhid: USB HID core driver worker2 # [ 2.996699] usbcore: registered new interface driver usbhid worker2 # [ 2.997488] usbhid: USB HID core driver worker2 # [ 3.010433] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 3.011296] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.982737] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.984495] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 3.016630] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.988504] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 3.018981] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 3.022367] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 3.024295] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.999541] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 3.028845] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 3.032645] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 3.003472] EXT4-fs (vda): mounted filesystem 12f3882e-0173-4aba-8b26-dc31b8bf8bf3 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.865657] systemd[1]: Mounted /sysroot. worker1 # [ 2.868800] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.871336] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.044611] EXT4-fs (vda): mounted filesystem aa7e6a8b-accf-4dca-8a13-28c620627c15 r/w with ordered data mode. Quota mode: none. lb # [ 3.062467] usbcore: registered new interface driver usbhid client # [ 2.910231] systemd[1]: Mounted /sysroot. client # [ 2.910887] systemd[1]: Reached target Initrd Root File System. client # [ 2.914073] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.885655] systemd-sysroot-fstab-check[137]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.069502] usbhid: USB HID core driver worker1 # [ 2.891069] systemd[1]: Reload requested from client PID 137 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.892520] systemd[1]: Reloading... worker2 # [ 3.065809] EXT4-fs (vda): mounted filesystem 05fdbd80-b498-48ce-95d5-8c5958458133 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.937801] systemd[1]: Mounted /sysroot. client # [ 2.927730] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.082276] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.940074] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.941317] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.930581] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.932971] systemd[1]: Reloading... lb # [ 3.094360] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.096298] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.955878] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.100380] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.961092] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.962546] systemd[1]: Reloading... lb # [ 3.117885] EXT4-fs (vda): mounted filesystem 9235bbd0-5e56-4e7e-9705-a7600a7783e4 r/w with ordered data mode. Quota mode: none. lb # [ 2.979989] systemd[1]: Mounted /sysroot. lb # [ 2.981590] systemd[1]: Reached target Initrd Root File System. lb # [ 2.987956] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 2.994817] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.000142] systemd[1]: Mounting /sysroot/run... lb # [ 3.002727] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 2.973933] systemd[1]: Reloading finished in 83 ms. lb # [ 3.014133] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 2.982070] systemd-sysroot-fstab-check[137]: Requesting initrd-fs.target/start/replace... lb # [ 3.020060] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.012908] systemd[1]: Reloading finished in 80 ms. worker1 # [ 2.986209] systemd-sysroot-fstab-check[137]: Requesting swap.target/start/replace... worker1 # [ 2.989679] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.992093] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.021087] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.992971] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.024153] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... client # [ 3.028494] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.029863] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.030908] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.041843] systemd[1]: Reloading finished in 81 ms. worker2 # [ 3.050835] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.054155] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker2 # [ 3.058812] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.056983] systemd-sysroot-fstab-check[145]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.060219] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.061313] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.064254] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.065992] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.070139] systemd[1]: Mounted /sysroot/run. lb # [ 3.071179] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.072473] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.079499] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.081518] systemd[1]: Reload requested from client PID 145 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.083136] systemd[1]: Reloading... lb # [ 3.151869] systemd[1]: Reloading finished in 67 ms. lb # [ 3.161078] systemd-sysroot-fstab-check[145]: Requesting initrd-fs.target/start/replace... lb # [ 3.163311] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.164768] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.166877] systemd-sysroot-fstab-check[145]: Requesting swap.target/start/replace... lb # [ 3.170832] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.173107] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.174888] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.175816] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.185440] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.186870] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.629089] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.632065] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.661103] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.663499] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.636131] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.675190] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.668131] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.639843] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.670696] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.681173] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.646144] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.677129] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.691166] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.701150] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.703367] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.666674] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.709396] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.673085] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.704072] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.677983] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.679126] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.708142] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.679821] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.709090] systemd[1]: Mounted /sysroot/run. client # [ 3.709934] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.710854] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.683380] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.714975] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.725250] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.726510] systemd[1]: Reached target Initrd File Systems. lb # [ 3.728938] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.693369] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.731354] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.695088] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.725360] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.726778] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.737379] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.738428] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.739423] systemd[1]: Mounted /sysroot/run. client # [ 3.728943] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.740271] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.745397] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.747879] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.751260] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.753800] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 3.759075] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.760077] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.759934] systemd[1]: Finished Find NixOS closure. client # [ 3.751488] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.762126] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.752585] systemd[1]: Reached target Initrd File Systems. lb # [ 3.762109] systemd[1]: Reached target Initrd Default Target. lb # [ 3.763145] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.755145] systemd[1]: Starting Find NixOS closure... client # [ 3.756653] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.776390] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.777285] systemd[1]: Stopped target Basic System. lb # [ 3.778044] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.778822] systemd[1]: Stopped target Path Units. lb # [ 3.779547] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.780601] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.781773] systemd[1]: Stopped target Slice Units. worker2 # [ 3.783770] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.782535] systemd[1]: Stopped target Socket Units. lb # [ 3.783353] systemd[1]: Stopped target System Initialization. worker2 # [ 3.785844] systemd[1]: Reached target Initrd File Systems. client # [ 3.775119] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.784450] systemd[1]: Stopped target Swaps. worker2 # [ 3.786847] systemd[1]: Starting Find NixOS closure... lb # [ 3.786153] systemd[1]: Stopped target Timer Units. lb # [ 3.786871] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.787739] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.789498] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.788594] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.789628] systemd[1]: Stopped Find NixOS closure. lb # [ 3.790886] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.782823] systemd[1]: Finished Find NixOS closure. lb # [ 3.792166] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.784228] systemd[1]: Reached target Initrd Default Target. lb # [ 3.793329] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.794331] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.785724] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.796153] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.797114] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.798312] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.799573] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.800747] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.802080] systemd[1]: Stopped target Local File Systems. lb # [ 3.803117] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.805104] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.806079] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.808070] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.807497] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.799826] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.809499] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.801125] systemd[1]: Stopped target Basic System. lb # [ 3.810561] systemd[1]: Stopped Virtual Console Setup. client # [ 3.802064] systemd[1]: Stopped target Initrd Root Device. client # [ 3.804115] systemd[1]: Stopped target Path Units. worker2 # [ 3.815075] systemd[1]: Finished Find NixOS closure. client # [ 3.804787] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.805761] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.816405] systemd[1]: Reached target Initrd Default Target. client # [ 3.806755] systemd[1]: Stopped target Slice Units. client # [ 3.807459] systemd[1]: Stopped target Socket Units. worker2 # [ 3.818260] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.808345] systemd[1]: Stopped target System Initialization. client # [ 3.809138] systemd[1]: Stopped target Swaps. client # [ 3.809749] systemd[1]: Stopped target Timer Units. client # [ 3.810584] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.819385] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.812154] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.821112] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.812978] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.813982] systemd[1]: Stopped Find NixOS closure. client # [ 3.815231] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.816221] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.818254] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.828107] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.819378] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.830521] systemd[1]: Stopped target Initrd Default Target. client # [ 3.820552] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.829664] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.831563] systemd[1]: Stopped target Basic System. client # [ 3.821564] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.830945] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.833110] systemd[1]: Stopped target Initrd Root Device. client # [ 3.822907] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.833869] systemd[1]: Stopped target Path Units. lb # [ 3.832428] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.834647] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.824256] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.835670] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.834332] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.826139] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.836924] systemd[1]: Stopped target Slice Units. lb # [ 3.836176] systemd[1]: Closed udev Control Socket. worker2 # [ 3.837915] systemd[1]: Stopped target Socket Units. client # [ 3.828107] systemd[1]: Stopped target Local File Systems. lb # [ 3.837098] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.838925] systemd[1]: Stopped target System Initialization. client # [ 3.828874] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.837887] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 3.840115] systemd[1]: Stopped target Swaps. client # [ 3.829814] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.840807] systemd[1]: Stopped target Timer Units. lb # [ 3.839116] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.830787] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.841681] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.839950] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.831571] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.843107] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.842155] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.843902] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.844895] systemd[1]: Stopped Find NixOS closure. lb # [ 3.843541] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.834720] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.846179] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.844528] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.835829] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.847083] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.849163] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.850137] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.851887] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.852621] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.853814] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.843870] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.855648] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.856632] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.857526] systemd[1]: Stopped target Local File Systems. client # [ 3.848162] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.859104] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.858146] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.860023] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.859302] systemd[1]: Finished Cleanup udev Database. client # [ 3.850799] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.861614] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.860482] systemd[1]: Reached target Switch Root. worker2 # [ 3.863181] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.864278] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.853920] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.863222] systemd[1]: Starting NixOS Activation... worker2 # [ 3.866127] systemd[1]: Stopped Virtual Console Setup. client # [ 3.857106] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.858170] systemd[1]: Closed udev Control Socket. client # [ 3.860143] systemd[1]: Starting Cleanup udev Database... client # [ 3.861125] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 3.872521] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.863077] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.863913] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.865080] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.866189] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.867149] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.878216] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.867977] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.879159] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.880178] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.870190] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.885967] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.887076] systemd[1]: Closed udev Control Socket. worker2 # [ 3.888323] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.889143] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 3.891976] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.892831] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.894129] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.895073] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.884969] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.895983] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.896856] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.887157] systemd[1]: Finished Cleanup udev Database. client # [ 3.888282] systemd[1]: Reached target Switch Root. worker2 # [ 3.899170] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.890083] systemd[1]: Starting NixOS Activation... worker2 # [ 3.914103] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.915179] systemd[1]: Finished Cleanup udev Database. worker2 # [ 3.915888] systemd[1]: Reached target Switch Root. worker2 # [ 3.917290] systemd[1]: Starting NixOS Activation... lb # [ 3.931231] initrd-nixos-activation-start[192]: booting system configuration /nix/store/ggsnp37phfgq4b11zirffk4vxgicg7h8-nixos-system-lb-test lb # [ 3.955634] initrd-nixos-activation-start[192]: running activation script... client # [ 3.960392] initrd-nixos-activation-start[191]: booting system configuration /nix/store/qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test worker2 # [ 3.985119] initrd-nixos-activation-start[191]: booting system configuration /nix/store/9ddfrc7c8w69kr1zczx1vf02afx7i8bp-nixos-system-worker2-test client # [ 3.985873] initrd-nixos-activation-start[191]: running activation script... worker2 # [ 4.012404] initrd-nixos-activation-start[191]: running activation script... lb # [ 4.130118] initrd-nixos-activation-start[215]: setting up /etc... client # [ 4.157916] initrd-nixos-activation-start[214]: setting up /etc... lb # [ 4.228711] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.230288] systemd[1]: Finished NixOS Activation. lb # [ 4.232360] systemd[1]: Starting Switch Root... lb # [ 4.244070] systemd[1]: Switching root. worker2 # [ 4.250824] initrd-nixos-activation-start[214]: setting up /etc... client # [ 4.250508] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.252991] systemd[1]: Finished NixOS Activation. client # [ 4.254365] systemd[1]: Starting Switch Root... client # [ 4.269235] systemd[1]: Switching root. worker2 # [ 4.352610] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.354087] systemd[1]: Finished NixOS Activation. worker2 # [ 4.355735] systemd[1]: Starting Switch Root... worker2 # [ 4.368827] systemd[1]: Switching root. lb # [ 4.512937] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.540247] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.626726] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.695295] NET: Registered PF_VSOCK protocol family worker2 # [ 4.716432] NET: Registered PF_VSOCK protocol family client # [ 4.727537] NET: Registered PF_VSOCK protocol family worker1 # [ 4.630505] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.680123] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.681463] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.683394] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.687175] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.707820] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.710099] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.717279] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.718550] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.720480] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.736281] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.737552] systemd[1]: Stopped target Basic System. worker1 # [ 4.738448] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.739411] systemd[1]: Stopped target Path Units. worker1 # [ 4.741115] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.742172] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.743159] systemd[1]: Stopped target Slice Units. worker1 # [ 4.744041] systemd[1]: Stopped target Socket Units. worker1 # [ 4.744727] systemd[1]: Stopped target System Initialization. worker1 # [ 4.745497] systemd[1]: Stopped target Swaps. worker1 # [ 4.746187] systemd[1]: Stopped target Timer Units. worker1 # [ 4.747103] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.748842] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.749688] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.750784] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.752094] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.754070] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.755094] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.755951] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.757168] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.758129] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.759750] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.761119] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.762445] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.764117] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.765080] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.766197] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.767340] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.769108] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.770081] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.771257] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.778354] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.783199] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.790190] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.791127] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.792132] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.793044] systemd[1]: Closed udev Control Socket. worker1 # [ 4.795524] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.797260] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.798281] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.799161] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.800215] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.801198] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.802097] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.803113] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.805164] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.820880] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.823156] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.823878] systemd[1]: Reached target Switch Root. worker1 # [ 4.825853] systemd[1]: Starting NixOS Activation... lb # [ 5.049819] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.059479] systemd[1]: Detected virtualization kvm. lb # [ 5.061258] systemd[1]: Detected architecture x86-64. lb # [ 5.063164] systemd[1]: Detected first boot. lb # [ 5.066626] systemd[1]: Initializing machine ID from random generator. worker1 # [ 4.895297] initrd-nixos-activation-start[189]: booting system configuration /nix/store/iw1slifxbpr8i9q8sa6lz50n4d12ifxq-nixos-system-worker1-test worker2 # [ 5.074080] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.077904] systemd[1]: Detected virtualization kvm. worker2 # [ 5.078604] systemd[1]: Detected architecture x86-64. worker2 # [ 5.079331] systemd[1]: Detected first boot. worker2 # [ 5.081090] systemd[1]: Initializing machine ID from random generator. worker1 # [ 4.921783] initrd-nixos-activation-start[189]: running activation script... client # [ 5.085685] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.095388] systemd[1]: Detected virtualization kvm. client # [ 5.097230] systemd[1]: Detected architecture x86-64. client # [ 5.099234] systemd[1]: Detected first boot. client # [ 5.102848] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.178862] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.274590] systemd[1]: Applying preset policy. lb # [ 5.287927] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.118714] initrd-nixos-activation-start[212]: setting up /etc... client # [ 5.345112] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.382074] systemd[1]: Applying preset policy. worker1 # [ 5.224046] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.225676] systemd[1]: Finished NixOS Activation. worker1 # [ 5.227661] systemd[1]: Starting Switch Root... worker1 # [ 5.241216] systemd[1]: Switching root. worker2 # [ 5.455837] systemd[1]: Populated /etc with preset unit settings. client # [ 5.475526] systemd[1]: Applying preset policy. worker1 # [ 5.507204] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 5.567913] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.646243] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 5.646446] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.647701] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.649985] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.652127] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.623006] NET: Registered PF_VSOCK protocol family worker2 # [ 5.653611] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.654459] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.655716] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.656837] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.657518] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.658281] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.659089] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.659871] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.660678] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.661580] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.662466] systemd[1]: Reached target Path Units. worker2 # [ 5.663163] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.663936] systemd[1]: Reached target Slice Units. worker2 # [ 5.664638] systemd[1]: Reached target Swaps. worker2 # [ 5.666440] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.668880] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.670668] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.672613] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.686162] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.689045] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.690646] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.693623] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.694793] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.695950] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.697360] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.701246] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.702312] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.703164] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.705329] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.708009] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.716649] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.726668] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.737579] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.747616] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.751863] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.756637] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.765941] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 5.779268] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.780686] systemd[1]: Stopped initrd-switch-root.service. lb # [ 5.782899] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 5.785082] systemd[1]: Created slice Slice /system/getty. lb # [ 5.786481] systemd[1]: Created slice User and Session Slice. lb # [ 5.787420] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 5.788624] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.789714] systemd[1]: Expecting device /dev/hvc0... lb # [ 5.790477] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.779634] systemd[1]: Mounting FUSE Control File System... lb # [ 5.791265] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.792097] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.792841] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.780505] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 5.793626] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.794501] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.795433] systemd[1]: Reached target Path Units. lb # [ 5.796167] systemd[1]: Reached target Remote File Systems. lb # [ 5.796911] systemd[1]: Reached target Slice Units. lb # [ 5.797616] systemd[1]: Reached target Swaps. lb # [ 5.799546] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.802095] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.794929] systemd[1]: Starting Journal Service... worker2 # [ 5.800125] systemd[1]: Starting Load Kernel Modules... lb # [ 5.803978] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 5.817672] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.807067] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.818619] systemd[1]: Listening on Hostname Service Socket. lb # [ 5.821631] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.812558] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.823844] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.814782] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.826168] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 5.827296] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.828416] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.829690] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.822061] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.833596] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.834631] systemd[1]: Listening on udev Control Socket. lb # [ 5.835544] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.826400] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.837781] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.829051] systemd[1]: Mounted Huge Pages File System. lb # [ 5.840475] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.831119] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.833673] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.835700] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.847548] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.837736] systemd[1]: Mounted FUSE Control File System. client # [ 5.840660] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 5.842014] systemd[1]: Stopped initrd-switch-root.service. lb # [ 5.856372] systemd[1]: Mounting Kernel Trace File System... client # [ 5.844581] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.847286] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.846668] systemd[1]: Created slice Slice /system/getty. client # [ 5.848050] systemd[1]: Created slice User and Session Slice. client # [ 5.848979] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.850210] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 5.851344] systemd[1]: Expecting device /dev/hvc0... client # [ 5.852026] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.853012] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.852804] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.853645] systemd[1]: Stopped target initrd-fs.target. client # [ 5.854436] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.855213] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.867435] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.856064] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.856959] systemd[1]: Reached target Path Units. client # [ 5.857685] systemd[1]: Reached target Remote File Systems. client # [ 5.858501] systemd[1]: Reached target Slice Units. client # [ 5.859201] systemd[1]: Reached target Swaps. client # [ 5.861004] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 5.863428] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.865187] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 5.880351] systemd[1]: Starting Load Kernel Module configfs... lb # [ 5.888355] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 5.867044] systemd[1]: Listening on Factory Reset Management. client # [ 5.879569] systemd[1]: Listening on Hostname Service Socket. client # [ 5.882656] systemd[1]: Starting Journal Log Access Socket... client # [ 5.883846] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.886336] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 5.886497] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.888716] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.888003] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.899760] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.889103] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.890417] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.894181] systemd[1]: Mounting Kernel Configuration File System... client # [ 5.894389] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.895436] systemd[1]: Listening on udev Control Socket. client # [ 5.896293] systemd[1]: Listening on udev Varlink Socket. lb # [ 5.909352] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.898417] systemd[1]: Mounting Huge Pages File System... client # [ 5.900825] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.905446] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.922663] systemd[1]: Mounting FUSE Control File System... client # [ 5.913583] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.917944] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.930825] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.923580] EXT4-fs (vda): re-mounted 05fdbd80-b498-48ce-95d5-8c5958458133. client # [ 5.924815] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.946409] systemd[1]: Starting Journal Service... client # [ 5.934737] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.938324] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.939581] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.952790] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.941639] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.942501] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.947834] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.949595] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.963287] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.953004] systemd-journald[284]: Collecting audit messages is enabled. client # [ 5.953499] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.959995] loop: module loaded lb # [ 5.972445] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.976232] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.967397] systemd[1]: Finished Load Kernel Modules. client # [ 5.966363] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.971421] systemd[1]: Starting Firewall... client # [ 5.979799] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.980915] systemd[1]: Starting Apply Kernel Variables... lb # [ 5.992379] systemd[1]: Starting Coldplug All udev Devices... client # [ 5.983384] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.000656] systemd[1]: Starting Journal Service... lb # [ 6.014394] systemd-journald[285]: Collecting audit messages is enabled. lb # [ 6.019515] systemd[1]: Listening on Journal Log Access Socket. client # [ 6.008522] systemd[1]: Starting Load Kernel Modules... lb # [ 6.023498] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.880593] systemd[1]: Queued start job for default target Multi-User System.[ 6.014166] systemd[1]: Started Journal Service. lb # [ 6.029287] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 5.981114] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # worker1 # [ 5.990821] systemd[1]: Detected virtualization kvm. client # [ 6.020212] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.992589] systemd[1]: Detected architecture x86-64. lb # [ 6.035360] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 5.994420] systemd[1]: Detected first boot. worker2 # [ 5.892156] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.894446] systemd-modules-load[285]: Inserted module 'loop' worker1 # [ 5.998178] systemd[1]: Initializing machine ID from random generator. lb # [ 6.041342] systemd[1]: Mounted Kernel Trace File System. client # [ 6.032377] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.903071] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.036343] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.905321] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.049806] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.909488] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.043344] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.055988] systemd[1]: Started Journal Service. worker2 # [ 5.913088] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.912404] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.059639] loop: module loaded lb # [ 5.919301] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.922817] systemd-modules-load[286]: Inserted module 'loop' client # [ 6.057004] systemd-journald[284]: Collecting audit messages is enabled. client # [ 6.058537] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.927457] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.928526] systemd[1]: Mounted FUSE Control File System. client # [ 6.066375] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.936805] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.070324] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 5.938283] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.940217] systemd[1]: Reached target First Boot Complete. client # [ 6.075592] systemd[1]: Mounted Kernel Debug File System. client # [ 6.082590] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.098174] EXT4-fs (vda): re-mounted 9235bbd0-5e56-4e7e-9705-a7600a7783e4. lb # [ 5.955080] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.088987] systemd[1]: Started Journal Service. client # [ 5.950852] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.952586] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.963066] systemd[1]: Starting Firewall... worker2 # [ 5.970340] systemd-oomd[286]: No swap; memory pressure usage will be degraded client # [ 5.961329] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.971304] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.106313] systemd-journald[284]: Received client request to flush runtime journal. client # [ 6.107465] loop: module loaded client # [ 5.966305] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 5.970465] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.971600] systemd[1]: Mounted FUSE Control File System. lb # [ 5.983071] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.974853] systemd-modules-load[285]: Inserted module 'loop' lb # [ 5.993305] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 5.985869] systemd[1]: Finished Load Kernel Modules. lb # [ 5.996888] systemd-oomd[287]: No swap; memory pressure usage will be degraded lb # [ 6.000658] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.002363] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.145431] EXT4-fs (vda): re-mounted aa7e6a8b-accf-4dca-8a13-28c620627c15. worker1 # [ 6.119612] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.006440] systemd[1]: Starting Apply Kernel Variables... client # [ 6.011441] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.022267] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.023271] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.035127] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.036068] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.031099] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.032069] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.043138] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.049131] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.050054] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.053372] systemd-oomd[287]: No swap; memory pressure usage will be degraded client # [ 6.059233] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.060028] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.065070] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.212457] systemd[1]: Applying preset policy. worker2 # [ 6.110545] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.113056] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.113850] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.115539] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.116175] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.118159] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.119214] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.264232] systemd-journald[285]: Received client request to flush runtime journal. client # [ 6.129582] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.274295] systemd-journald[284]: Received client request to flush runtime journal. worker2 # [ 6.196328] systemd-udevd[316]: Using default interface naming scheme 'v261'. lb # [ 6.211452] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.212602] systemd[1]: Reached target First Boot Complete. lb # [ 6.215465] systemd[1]: Finished Apply Kernel Variables. client # [ 6.214375] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.216312] systemd[1]: Reached target First Boot Complete. lb # [ 6.225293] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.218202] systemd[1]: Finished Apply Kernel Variables. client # [ 6.223076] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.246205] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.237830] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.242923] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.252685] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.271461] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.381738] systemd[1]: Populated /etc with preset unit settings. client # [ 6.299197] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.313085] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.314302] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.323574] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.316728] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.327358] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.339201] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 6.341111] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.344921] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.355832] systemd-udevd[315]: Using default interface naming scheme 'v261'. lb # [ 6.392472] systemd-udevd[328]: Using default interface naming scheme 'v261'. client # [ 6.393189] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.429678] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.441134] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.562822] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.564195] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.566656] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.568677] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.570010] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.570910] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.572090] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.573160] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.573891] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.574639] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.575454] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.576160] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.576993] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.578099] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.578998] systemd[1]: Reached target Path Units. worker1 # [ 6.579706] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.580476] systemd[1]: Reached target Slice Units. worker1 # [ 6.581163] systemd[1]: Reached target Swaps. worker1 # [ 6.582960] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 6.585340] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.479354] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.587049] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.600736] systemd[1]: Listening on Factory Reset Management. worker1 # [ 6.601653] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 6.604587] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.605705] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.608229] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.609712] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.610806] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.612058] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 6.509988] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.615973] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.616970] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.617831] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.619954] systemd[1]: Mounting Huge Pages File System... worker2 # [ 6.517684] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.623832] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.631865] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.638951] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.646614] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.533289] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.657989] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.557913] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.558715] systemd[1]: Reached target Local File Systems. worker1 # [ 6.662432] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.561190] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.552956] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.564320] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.668379] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.566115] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.567979] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 6.570303] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.573336] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.678433] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.577185] systemd[1]: Starting Create System Files and Directories... worker2 # [ 6.582174] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.573290] (udev-worker)[318]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.689525] systemd[1]: Mounting FUSE Control File System... client # [ 6.578822] (udev-worker)[320]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.693433] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.580988] (udev-worker)[320]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.704633] systemd[1]: Starting Journal Service... worker1 # [ 6.709651] systemd[1]: Starting Load Kernel Modules... worker1 # [ 6.715060] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 6.721652] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 6.723626] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.732020] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 6.738531] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.740473] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.742334] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.744525] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.640962] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.746845] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.748951] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.754673] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.653168] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.759791] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.656297] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.657474] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.658886] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.661438] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.663453] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.664701] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.678129] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.683366] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.789219] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.686946] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.686100] systemd[1]: Mounted /run/wrappers. lb # [ 6.686831] systemd[1]: Reached target Local File Systems. worker1 # [ 6.792338] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.690961] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 6.796844] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.694144] systemd[1]: Starting register-nix-paths.service... lb # [ 6.698356] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 6.699634] (udev-worker)[357]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.699198] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.701060] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.703320] (udev-worker)[357]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.702581] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.822973] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.721474] systemd[1]: Starting Create System Files and Directories... lb # [ 6.729385] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.738156] systemd[1]: Finished Create System Files and Directories. worker1 # [ 6.842349] systemd-journald[282]: Collecting audit messages is enabled. worker1 # [ 6.843351] EXT4-fs (vda): re-mounted 12f3882e-0173-4aba-8b26-dc31b8bf8bf3. worker2 # [ 6.744451] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.747156] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.878896] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 6.882249] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 6.855208] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.856483] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.858381] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.863017] loop: module loaded worker1 # [ 6.866318] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.867093] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.874360] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.877741] systemd[1]: Starting Firewall... client # [ 6.764451] systemd[1]: Mounted /run/wrappers. client # [ 6.765915] systemd[1]: Reached target Local File Systems. client # [ 6.766753] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.767732] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.882098] systemd[1]: Starting Apply Kernel Variables... client # [ 6.768584] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.769814] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.779865] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.773912] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.783184] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.905330] systemd[1]: Started Journal Service. worker1 # [ 6.764242] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.765343] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.769390] systemd-modules-load[283]: Inserted module 'loop' worker1 # [ 6.777145] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.817697] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.825544] (udev-worker)[349]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.829964] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 6.830485] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.796442] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.838614] (udev-worker)[349]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.806427] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.862117] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.867965] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 6.844552] systemd-oomd[284]: No swap; memory pressure usage will be degraded worker2 # [ 6.886414] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.884807] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.888404] systemd[1]: Starting Update is Completed... worker1 # [ 6.851249] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.852372] systemd[1]: Reached target First Boot Complete. lb # [ 6.894886] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.862413] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.006531] systemd-journald[282]: Received client request to flush runtime journal. lb # [ 6.903160] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.901591] systemd[1]: Finished Create System Files and Directories. client # [ 6.910189] systemd[1]: Starting Rebuild Journal Catalog... client # [ 6.912891] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 6.978225] systemd[1]: Finished Update is Completed. lb # [ 6.993724] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.956473] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 6.960349] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.991366] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.980369] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.984067] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.989204] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 7.034121] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 7.039745] systemd[1]: Starting Update is Completed... client # [ 7.059548] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.065195] systemd[1]: Starting Update is Completed... lb # [ 7.099371] systemd[1]: Finished Update is Completed. client # [ 7.091844] systemd[1]: Finished Update is Completed. client # [ 6.890963] ACPI: button: Power Button [PWRF] client # [ 6.988970] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.069252] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker2 # [ 7.110619] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.113327] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.115121] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.011692] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.117347] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.120381] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.122649] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.124833] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.094552] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.145808] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 7.145883] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T04:41:38 UTC (1790138498) client # [ 7.145974] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 7.150956] systemd-journald[284]: Time jumped backwards, rotating. worker1 # [ 7.143242] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.330163] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.167039] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.195051] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.211374] systemd[1]: Finished Firewall. worker2 # [ 7.360145] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.227105] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 7.228534] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.231253] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.196743] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.233614] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.236141] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.237721] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.217213] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.238926] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.238309] Console: switching to colour dummy device 80x25 worker2 # [ 7.380498] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.258195] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.260530] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.406646] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.399167] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.399620] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 7.412208] ACPI: button: Power Button [PWRF] client # [ 7.430031] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.456339] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.291737] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.463557] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.464579] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.466851] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.469768] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 7.380871] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.421995] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.488995] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.529000] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.430824] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.434074] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 7.406364] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.424415] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.547889] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.547963] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T04:41:39 UTC (1790138499) worker1 # [ 7.437768] (udev-worker)[350]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.476413] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.440193] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.483459] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.616697] Console: switching to colour frame buffer device 160x50 client # [ 7.623505] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.548037] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.549028] systemd-journald[284]: Time jumped backwards, rotating. client # [ 7.484649] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.457666] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.487041] systemd[1]: Stopped Virtual Console Setup. client # [ 7.493085] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.466756] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.467489] systemd[1]: Reached target Local File Systems. worker1 # [ 7.470125] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.473982] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.476260] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.478050] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.480808] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.554825] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.554948] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.488176] systemd[1]: Starting Create System Files and Directories... worker2 # [ 7.561917] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.572918] Console: switching to colour dummy device 80x25 worker2 # [ 7.617832] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 7.685581] ppdev: user-space parallel port driver lb # [ 7.429546] ACPI: button: Power Button [PWRF] lb # [ 7.623450] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.702741] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 7.710417] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.710424] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 7.713107] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 7.720031] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.720754] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.724763] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 7.639080] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.641013] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T04:41:39 UTC (1790138499) worker2 # [ 7.596986] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.598430] systemd[1]: Reached target System Initialization. worker2 # [ 7.599918] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.602674] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.603942] systemd[1]: Reached target Timer Units. worker2 # [ 7.607124] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.608679] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.598325] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 7.641374] systemd-journald[285]: Time jumped backwards, rotating. lb # [ 7.642192] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.651818] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.600859] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.614899] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 7.615788] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.618054] systemd[1]: Reached target Socket Units. client # [ 7.607779] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.621305] systemd[1]: Reached target Basic System. lb # [ 7.622033] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.624299] systemd[1]: Started backdoor.service. lb # [ 7.623329] systemd[1]: Reached target System Initialization. worker2 # [ 7.624960] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.758411] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.627128] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.626659] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.629179] systemd[1]: Starting Post-Boot Actions... lb # [ 7.627688] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.628548] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.630162] systemd[1]: Reached target Timer Units. lb # [ 7.633119] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.637604] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.638544] systemd[1]: Starting resolvconf update... worker2 # [ 7.639284] systemd[1]: Starting D-Bus System Message Bus... lb # [ 7.651955] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.658420] mousedev: PS/2 mouse device common for all mice lb # [ 7.656128] systemd[1]: Listening on niks3 server socket. lb # [ 7.656978] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.658141] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.660991] systemd[1]: Reached target Socket Units. lb # [ 7.662667] systemd[1]: Reached target Basic System. lb # [ 7.668071] systemd[1]: Started backdoor.service. lb # [ 7.672749] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 7.638252] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.645088] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.647485] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 7.714064] Console: switching to colour dummy device 80x25 lb # [ 7.727575] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.762026] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.694181] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.707815] systemd[1]: Starting Post-Boot Actions... client # [ 7.846290] kvm_amd: TSC scaling supported client # [ 7.846714] kvm_amd: Nested Virtualization enabled client # [ 7.847461] kvm_amd: Nested Paging enabled client # [ 7.847854] kvm_amd: LBR virtualization supported client # [ 7.848569] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.849037] kvm_amd: Virtual GIF supported client # [ 7.849651] kvm_amd: Virtual NMI enabled worker1 # [ 7.683735] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.723717] systemd[1]: Finished Post-Boot Actions. worker1 # [ 7.687298] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.728573] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.746730] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.747848] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.749521] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.751320] nsncd[512]: Sep 23 04:41:39.830 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # connecting to host... lb # [ 7.903537] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.903540] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.733733] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 7.771332] systemd[1]: Starting resolvconf update... client # [ 7.911022] EDAC MC: Ver: 3.0.0 worker2 # [ 7.920951] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.922077] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.803864] systemd[1]: Started rustfs.service. worker2 # [ 7.812240] systemd[1]: Starting User Login Management... lb # connecting to host... worker1 # [ 7.787683] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 7.824223] nsncd[515]: Sep 23 04:41:39.826 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.827435] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 7.790705] systemd[1]: Starting Update is Completed... lb # [ 7.974718] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.975502] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.834283] dbus-broker-launch[516]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.842266] dbus-broker-launch[516]: NSS returned no entry for 'systemd-timesync' lb # [ 7.842656] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 7.844139] dbus-broker-launch[516]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.851900] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.857178] systemd[1]: Started D-Bus System Message Bus. lb # [ 7.866126] systemd[1]: Finished Firewall. lb # [ 7.879260] systemd[1]: Finished Post-Boot Actions. worker2 # [ 7.893279] dbus-broker-launch[516]: Ready worker1 # [ 7.854331] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.855970] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.886733] systemd[1]: Finished register-nix-paths.service. worker1 # [ 7.858611] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.860739] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.864430] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.905112] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 7.905963] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 7.866653] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.907508] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 7.908452] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 7.869083] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.909819] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 7.913071] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 7.913851] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 7.904297] systemd-vconsole-setup[419]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 7.907719] systemd[1]: Finished Virtual Console Setup. client # [ 7.909494] systemd[1]: Reached target System Initialization. lb # [ 8.064054] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.920806] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.064855] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.910840] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.912248] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 7.913298] systemd[1]: Reached target Timer Units. worker1 # [ 7.885745] systemd[1]: Finished Update is Completed. client # [ 7.915083] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.915971] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.916808] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 7.917972] systemd[1]: Reached target Socket Units. client # [ 7.918912] systemd[1]: Reached target Basic System. lb # [ 7.927934] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.920661] systemd[1]: Started backdoor.service. client # [ 7.924088] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.933248] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.929524] systemd[1]: Starting nftables firewall... lb # [ 7.944443] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.939115] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.948317] systemd[1]: Starting Post-Boot Actions... client # [ 7.957937] systemd[1]: Started Reset console on configuration changes. client # [ 7.964912] systemd[1]: Starting resolvconf update... lb # [ 7.980964] systemd[1]: Starting User Login Management... lb # [ 8.001807] systemd[1]: Finished Import lastlog data into lastlog2 database. client # connecting to host... client # [ 8.022081] systemd[1]: Starting D-Bus System Message Bus... client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 8.159266] Console: switching to colour frame buffer device 160x50 client # [ 8.035150] nsncd[427]: Sep 23 04:41:39.530 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.038604] systemd[1]: Finished Post-Boot Actions. client # [ 8.040324] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.056317] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.060503] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.071229] systemd[1]: Starting User Login Management... client # [ 8.076073] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.201864] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 8.247879] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.076094] systemd[1]: Finished Firewall. worker1 # [ 8.219867] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.986487] systemd[1]: Started Name Service Cache Daemon (nsncd). client: connected to guest root shell worker2 # [ 8.120155] nsncd[585]: Sep 23 04:41:40.069 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: (connecting took 8.78 seconds) client: (finished: waiting for the VM to finish booting, in 8.78 seconds) worker2 # [ 8.124348] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.131661] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.135575] systemd[1]: Finished resolvconf update. worker2 # [ 8.138864] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.248342] ACPI: button: Power Button [PWRF] worker2 # [ 8.145354] systemd[1]: Starting DHCP Client... worker2 # [ 8.146748] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.150124] systemd[1]: Starting Extra networking commands.... worker2 # [ 8.150899] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.153713] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.155742] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.157713] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.159686] network-addresses-eth1-start[612]: adding address 192.168.1.4/24... done worker2 # [ 8.164480] systemd-logind[547]: New seat seat0. worker2 # [ 8.166617] systemd[1]: Started User Login Management. worker2 # [ 8.169607] systemd-logind[547]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.172251] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 8.175061] systemd[1]: Starting linger-users.service... lb # [ 8.174418] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 8.176200] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.178566] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.180433] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 8.184327] systemd-logind[547]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 8.185555] network-addresses-eth1-start[612]: adding address 2001:db8:1::4/64... done lb # [ 8.188343] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.151715] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.152819] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 8.194440] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.188138] dbus-broker-launch[441]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.200318] dbus-broker-launch[548]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.206300] dbus-broker-launch[548]: NSS returned no entry for 'systemd-timesync' client # [ 8.198920] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.207454] dbus-broker-launch[548]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 8.201225] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.202121] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.202987] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 8.214659] systemd[1]: Finished Address configuration of eth1. client # [ 8.205474] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.206965] dbus-broker-launch[441]: NSS returned no entry for 'systemd-timesync' client # [ 8.209101] dbus-broker-launch[441]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 8.226280] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.224838] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.217100] systemd-logind[458]: New seat seat0. worker2 # [ 8.230144] systemd[1]: Finished linger-users.service. client # [ 8.221443] systemd-logind[458]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.222602] systemd-logind[458]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.224543] systemd-logind[458]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.237562] systemd[1]: Started User Login Management. client # [ 8.238377] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.242911] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.251925] systemd[1]: Started D-Bus System Message Bus. client # [ 8.279968] systemd[1]: Starting linger-users.service... client # [ 8.286298] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.288732] dbus-broker-launch[441]: Ready worker2 # [ 8.321672] dhcpcd[622]: dhcpcd-10.3.2 starting worker2 # [ 8.328497] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.462961] ppdev: user-space parallel port driver worker2 # [ 8.331603] systemd[1]: Reached target Network. worker2 # [ 8.333843] systemd[1]: Starting Permit User Sessions... lb # [ 8.329555] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 8.331079] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.340962] dhcpcd[683]: dev: loaded udev worker1 # [ 8.367968] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 8.384144] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 8.489714] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.490141] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 8.348726] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.350482] systemd[1]: Finished linger-users.service. client # [ 8.352856] systemd[1]: Finished resolvconf update. worker1 # [ 8.390212] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.390624] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T04:41:39 UTC (1790138499) worker1 # [ 8.390708] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 8.360497] nsncd[517]: Sep 23 04:41:39.856 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.363928] systemd[1]: Starting DHCP Client... client # [ 8.364823] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.366740] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.330747] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.402905] Console: switching to colour frame buffer device 160x50 lb # [ 8.522656] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 8.369257] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.262152] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.379888] dbus-broker-launch[548]: Ready worker2 # [ 8.386617] systemd[1]: Finished Permit User Sessions. lb # [ 8.384930] nsncd[604]: Sep 23 04:41:40.327 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.389101] systemd[1]: Starting Virtual Console Setup... lb # [ 8.389947] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.391901] systemd[1]: Started Getty on tty1. worker2 # [ 8.394112] systemd[1]: Reached target Login Prompts. lb # [ 8.393088] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.394024] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.396118] systemd[1]: Finished resolvconf update. lb # [ 8.396817] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.391500] systemd-journald[282]: Time jumped backwards, rotating. lb # [ 8.398713] systemd[1]: Starting DHCP Client... worker1 # [ 8.416777] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.416880] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.401163] systemd[1]: Starting Address configuration of eth1... lb # [ 8.402159] systemd-logind[553]: New seat seat0. lb # [ 8.409112] systemd[1]: Starting Extra networking commands.... lb # [ 8.409939] systemd[1]: Started User Login Management. lb # [ 8.419862] systemd-logind[553]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.424152] systemd-logind[553]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.435788] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.444001] Console: switching to colour dummy device 80x25 worker1 # [ 8.558744] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 8.558746] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 8.456714] systemd-logind[547]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.567350] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.568130] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.467072] systemd[1]: Starting linger-users.service... client # [ 8.460985] dhcpcd[554]: dhcpcd-10.3.2 starting worker2 # [ 8.471703] systemd-vconsole-setup[617]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.578177] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.578904] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.466263] dhcpcd[562]: dev: loaded udev lb # [ 8.481199] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.483323] systemd[1]: Finished Virtual Console Setup. lb # [ 8.483340] systemd[1]: Stopped Virtual Console Setup. client # [ 8.617281] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.631584] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.632831] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.468900] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.470551] systemd[1]: Reached target System Initialization. worker1 # [ 8.473967] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 8.475175] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 8.515209] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.476960] systemd[1]: Reached target Timer Units. worker2 # [ 8.517130] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.517832] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 8.479210] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.480940] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 8.520152] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.653740] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.482885] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 8.485442] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.487373] systemd[1]: Reached target Socket Units. worker1 # [ 8.489180] systemd[1]: Reached target Basic System. lb # [ 8.526611] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.490734] systemd[1]: Started backdoor.service. client # [ 8.521844] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.494103] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.497200] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.670589] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.499236] systemd[1]: Starting Post-Boot Actions... worker2 # [ 8.671237] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.673404] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.674284] cfg80211: failed to load regulatory.db worker1 # [ 8.505243] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.654365] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 8.655429] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 8.514648] systemd[1]: Starting resolvconf update... worker2 # [ 8.559165] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.520366] systemd[1]: Starting D-Bus System Message Bus... client # [ 8.691875] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.717313] ppdev: user-space parallel port driver lb # [ 8.577172] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.712540] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.713439] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 8.581277] systemd[1]: Finished linger-users.service. client # [ 8.715544] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.716425] cfg80211: failed to load regulatory.db client # [ 8.597445] systemd[1]: Finished nftables firewall. client # [ 8.598785] systemd[1]: Reached target Preparation for Network. client # [ 8.604125] systemd[1]: Starting Address configuration of eth1... client # [ 8.608171] systemd[1]: Starting Extra networking commands.... lb # [ 8.621898] network-addresses-eth1-start[637]: adding address 192.168.1.2/24... done client # [ 8.765081] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.595898] systemd[1]: Finished Post-Boot Actions. client # [ 8.624678] dhcpcd[562]: eth0: waiting for carrier client # [ 8.625683] dhcpcd[562]: eth0: carrier acquired worker2 # [ 8.769735] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.639518] dhcpcd[683]: eth0: waiting for carrier worker2 # [ 8.642586] dhcpcd[683]: libudev: received NULL device worker2 # [ 8.643418] dhcpcd[683]: libudev: received NULL device worker2 # [ 8.644272] dhcpcd[683]: eth0: carrier acquired client # [ 8.638661] dhcpcd[562]: DUID 00:01:00:01:32:46:15:04:52:54:00:12:34:56 client # [ 8.639610] dhcpcd[562]: eth0: IAID 00:12:34:56 client # [ 8.640401] dhcpcd[562]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 8.657090] dhcpcd[683]: DUID 00:01:00:01:32:46:15:04:52:54:00:12:34:56 worker2 # [ 8.657941] dhcpcd[683]: eth0: IAID 00:12:34:56 worker2 # [ 8.659460] dhcpcd[683]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.631163] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.802417] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.805316] kvm_amd: TSC scaling supported worker1 # [ 8.633935] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.805918] kvm_amd: Nested Virtualization enabled worker2 # [ 8.806380] kvm_amd: Nested Paging enabled worker2 # [ 8.806914] kvm_amd: LBR virtualization supported worker2 # [ 8.807350] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.636792] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.809141] kvm_amd: Virtual GIF supported worker1 # connecting to host... worker2 # [ 8.809787] kvm_amd: Virtual NMI enabled lb # [ 8.676135] network-addresses-eth1-start[637]: adding address 2001:db8:1::2/64... done worker1 # [ 8.641106] systemd[1]: Starting User Login Management... client # [ 8.669901] network-addresses-eth1-start[581]: adding address 192.168.1.1/24... done worker1 # [ 8.644663] nsncd[512]: Sep 23 04:41:39.880 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.680949] network-addresses-eth1-start[581]: adding address 2001:db8:1::1/64... done client # [ 8.693656] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.665791] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.849055] EDAC MC: Ver: 3.0.0 lb # [ 8.720841] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.686411] dbus-broker-launch[516]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.719877] systemd[1]: Finished Extra networking commands.. client # [ 8.722198] systemd[1]: Reached target Network. client # [ 8.724391] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.738574] systemd-vconsole-setup[694]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.700593] dbus-broker-launch[516]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.701702] dbus-broker-launch[516]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 8.742224] systemd[1]: Finished Virtual Console Setup. client # [ 8.740387] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.711886] systemd[1]: Started D-Bus System Message Bus. client # [ 8.743556] systemd[1]: Started Getty on tty1. lb # [ 8.752770] systemd-logind[553]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.744756] systemd[1]: Reached target Login Prompts. worker1 # [ 8.725426] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.756478] dbus-broker-launch[516]: Ready lb # [ 8.818553] systemd[1]: Finished Extra networking commands.. lb # [ 8.827149] systemd[1]: Reached target Network. lb # [ 8.829623] dhcpcd[666]: dhcpcd-10.3.2 starting lb # [ 8.977850] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.837517] systemd[1]: Starting PostgreSQL Server... lb # [ 8.842249] systemd[1]: Starting Permit User Sessions... lb # [ 8.852272] dhcpcd[717]: dev: loaded udev worker1 # [ 8.974187] Console: switching to colour frame buffer device 160x50 lb # [ 9.048075] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.054701] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.015711] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.810283] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 8.878832] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.886328] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 8.890196] nsncd[586]: Sep 23 04:41:40.117 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.929222] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.932658] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.895380] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 8.896623] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.901303] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.903187] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.908059] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.909062] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.909838] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.910683] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.948220] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.911669] systemd-logind[536]: New seat seat0. worker1 # [ 8.915444] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.098455] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.916432] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.918107] systemd-logind[536]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.919424] systemd-logind[536]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 8.920437] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.927190] systemd[1]: Started User Login Management. worker1 # [ 8.927888] systemd[1]: Starting linger-users.service... worker1 # [ 8.928608] systemd[1]: Finished resolvconf update. worker1 # [ 8.929289] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.932238] systemd[1]: Starting DHCP Client... worker1 # [ 8.932862] systemd[1]: Starting Address configuration of eth1... worker1 # [ 8.937411] systemd[1]: Starting Extra networking commands.... lb # [ 8.978170] systemd[1]: Finished Permit User Sessions. lb # [ 8.994156] systemd[1]: Started Getty on tty1. lb # [ 8.997243] systemd[1]: Reached target Login Prompts. worker1 # [ 8.998845] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.999774] systemd[1]: Finished linger-users.service. lb # [ 9.040082] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.063940] network-addresses-eth1-start[615]: adding address 192.168.1.3/24... done worker1 # [ 9.082357] network-addresses-eth1-start[615]: adding address 2001:db8:1::3/64... done worker1 # [ 9.106631] systemd[1]: Finished Address configuration of eth1. lb # [ 9.328685] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.177774] systemd-logind[536]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 9.373860] kvm_amd: TSC scaling supported lb # [ 9.376236] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.336090] ppdev: user-space parallel port driver lb # [ 9.377039] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.378392] kvm_amd: Nested Virtualization enabled lb # [ 9.379366] kvm_amd: Nested Paging enabled lb # [ 9.379861] kvm_amd: LBR virtualization supported lb # [ 9.382375] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.383454] cfg80211: failed to load regulatory.db lb # [ 9.387383] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 9.387958] kvm_amd: Virtual GIF supported lb # [ 9.391663] kvm_amd: Virtual NMI enabled worker1 # [ 9.218719] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.219801] systemd[1]: Reached target Network. worker1 # [ 9.221865] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.230199] dhcpcd[627]: dhcpcd-10.3.2 starting worker1 # [ 9.237445] dhcpcd[686]: dev: loaded udev worker1 # [ 9.394564] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.394998] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.265352] systemd-vconsole-setup[611]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.274115] systemd[1]: Finished Virtual Console Setup. lb # [ 9.468492] EDAC MC: Ver: 3.0.0 worker1 # [ 9.285809] systemd[1]: Finished Permit User Sessions. client # [ 9.314652] dhcpcd[562]: eth0: soliciting a DHCP lease worker1 # [ 9.294157] systemd[1]: Started Getty on tty1. worker1 # [ 9.294907] systemd[1]: Reached target Login Prompts. lb # [ 9.341558] postgresql-pre-start[734]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.343208] postgresql-pre-start[734]: This user must also own the server process. worker1 # [ 9.448347] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 9.476490] NET: Registered PF_PACKET protocol family lb # [ 9.493156] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 9.350501] dhcpcd[717]: eth0: waiting for carrier client # [ 9.341424] dhcpcd[562]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 9.351699] dhcpcd[717]: eth0: carrier acquired client # [ 9.344404] dhcpcd[562]: eth0: probing address 10.0.2.15/24 lb # [ 9.354091] postgresql-pre-start[734]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.355473] postgresql-pre-start[734]: The default database encoding has accordingly been set to "UTF8". lb # [ 9.356812] postgresql-pre-start[734]: The default text search configuration will be set to "english". lb # [ 9.358148] postgresql-pre-start[734]: Data page checksums are enabled. lb # [ 9.359167] postgresql-pre-start[734]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.360536] postgresql-pre-start[734]: creating subdirectories ... ok lb # [ 9.361520] postgresql-pre-start[734]: selecting dynamic shared memory implementation ... posix worker1 # [ 9.473604] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 9.335247] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.336383] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.337227] systemd[1]: Stopping Virtual Console Setup... lb # [ 9.375046] dhcpcd[717]: DUID 00:01:00:01:32:46:15:05:52:54:00:12:34:56 lb # [ 9.376401] dhcpcd[717]: eth0: IAID 00:12:34:56 worker1 # [ 9.339057] systemd[1]: Starting Virtual Console Setup... lb # [ 9.377608] dhcpcd[717]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 9.384696] dhcpcd[683]: eth0: soliciting a DHCP lease client: (finished: waiting for unit network-addresses-eth1.service, in 10.06 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker2 # [ 9.534795] NET: Registered PF_PACKET protocol family worker2 # [ 9.409888] dhcpcd[683]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.412364] dhcpcd[683]: eth0: probing address 10.0.2.15/24 client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.542144] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.404978] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.475660] postgresql-pre-start[734]: selecting default "max_connections" ... 100 lb: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker1 # [ 9.618681] kvm_amd: TSC scaling supported worker1 # [ 9.619107] kvm_amd: Nested Virtualization enabled worker1 # [ 9.619869] kvm_amd: Nested Paging enabled worker1 # [ 9.620446] kvm_amd: LBR virtualization supported worker1 # [ 9.620904] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.621603] kvm_amd: Virtual GIF supported worker1 # [ 9.622003] kvm_amd: Virtual NMI enabled worker1 # [ 9.629531] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.630181] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.632006] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 9.632856] cfg80211: failed to load regulatory.db lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 9.570149] postgresql-pre-start[734]: selecting default "shared_buffers" ... 128MB worker1 # [ 9.685549] EDAC MC: Ver: 3.0.0 lb # [ 9.582763] systemd-vconsole-setup[729]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.587166] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.697235] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 9.557209] dhcpcd[686]: eth0: waiting for carrier worker1 # [ 9.559384] dhcpcd[686]: eth0: carrier acquired worker1 # [ 9.569597] dhcpcd[686]: DUID 00:01:00:01:32:46:15:04:52:54:00:12:34:56 worker1 # [ 9.570998] dhcpcd[686]: eth0: IAID 00:12:34:56 worker1 # [ 9.571998] dhcpcd[686]: eth0: adding address fe80::5054:ff:fe12:3456 worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.636716] systemd-vconsole-setup[692]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.639686] systemd[1]: Finished Virtual Console Setup. worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service lb # [ 10.171381] postgresql-pre-start[734]: selecting default time zone ... UTC lb # [ 10.174202] postgresql-pre-start[734]: creating configuration files ... ok lb # [ 10.346908] postgresql-pre-start[734]: running bootstrap script ... ok worker1 # [ 10.313714] dhcpcd[686]: eth0: soliciting a DHCP lease worker1 # [ 10.472945] NET: Registered PF_PACKET protocol family worker1 # [ 10.340095] dhcpcd[686]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.342415] dhcpcd[686]: eth0: probing address 10.0.2.15/24 client # [ 10.406216] dhcpcd[562]: eth0: soliciting an IPv6 router client # [ 10.409243] dhcpcd[562]: eth0: Router Advertisement from fe80::2 client # [ 10.411366] dhcpcd[562]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.413514] dhcpcd[562]: eth0: adding route to fec0::/64 client # [ 10.415445] dhcpcd[562]: eth0: adding default route via fe80::2 lb # [ 10.740661] postgresql-pre-start[734]: performing post-bootstrap initialization ... ok lb # [ 10.890269] postgresql-pre-start[734]: syncing data to disk ... ok lb # [ 10.892328] postgresql-pre-start[734]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.893586] postgresql-pre-start[734]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.895486] postgresql-pre-start[734]: Success. You can now start the database server using: lb # [ 10.896521] postgresql-pre-start[734]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 10.970161] postgres[788]: [788] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.972965] postgres[788]: [788] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.974124] postgres[788]: [788] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.976970] postgres[788]: [788] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" worker2 # [ 10.984889] dhcpcd[683]: eth0: soliciting an IPv6 router worker2 # [ 10.986300] dhcpcd[683]: eth0: Router Advertisement from fe80::2 worker2 # [ 10.987291] dhcpcd[683]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 10.988363] dhcpcd[683]: eth0: adding route to fec0::/64 worker2 # [ 10.989281] dhcpcd[683]: eth0: adding default route via fe80::2 lb # [ 10.987653] postgres[797]: [797] LOG: database system was shut down at 2026-09-23 04:41:42 GMT lb # [ 10.993857] postgres[788]: [788] LOG: database system is ready to accept connections lb # [ 10.998514] systemd[1]: Started PostgreSQL Server. lb # [ 11.004411] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 11.137026] postgresql-setup-start[808]: CREATE DATABASE lb # [ 11.168322] postgresql-setup-start[813]: CREATE ROLE lb # [ 11.179966] postgresql-setup-start[815]: ALTER DATABASE lb # [ 11.184522] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 11.186379] systemd[1]: Reached target PostgreSQL. lb # [ 11.372862] dhcpcd[717]: eth0: soliciting a DHCP lease lb # [ 11.536797] NET: Registered PF_PACKET protocol family worker1 # [ 11.358943] dhcpcd[686]: eth0: soliciting an IPv6 router worker1 # [ 11.361432] dhcpcd[686]: eth0: Router Advertisement from fe80::2 lb # [ 11.399857] dhcpcd[717]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.363570] dhcpcd[686]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 11.365712] dhcpcd[686]: eth0: adding route to fec0::/64 lb # [ 11.403413] dhcpcd[717]: eth0: probing address 10.0.2.15/24 worker1 # [ 11.367545] dhcpcd[686]: eth0: adding default route via fe80::2 lb # [ 11.675346] dhcpcd[717]: eth0: soliciting an IPv6 router lb # [ 11.678839] dhcpcd[717]: eth0: Router Advertisement from fe80::2 lb # [ 11.680862] dhcpcd[717]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.682980] dhcpcd[717]: eth0: adding route to fec0::/64 lb # [ 11.685463] dhcpcd[717]: eth0: adding default route via fe80::2 client # [ 13.702718] dhcpcd[562]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 13.706094] dhcpcd[562]: eth0: adding route to 10.0.2.0/24 client # [ 13.708473] dhcpcd[562]: eth0: adding default route via 10.0.2.2 client # [ 13.806934] systemd[1]: Started DHCP Client. client # [ 13.809160] systemd[1]: Reached target Multi-User System. client # [ 13.810150] systemd[1]: Startup finished in 907ms (kernel) + 3.653s (initrd) + 9.249s (userspace) = 13.809s. worker2 # [ 14.928440] dhcpcd[683]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 14.931528] dhcpcd[683]: eth0: adding route to 10.0.2.0/24 worker2 # [ 14.934452] dhcpcd[683]: eth0: adding default route via 10.0.2.2 worker2 # [ 15.009906] systemd[1]: Started DHCP Client. worker2 # [ 15.011822] systemd[1]: Reached target Multi-User System. worker2 # [ 15.012724] systemd[1]: Startup finished in 917ms (kernel) + 3.644s (initrd) + 10.449s (userspace) = 15.011s. worker1 # [ 15.179357] dhcpcd[686]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 15.181951] dhcpcd[686]: eth0: adding route to 10.0.2.0/24 worker1 # [ 15.184341] dhcpcd[686]: eth0: adding default route via 10.0.2.2 worker1 # [ 15.269989] systemd[1]: Started DHCP Client. worker1 # [ 15.272175] systemd[1]: Reached target Multi-User System. worker1 # [ 15.272895] systemd[1]: Startup finished in 887ms (kernel) + 4.570s (initrd) + 9.813s (userspace) = 15.271s. lb # [ 16.613231] dhcpcd[717]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.615288] dhcpcd[717]: eth0: adding route to 10.0.2.0/24 lb # [ 16.616360] dhcpcd[717]: eth0: adding default route via 10.0.2.2 lb # [ 16.676340] systemd[1]: Started DHCP Client. lb # [ 16.678729] systemd[1]: Reached target Network is Online. lb # [ 16.682369] systemd[1]: Started Envoy reverse proxy. lb # [ 16.687324] systemd[1]: Started mock-oidc.service. lb # [ 16.914554] mock-oidc-server[927]: Mock OIDC Server running lb # [ 16.916792] mock-oidc-server[927]: OIDC Address: 192.168.1.2:8080 lb # [ 16.918156] mock-oidc-server[927]: Issue Address: 0.0.0.0:8081 lb # [ 16.919314] mock-oidc-server[927]: Issuer: http://192.168.1.2:8080/oidc lb # [ 16.920207] mock-oidc-server[927]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 16.921523] mock-oidc-server[927]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 16.922805] mock-oidc-server[927]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 17.007796] envoy[926]: [2026-09-23 04:41:49.011][926][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 17.010534] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 17.011994] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 17.013734] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 17.015581] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 17.017808] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 17.020060] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 17.021633] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 17.023973] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.025955] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 17.027514] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 17.031805] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 17.064314] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 17.069494] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 17.072435] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 17.075387] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 17.077703] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 17.081535] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 17.083794] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 17.086494] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 17.088387] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 17.090121] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 17.091812] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 17.095296] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 17.101331] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 17.103268] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 17.104971] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 17.106699] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 17.108861] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 17.110501] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 17.112574] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 17.114449] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 17.116119] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 17.118405] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 17.120019] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 17.125815] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 17.127648] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 17.131512] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 17.134550] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 17.136999] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 17.138848] envoy[926]: [2026-09-23 04:41:49.013][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 17.141496] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 17.143345] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 17.149345] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 17.152083] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 17.153781] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 17.158042] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 17.160127] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 17.162171] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 17.165117] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 17.166926] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 17.170804] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 17.175298] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 17.176895] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 17.179275] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 17.180832] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 17.182281] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 17.187061] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 17.189080] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 17.194245] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 17.196041] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 17.198075] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 17.202480] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 17.204249] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 17.209156] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 17.210907] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 17.213364] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 17.216119] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 17.218249] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 17.222031] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 17.224199] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 17.226436] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 17.228788] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 17.231095] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.233478] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 17.235043] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 17.237213] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 17.238900] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 17.240748] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 17.242435] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 17.244728] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 17.246409] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 17.249107] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 17.251809] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 17.258958] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 17.260452] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 17.271352] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 17.275332] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 17.279189] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 17.282041] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.285081] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 17.286485] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 17.288482] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.290354] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 17.292113] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 17.298357] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 17.300867] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 17.312128] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 17.317606] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 17.319403] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 17.320904] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 17.322449] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 17.324633] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 17.327747] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 17.331507] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 17.333253] envoy[926]: [2026-09-23 04:41:49.014][926][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 17.335168] envoy[926]: [2026-09-23 04:41:49.065][926][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 17.336445] envoy[926]: [2026-09-23 04:41:49.066][926][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 17.349305] envoy[926]: [2026-09-23 04:41:49.066][926][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 17.350653] envoy[926]: [2026-09-23 04:41:49.066][926][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 17.357997] envoy[926]: [2026-09-23 04:41:49.066][926][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 17.364577] envoy[926]: [2026-09-23 04:41:49.368][926][info][main] [source/server/server.cc:968] runtime: {} lb # [ 17.366876] envoy[926]: [2026-09-23 04:41:49.370][926][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 17.368446] envoy[926]: [2026-09-23 04:41:49.370][926][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 17.370591] envoy[926]: [2026-09-23 04:41:49.374][926][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 17.372752] envoy[926]: [2026-09-23 04:41:49.376][926][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 17.374252] envoy[926]: [2026-09-23 04:41:49.376][926][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 17.375692] envoy[926]: [2026-09-23 04:41:49.376][926][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 17.398966] envoy[926]: [2026-09-23 04:41:49.402][926][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 17.402483] systemd[1]: Reached target Network is Online. worker2 # [ 17.407037] systemd[1]: Starting scheduler-token.service... lb # [ 17.406511] envoy[926]: [2026-09-23 04:41:49.410][926][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 17.409250] envoy[926]: [2026-09-23 04:41:49.412][926][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 17.412655] envoy[926]: [2026-09-23 04:41:49.412][926][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 17.370409] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 17.454318] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.456387] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.457769] systemd[1]: scheduler-token.service: Consumed 27ms CPU time over 48ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 17.464723] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 17.499236] nix-grpc-daemon[779]: ts=2026-09-23T04:41:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 17.509545] nix-grpc-daemon[779]: ts=2026-09-23T04:41:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 17.512410] nix-grpc-daemon[779]: ts=2026-09-23T04:41:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 17.525048] nix-grpc-daemon[779]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 17.526555] nix-grpc-daemon[779]: E0000 00:00:1790138508.776245 779 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 17.532674] nix-grpc-daemon[779]: E0000 00:00:1790138508.784256 779 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.574387] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 17.536103] nix-grpc-daemon[779]: ts=2026-09-23T04:41:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 17.537736] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 17.585116] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 17.587463] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 17.557067] nix-grpc-daemon[779]: E0000 00:00:1790138508.808436 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.600824] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 17.602396] nix-grpc-daemon[783]: E0000 00:00:1790138509.684950 783 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.604654] envoy[926]: [2026-09-23 04:41:49.608][926][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker2 # [ 17.608676] nix-grpc-daemon[783]: E0000 00:00:1790138509.692995 783 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.611734] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 17.609237] envoy[926]: [2026-09-23 04:41:49.608][926][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 17.616280] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 17.574186] nix-grpc-daemon[779]: E0000 00:00:1790138508.825695 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 17.613484] envoy[926]: [2026-09-23 04:41:49.608][926][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 17.578251] nix-grpc-daemon[779]: E0000 00:00:1790138508.827849 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.619740] envoy[926]: [2026-09-23 04:41:49.623][926][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 17.590396] nix-grpc-daemon[779]: E0000 00:00:1790138508.841912 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.629068] nix-grpc-daemon[783]: E0000 00:00:1790138509.713339 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 17.603470] nix-grpc-daemon[779]: ts=2026-09-23T04:41:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.607167] nix-grpc-daemon[779]: ts=2026-09-23T04:41:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.648171] nix-grpc-daemon[783]: E0000 00:00:1790138509.732634 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.652171] nix-grpc-daemon[783]: E0000 00:00:1790138509.734878 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.663904] nix-grpc-daemon[783]: E0000 00:00:1790138509.748353 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.675772] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.677540] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.808251] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.812343] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.879120] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.883214] nix-grpc-daemon[783]: ts=2026-09-23T04:41:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.012865] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.014527] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.083633] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.085429] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.215258] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.217512] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.286730] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.290595] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.418161] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.420457] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.491401] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.493306] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.622281] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.624714] nix-grpc-daemon[779]: ts=2026-09-23T04:41:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.694280] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.695867] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.822831] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.824623] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.896622] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.898445] nix-grpc-daemon[783]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.025560] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.029384] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.099755] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.103596] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.230074] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.233880] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.305113] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.308937] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.434266] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.435932] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.509611] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.511364] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.636812] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.638490] nix-grpc-daemon[779]: ts=2026-09-23T04:41:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.712375] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.714097] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.839443] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.842519] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.915330] nix-grpc-daemon[783]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.919101] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.043244] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.046314] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.119649] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.121493] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.247175] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.250976] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.322658] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.326477] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.451562] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.455637] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.527553] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.531696] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.657959] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.661131] nix-grpc-daemon[779]: ts=2026-09-23T04:41:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.732505] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.734326] nix-grpc-daemon[783]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.858863] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.862179] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.935633] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.939531] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.062606] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.064422] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.140365] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.145142] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.265525] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.269732] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.346102] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.350256] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.470471] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.474491] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.550194] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.552232] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.676660] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.679782] nix-grpc-daemon[779]: ts=2026-09-23T04:41:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.753377] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.755294] nix-grpc-daemon[783]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.877582] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.881388] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.956415] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.959934] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.082090] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.085955] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.160616] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.163638] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.286124] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.287939] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.364858] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.368715] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.489059] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.492979] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.569832] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.573617] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.693778] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.695616] nix-grpc-daemon[779]: ts=2026-09-23T04:41:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.775794] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.779143] nix-grpc-daemon[783]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.896780] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.900678] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.980409] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.984203] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.101628] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.105493] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.185406] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.189128] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.306360] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.310220] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.390314] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.394079] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.510587] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.512461] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.594959] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.599077] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.714364] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.717973] nix-grpc-daemon[779]: ts=2026-09-23T04:41:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.800126] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.801720] nix-grpc-daemon[783]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.918584] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.920866] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.002521] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.004256] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.121958] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.126227] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.205656] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.209727] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.327170] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.331268] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.410863] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.414829] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.531890] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.535895] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.615981] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.620420] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.738282] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.741432] nix-grpc-daemon[779]: ts=2026-09-23T04:41:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.822160] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.825980] nix-grpc-daemon[783]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.938882] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.940590] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.027225] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.031433] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.141838] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.146170] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.232573] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.236485] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.346648] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.350450] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.437073] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.438758] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.550813] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.553630] nix-grpc-daemon[779]: ts=2026-09-23T04:41:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.639361] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.641103] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.755249] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.758861] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.842268] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.843824] nix-grpc-daemon[783]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.959780] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.963842] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.045275] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.049311] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.164155] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.166563] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.250633] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.254951] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.367638] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.371586] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.456175] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.460322] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.572467] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.576419] nix-grpc-daemon[779]: ts=2026-09-23T04:41:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.661581] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.664683] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.778991] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.782121] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.862805] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.864516] nix-grpc-daemon[783]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.979930] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.983985] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.065976] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.070322] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.184595] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.188684] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.271269] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.275160] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.294646] rustfs-bucket-start[1036]: mb s3://farm lb # [ 27.308886] systemd[1]: Finished rustfs-bucket.service. lb # [ 27.314412] systemd[1]: Starting niks3 server... worker1 # [ 27.389537] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 lb # [ 27.431031] postgres[1051]: [1051] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 27.432281] postgres[1051]: [1051] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker1 # [ 27.393495] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.455115] niks3-server[1046]: 2026/09/23 04:41:59 OK 20241026095416_initial_model.sql (11.94ms) lb # [ 27.458506] niks3-server[1046]: 2026/09/23 04:41:59 OK 20251210153512_drop_unused_gin_index.sql (3.69ms) lb # [ 27.463889] niks3-server[1046]: 2026/09/23 04:41:59 OK 20251218171726_add_pins.sql (5.29ms) lb # [ 27.468185] niks3-server[1046]: 2026/09/23 04:41:59 OK 20260628120000_add_object_size_and_stats.sql (4.34ms) lb # [ 27.472749] niks3-server[1046]: 2026/09/23 04:41:59 OK 20260905000000_add_claims.sql (3.13ms) worker2 # [ 27.475954] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.478179] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.478152] niks3-server[1046]: 2026/09/23 04:41:59 OK 20260920000000_drop_claims.sql (5.24ms) lb # [ 27.479442] niks3-server[1046]: 2026/09/23 04:41:59 goose: successfully migrated database to version: 20260920000000 lb # [ 27.483616] niks3-server[1046]: 2026/09/23 04:41:59 OK 1_commit_pending_closure.sql (5.45ms) lb # [ 27.486479] niks3-server[1046]: 2026/09/23 04:41:59 OK 2_object_stats_trigger.sql (2.77ms) lb # [ 27.487592] niks3-server[1046]: 2026/09/23 04:41:59 goose: up to current file version: 2 lb # [ 27.490684] niks3-server[1046]: 2026/09/23 04:41:59 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 27.516734] niks3-server[1046]: 2026/09/23 04:41:59 INFO Read proxy enabled — serving cache objects from S3 lb # [ 27.519226] niks3-server[1046]: 2026/09/23 04:41:59 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 27.525120] systemd[1]: Started niks3 server. lb # [ 27.525761] niks3-server[1046]: 2026/09/23 04:41:59 INFO systemd watchdog enabled interval=15s lb # [ 27.526912] niks3-server[1046]: 2026/09/23 04:41:59 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 27.528063] systemd[1]: Reached target Multi-User System. lb # [ 27.530143] systemd[1]: Startup finished in 887ms (kernel) + 3.640s (initrd) + 23.002s (userspace) = 27.529s. worker1 # [ 27.594220] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.597893] nix-grpc-daemon[779]: ts=2026-09-23T04:41:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.679188] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.683399] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.799762] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.803871] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.884439] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.887909] nix-grpc-daemon[783]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.004726] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.008733] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 18.35 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 28.088923] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.03 seconds) lb: waiting for unit envoy.service worker2 # [ 28.092795] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 28.132709] envoy[926]: conn peer=[::1]:40762 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker2 # [ 28.242527] systemd[1]: Starting scheduler-token.service... worker1 # [ 28.209085] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.210949] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.291043] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 28.294557] systemd[1]: Finished scheduler-token.service. worker2 # [ 28.296671] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.297861] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.299339] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 51ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 28.411866] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.415932] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.497278] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.501302] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.616611] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.620961] nix-grpc-daemon[779]: ts=2026-09-23T04:41:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.702061] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.706139] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.822094] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.824388] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.908781] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.911998] nix-grpc-daemon[783]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.025088] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.027608] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.109944] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.114323] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.228251] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.230596] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.315575] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.319531] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 29.431209] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.433426] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.520599] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.524506] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.633943] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.636044] nix-grpc-daemon[779]: ts=2026-09-23T04:42:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.725634] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.729657] nix-grpc-daemon[783]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.837108] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.839203] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.931699] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.935217] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.039653] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.041474] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.136222] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.139400] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.242104] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.244322] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.340569] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.344705] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 30.444902] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 30.447365] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.546090] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.550376] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.647960] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.650279] nix-grpc-daemon[779]: ts=2026-09-23T04:42:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.751312] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.754993] nix-grpc-daemon[783]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.851458] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.853601] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.955746] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.957468] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.054447] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.056643] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.158676] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.162695] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.257561] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.261455] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.364116] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.367918] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 31.462511] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.466331] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 31.568959] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.572869] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.666948] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.670905] nix-grpc-daemon[779]: ts=2026-09-23T04:42:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.774076] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.777979] nix-grpc-daemon[783]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.874376] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.878952] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.978667] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.980335] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.074851] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.078688] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.180940] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.182671] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.279114] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.280862] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.383818] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.387540] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.481884] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.485815] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 32.588863] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.593142] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.686545] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.690345] nix-grpc-daemon[779]: ts=2026-09-23T04:42:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.793748] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.795422] nix-grpc-daemon[783]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.892412] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.895486] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.997418] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.001741] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.093487] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.097384] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.202639] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.206450] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.298290] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.302325] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.407456] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.411333] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.503094] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.507120] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 33.612212] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.615987] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.707793] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.711702] nix-grpc-daemon[779]: ts=2026-09-23T04:42:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.817404] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.821301] nix-grpc-daemon[783]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.913384] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.917639] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.023135] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.027124] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.118586] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.123112] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.227904] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.231615] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.323869] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.327802] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.432715] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.436537] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.528534] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.532428] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 34.637397] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.641210] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 34.733301] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.737156] nix-grpc-daemon[779]: ts=2026-09-23T04:42:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.842317] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.846210] nix-grpc-daemon[783]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.938663] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.942729] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.048579] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.051823] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.142820] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.144612] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.249279] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.251622] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.345543] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.349467] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.452737] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.456513] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.549998] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.553872] nix-grpc-daemon[779]: ts=2026-09-23T04:42:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 35.657566] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.661690] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 35.754623] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.758428] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.863139] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.867207] nix-grpc-daemon[783]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.959288] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.962608] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.069420] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.073160] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.163467] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.167238] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.274267] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.278073] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.367737] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.369959] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.479172] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.483312] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.570637] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.572813] nix-grpc-daemon[779]: ts=2026-09-23T04:42:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.683994] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.687774] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 36.773756] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.777572] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.888907] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.892686] nix-grpc-daemon[783]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.979204] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.982795] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.094667] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.098441] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.183705] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.187658] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.299105] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.303347] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.388535] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.392537] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.503899] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.507881] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.536488] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_take_over lb # [ 37.534942] niks3-server[1046]: 2026/09/23 04:42:09 INFO lead: acquired remote=192.168.1.4:56356 worker1 # [ 37.593369] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.597201] nix-grpc-daemon[779]: ts=2026-09-23T04:42:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.708715] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.723345] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 37.726280] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:46104 worker2 # [ 37.730714] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 37.797940] nix-grpc-daemon[779]: ts=2026-09-23T04:42:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.839308] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:46104 worker2 # [ 37.842968] nix-grpc-daemon[783]: ts=2026-09-23T04:42:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.83 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 39.342947] nix-grpc-daemon[779]: ts=2026-09-23T04:42:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 39.353537] systemd[1]: Started Nix Daemon. worker1 # [ 39.468128] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 39.482616] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5) worker1 # [ 39.587789] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 2/5) worker1 # [ 39.645239] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 390 ms (attempt 3/5) worker1 # [ 40.037542] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 307 ms (attempt 4/5) worker1 # [ 40.349464] nix-grpc-daemon[779]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 40.352638] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 40.413816] nix-grpc-daemon[783]: ts=2026-09-23T04:42:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 40.424954] systemd[1]: Started Nix Daemon. worker2 # [ 40.570525] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 40.596780] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5) worker2 # [ 40.631861] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5) worker2 # [ 40.687819] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 3/5) worker2 # [ 40.833940] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 344 ms (attempt 4/5) worker2 # [ 41.180892] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 41.184291] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 41.198876] nix-grpc-daemon[783]: ts=2026-09-23T04:42:13Z level=debug event=path_info_miss path=qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test error="error: path '/nix/store/qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 41.167895] nix-grpc-daemon[779]: ts=2026-09-23T04:42:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 41.180112] nix-grpc-daemon[779]: ts=2026-09-23T04:42:12Z level=debug event=path_info_miss path=qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test error="error: path '/nix/store/qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 41.409081] nix-grpc-daemon[779]: ts=2026-09-23T04:42:12Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 41.411163] nix-grpc-daemon[779]: ts=2026-09-23T04:42:12Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:40946 worker2 # [ 41.459609] nix-grpc-daemon[783]: ts=2026-09-23T04:42:13Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46108 worker2 # [ 41.469692] nix-grpc-daemon[783]: ts=2026-09-23T04:42:13Z level=debug event=path_info_miss path=qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test error="error: path '/nix/store/qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 41.479681] nix-grpc-daemon[783]: ts=2026-09-23T04:42:13Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46108 worker2 # [ 41.489074] nix-grpc-daemon[783]: ts=2026-09-23T04:42:13Z level=debug event=path_info_miss path=qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test error="error: path '/nix/store/qhqikc52z3k5ifiwyi2zsl4rf7zd53vq-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker1 # [ 41.604831] nix-grpc-daemon[779]: ts=2026-09-23T04:42:12Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 41.750546] nix-grpc-daemon[779]: ts=2026-09-23T04:42:13Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.62 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 42.335562] nix-grpc-daemon[783]: ts=2026-09-23T04:42:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46108 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 42.308375] nix-grpc-daemon[779]: ts=2026-09-23T04:42:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker2 # [ 42.369210] nix-grpc-daemon[783]: ts=2026-09-23T04:42:14Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 42.374759] nix-grpc-daemon[783]: ts=2026-09-23T04:42:14Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 42.419840] nix-grpc-daemon[783]: ts=2026-09-23T04:42:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 42.431540] nix-grpc-daemon[783]: ts=2026-09-23T04:42:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 client # copying 1 paths to 'lb:50051'... worker2 # [ 42.442572] nix-grpc-daemon[783]: ts=2026-09-23T04:42:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker2 # [ 42.471119] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 42.493771] nix-grpc-daemon[783]: ts=2026-09-23T04:42:14Z level=info event=niks3_push_started pid=889 worker2 # [ 42.647451] nix-grpc-daemon[889]: time=2026-09-23T04:42:14.730Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 42.740242] nix-daemon[874]: accepted connection from pid 902, user nix-grpc-daemon (trusted) worker2 # [ 42.754726] nix-daemon[874]: reaped child process 905, status = succeeded lb # [ 42.761843] niks3-server[1046]: 2026/09/23 04:42:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.820743] nix-grpc-daemon[889]: time=2026-09-23T04:42:14.905Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 42.822353] nix-grpc-daemon[889]: time=2026-09-23T04:42:14.906Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 42.858262] niks3-server[1046]: 2026/09/23 04:42:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 42.885209] niks3-server[1046]: 2026/09/23 04:42:14 INFO Signed narinfos id=1 count=1 worker2 # [ 42.890155] nix-grpc-daemon[889]: time=2026-09-23T04:42:14.973Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.896766] niks3-server[1046]: 2026/09/23 04:42:14 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 42.914114] niks3-server[1046]: 2026/09/23 04:42:14 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 42.919639] niks3-server[1046]: 2026/09/23 04:42:14 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 42.924636] niks3-server[1046]: 2026/09/23 04:42:14 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 42.927160] niks3-server[1046]: 2026/09/23 04:42:14 INFO Completed upload id=1 worker2 # [ 42.929395] nix-grpc-daemon[889]: time=2026-09-23T04:42:15.013Z level=INFO msg="Upload complete. (278ms)" worker2 # [ 42.934459] nix-grpc-daemon[783]: ts=2026-09-23T04:42:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 42.940500] nix-grpc-daemon[783]: ts=2026-09-23T04:42:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 42.953342] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 42.964452] nix-daemon[874]: reaped child process 887, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker2 # [ 42.972426] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 44.192138] nix-daemon[874]: reaped child process 909, status = succeeded worker2 # [ 44.269418] nix-daemon[874]: accepted connection from pid 925, user nix-grpc-daemon (trusted) worker2 # [ 44.284062] nix-daemon[874]: reaped child process 928, status = succeeded lb # [ 44.292110] niks3-server[1046]: 2026/09/23 04:42:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.312349] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.396Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 44.315685] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.398Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 44.349322] niks3-server[1046]: 2026/09/23 04:42:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 44.356257] niks3-server[1046]: 2026/09/23 04:42:16 INFO Signed narinfos id=2 count=1 worker2 # [ 44.361123] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.445Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.359491] niks3-server[1046]: 2026/09/23 04:42:16 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 44.364804] niks3-server[1046]: 2026/09/23 04:42:16 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 44.376061] niks3-server[1046]: 2026/09/23 04:42:16 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 44.379361] niks3-server[1046]: 2026/09/23 04:42:16 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 44.383939] niks3-server[1046]: 2026/09/23 04:42:16 INFO Completed upload id=2 worker2 # [ 44.386075] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.470Z level=INFO msg="Upload complete. (202ms)" lb # [ 44.387198] niks3-server[1046]: 2026/09/23 04:42:16 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker2 # [ 44.397561] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker2 # [ 44.409537] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 44.414232] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 44.424286] nix-daemon[874]: reaped child process 907, status = succeeded worker2 # [ 44.453424] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 44.467542] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 44.481820] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.566Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker2 # [ 44.490545] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 44.503298] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 44.605145] nix-daemon[874]: accepted connection from pid 934, user nix-grpc-daemon (trusted) worker2 # [ 44.620393] nix-daemon[874]: reaped child process 937, status = succeeded lb # [ 44.623601] niks3-server[1046]: 2026/09/23 04:42:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.630067] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.714Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 44.631485] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.715Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 44.642252] niks3-server[1046]: 2026/09/23 04:42:16 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 44.644422] niks3-server[1046]: 2026/09/23 04:42:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 44.647706] niks3-server[1046]: 2026/09/23 04:42:16 INFO Signed narinfos id=3 count=1 worker2 # [ 44.649418] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.733Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.650830] niks3-server[1046]: 2026/09/23 04:42:16 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 44.656847] niks3-server[1046]: 2026/09/23 04:42:16 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 44.663864] niks3-server[1046]: 2026/09/23 04:42:16 INFO Completed upload id=3 worker2 # [ 44.665635] nix-grpc-daemon[889]: time=2026-09-23T04:42:16.750Z level=INFO msg="Upload complete. (149ms)" worker2 # [ 44.667693] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 44.667545] niks3-server[1046]: 2026/09/23 04:42:16 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker2 # [ 44.672065] nix-grpc-daemon[783]: ts=2026-09-23T04:42:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 44.677881] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 44.680098] nix-daemon[874]: reaped child process 932, status = succeeded worker2 # [ 44.685171] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 45.321679] nix-daemon[874]: reaped child process 941, status = succeeded worker2 # [ 45.409233] nix-daemon[874]: accepted connection from pid 957, user nix-grpc-daemon (trusted) worker2 # [ 45.422973] nix-daemon[874]: reaped child process 960, status = succeeded lb # [ 45.428898] niks3-server[1046]: 2026/09/23 04:42:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.440856] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.525Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 45.442592] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.526Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 45.470295] niks3-server[1046]: 2026/09/23 04:42:17 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 45.478434] niks3-server[1046]: 2026/09/23 04:42:17 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 45.486452] niks3-server[1046]: 2026/09/23 04:42:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 45.493341] niks3-server[1046]: 2026/09/23 04:42:17 INFO Signed narinfos id=4 count=1 worker2 # [ 45.495485] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.579Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.503161] niks3-server[1046]: 2026/09/23 04:42:17 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 45.505724] niks3-server[1046]: 2026/09/23 04:42:17 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 45.511074] niks3-server[1046]: 2026/09/23 04:42:17 INFO Completed upload id=4 lb # [ 45.512327] niks3-server[1046]: 2026/09/23 04:42:17 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker2 # [ 45.513120] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.597Z level=INFO msg="Upload complete. (220ms)" worker2 # [ 45.525403] nix-grpc-daemon[783]: ts=2026-09-23T04:42:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 45.531693] nix-grpc-daemon[783]: ts=2026-09-23T04:42:17Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 45.536975] nix-grpc-daemon[783]: ts=2026-09-23T04:42:17Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.547508] nix-daemon[874]: reaped child process 939, status = succeeded worker2 # [ 45.575784] nix-grpc-daemon[783]: ts=2026-09-23T04:42:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 45.588099] nix-grpc-daemon[783]: ts=2026-09-23T04:42:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 45.602092] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.686Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 45.611721] nix-grpc-daemon[783]: ts=2026-09-23T04:42:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker2 # [ 45.634664] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 45.741180] nix-daemon[874]: accepted connection from pid 966, user nix-grpc-daemon (trusted) worker2 # [ 45.755822] nix-daemon[874]: reaped child process 969, status = succeeded lb # [ 45.759299] niks3-server[1046]: 2026/09/23 04:42:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.768975] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.853Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.771027] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.855Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 45.793274] niks3-server[1046]: 2026/09/23 04:42:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 45.798278] niks3-server[1046]: 2026/09/23 04:42:17 INFO Signed narinfos id=5 count=1 worker2 # [ 45.803162] nix-grpc-daemon[889]: time=2026-09-23T04:42:17.887Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.811878] niks3-server[1046]: 2026/09/23 04:42:17 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 46.116879] niks3-server[1046]: 2026/09/23 04:42:18 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 46.128731] niks3-server[1046]: 2026/09/23 04:42:18 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 46.147721] niks3-server[1046]: 2026/09/23 04:42:18 INFO Completed upload id=5 worker2 # [ 46.149846] nix-grpc-daemon[889]: time=2026-09-23T04:42:18.234Z level=INFO msg="Upload complete. (500ms)" worker2 # [ 46.154870] nix-grpc-daemon[783]: ts=2026-09-23T04:42:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 46.154507] niks3-server[1046]: 2026/09/23 04:42:18 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker2 # [ 46.161818] nix-grpc-daemon[783]: ts=2026-09-23T04:42:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 46.175594] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 46.183103] nix-daemon[874]: reaped child process 964, status = succeeded client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 46.195837] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 47.016373] nix-daemon[874]: reaped child process 973, status = succeeded worker2 # [ 47.091743] nix-daemon[874]: accepted connection from pid 989, user nix-grpc-daemon (trusted) worker2 # [ 47.104516] nix-daemon[874]: reaped child process 992, status = succeeded lb # [ 47.111801] niks3-server[1046]: 2026/09/23 04:42:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.122722] nix-grpc-daemon[889]: time=2026-09-23T04:42:19.206Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.124407] nix-grpc-daemon[889]: time=2026-09-23T04:42:19.208Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 47.154061] niks3-server[1046]: 2026/09/23 04:42:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker2 # [ 47.165824] nix-grpc-daemon[889]: time=2026-09-23T04:42:19.250Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.164255] niks3-server[1046]: 2026/09/23 04:42:19 INFO Signed narinfos id=6 count=1 lb # [ 47.169586] niks3-server[1046]: 2026/09/23 04:42:19 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 47.175527] niks3-server[1046]: 2026/09/23 04:42:19 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 47.178872] niks3-server[1046]: 2026/09/23 04:42:19 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 47.189072] niks3-server[1046]: 2026/09/23 04:42:19 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 47.197271] niks3-server[1046]: 2026/09/23 04:42:19 INFO Completed upload id=6 worker2 # [ 47.199178] nix-grpc-daemon[889]: time=2026-09-23T04:42:19.283Z level=INFO msg="Upload complete. (191ms)" lb # [ 47.200131] niks3-server[1046]: 2026/09/23 04:42:19 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker2 # [ 47.205681] nix-grpc-daemon[783]: ts=2026-09-23T04:42:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker2 # [ 47.220687] nix-daemon[874]: reaped child process 971, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.44 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.12 seconds) lb # [ 47.406231] envoy[926]: conn peer=[2001:db8:1::1]:49130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=1868 lb # [ 47.409922] envoy[926]: conn peer=[2001:db8:1::1]:49136 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=55 lb # [ 47.413941] envoy[926]: conn peer=[2001:db8:1::1]:49150 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=8 lb # [ 47.417272] envoy[926]: conn peer=[2001:db8:1::1]:49158 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 lb # [ 47.420772] envoy[926]: conn peer=[2001:db8:1::1]:49174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9477 tx=4349 ms=5290 client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 5.82 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 48.071048] nix-grpc-daemon[779]: ts=2026-09-23T04:42:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40946 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 48.076615] nix-grpc-daemon[779]: ts=2026-09-23T04:42:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker2 # [ 48.140691] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.21 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.81 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 48.684853] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46108 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 48.693728] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 48.704175] nix-grpc-daemon[889]: time=2026-09-23T04:42:20.788Z level=INFO msg="All 2 paths already cached" worker2 # [ 48.716978] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 48.723296] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.728159] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 48.739185] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 48.751720] nix-grpc-daemon[889]: time=2026-09-23T04:42:20.836Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker2 # [ 48.760705] nix-grpc-daemon[783]: ts=2026-09-23T04:42:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 48.769697] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 48.867211] nix-daemon[874]: accepted connection from pid 1021, user nix-grpc-daemon (trusted) worker2 # [ 48.881541] nix-daemon[874]: reaped child process 1024, status = succeeded lb # [ 48.885825] niks3-server[1046]: 2026/09/23 04:42:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.895641] nix-grpc-daemon[889]: time=2026-09-23T04:42:20.980Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 48.897273] nix-grpc-daemon[889]: time=2026-09-23T04:42:20.981Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 48.925373] niks3-server[1046]: 2026/09/23 04:42:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 48.932768] niks3-server[1046]: 2026/09/23 04:42:20 INFO Signed narinfos id=7 count=1 worker2 # [ 48.937610] nix-grpc-daemon[889]: time=2026-09-23T04:42:21.021Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.937966] niks3-server[1046]: 2026/09/23 04:42:20 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 48.950439] niks3-server[1046]: 2026/09/23 04:42:20 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 48.958143] niks3-server[1046]: 2026/09/23 04:42:20 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 48.962082] niks3-server[1046]: 2026/09/23 04:42:20 INFO Completed upload id=7 lb # [ 48.964630] niks3-server[1046]: 2026/09/23 04:42:20 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker2 # [ 48.964044] nix-grpc-daemon[889]: time=2026-09-23T04:42:21.048Z level=INFO msg="Upload complete. (181ms)" worker2 # [ 48.968601] nix-grpc-daemon[783]: ts=2026-09-23T04:42:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 48.975594] nix-grpc-daemon[783]: ts=2026-09-23T04:42:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 48.986113] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 48.994798] nix-daemon[874]: reaped child process 1019, status = succeeded worker2 # [ 48.999706] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 50.635118] nix-daemon[874]: reaped child process 1028, status = succeeded worker2 # [ 50.723194] nix-daemon[874]: accepted connection from pid 1044, user nix-grpc-daemon (trusted) worker2 # [ 50.737417] nix-daemon[874]: reaped child process 1047, status = succeeded lb # [ 50.742449] niks3-server[1046]: 2026/09/23 04:42:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.753611] nix-grpc-daemon[889]: time=2026-09-23T04:42:22.837Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 50.758921] nix-grpc-daemon[889]: time=2026-09-23T04:42:22.839Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 50.785243] niks3-server[1046]: 2026/09/23 04:42:22 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 50.790590] niks3-server[1046]: 2026/09/23 04:42:22 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 50.794893] niks3-server[1046]: 2026/09/23 04:42:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 50.799097] niks3-server[1046]: 2026/09/23 04:42:22 INFO Signed narinfos id=8 count=1 worker2 # [ 50.803603] nix-grpc-daemon[889]: time=2026-09-23T04:42:22.887Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.811710] niks3-server[1046]: 2026/09/23 04:42:22 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 50.814471] niks3-server[1046]: 2026/09/23 04:42:22 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 50.819498] niks3-server[1046]: 2026/09/23 04:42:22 INFO Completed upload id=8 worker2 # [ 50.821476] nix-grpc-daemon[889]: time=2026-09-23T04:42:22.905Z level=INFO msg="Upload complete. (211ms)" lb # [ 50.822068] niks3-server[1046]: 2026/09/23 04:42:22 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker2 # [ 50.827402] nix-grpc-daemon[783]: ts=2026-09-23T04:42:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker2 # [ 50.839881] nix-daemon[874]: reaped child process 1026, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.33 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.12 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.67 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 worker1 # [ 51.199880] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40946 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 51.211308] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker2 # [ 51.272743] nix-grpc-daemon[783]: ts=2026-09-23T04:42:23Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker1 # [ 51.236187] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker2 # [ 51.277333] nix-grpc-daemon[783]: ts=2026-09-23T04:42:23Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.247520] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker1 # [ 51.258125] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 51.263332] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 51.408498] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=info event=niks3_push_started pid=873 worker1 # [ 51.545516] nix-grpc-daemon[873]: time=2026-09-23T04:42:22.795Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 51.637993] nix-daemon[847]: accepted connection from pid 885, user nix-grpc-daemon (trusted) worker1 # [ 51.650420] nix-daemon[847]: reaped child process 888, status = succeeded lb # [ 51.696296] niks3-server[1046]: 2026/09/23 04:42:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.667347] nix-grpc-daemon[873]: time=2026-09-23T04:42:22.918Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 51.668890] nix-grpc-daemon[873]: time=2026-09-23T04:42:22.920Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 51.732509] niks3-server[1046]: 2026/09/23 04:42:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 51.739572] niks3-server[1046]: 2026/09/23 04:42:23 INFO Signed narinfos id=9 count=1 worker1 # [ 51.704963] nix-grpc-daemon[873]: time=2026-09-23T04:42:22.956Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.748833] niks3-server[1046]: 2026/09/23 04:42:23 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 51.756203] niks3-server[1046]: 2026/09/23 04:42:23 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 51.765285] niks3-server[1046]: 2026/09/23 04:42:23 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker1 # [ 51.734902] nix-grpc-daemon[873]: time=2026-09-23T04:42:22.986Z level=INFO msg="Upload complete. (186ms)" lb # [ 51.772762] niks3-server[1046]: 2026/09/23 04:42:23 INFO Completed upload id=9 worker1 # [ 51.737381] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 51.776878] niks3-server[1046]: 2026/09/23 04:42:23 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 51.742375] nix-grpc-daemon[779]: ts=2026-09-23T04:42:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 51.750347] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 51.756191] nix-daemon[847]: reaped child process 871, status = succeeded worker1 # [ 51.759202] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 52.597489] nix-daemon[847]: reaped child process 892, status = succeeded worker1 # [ 52.677831] nix-daemon[847]: accepted connection from pid 908, user nix-grpc-daemon (trusted) worker1 # [ 52.690243] nix-daemon[847]: reaped child process 911, status = succeeded lb # [ 52.733392] niks3-server[1046]: 2026/09/23 04:42:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.703740] nix-grpc-daemon[873]: time=2026-09-23T04:42:23.955Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.707680] nix-grpc-daemon[873]: time=2026-09-23T04:42:23.956Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 52.764409] niks3-server[1046]: 2026/09/23 04:42:24 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 52.777294] niks3-server[1046]: 2026/09/23 04:42:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 52.782726] niks3-server[1046]: 2026/09/23 04:42:24 INFO Signed narinfos id=10 count=1 worker1 # [ 52.747857] nix-grpc-daemon[873]: time=2026-09-23T04:42:23.999Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.790249] niks3-server[1046]: 2026/09/23 04:42:24 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 52.799159] niks3-server[1046]: 2026/09/23 04:42:24 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 52.803137] niks3-server[1046]: 2026/09/23 04:42:24 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 52.806350] niks3-server[1046]: 2026/09/23 04:42:24 INFO Completed upload id=10 worker1 # [ 52.769237] nix-grpc-daemon[873]: time=2026-09-23T04:42:24.020Z level=INFO msg="Upload complete. (203ms)" lb # [ 52.808432] niks3-server[1046]: 2026/09/23 04:42:24 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker1 # [ 52.774560] nix-grpc-daemon[779]: ts=2026-09-23T04:42:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 52.818397] nix-grpc-daemon[783]: ts=2026-09-23T04:42:24Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker2 # [ 52.820827] nix-grpc-daemon[783]: ts=2026-09-23T04:42:24Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.787762] nix-daemon[847]: reaped child process 890, status = succeeded worker1 # [ 52.823182] nix-grpc-daemon[779]: ts=2026-09-23T04:42:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 52.829616] nix-grpc-daemon[779]: ts=2026-09-23T04:42:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 52.838378] nix-grpc-daemon[873]: time=2026-09-23T04:42:24.089Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker1 # [ 52.846224] nix-grpc-daemon[779]: ts=2026-09-23T04:42:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 52.856209] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 52.947469] nix-daemon[847]: accepted connection from pid 915, user nix-grpc-daemon (trusted) worker1 # [ 52.961503] nix-daemon[847]: reaped child process 918, status = succeeded lb # [ 53.005466] niks3-server[1046]: 2026/09/23 04:42:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.976079] nix-grpc-daemon[873]: time=2026-09-23T04:42:24.227Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 52.977591] nix-grpc-daemon[873]: time=2026-09-23T04:42:24.229Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 53.039175] niks3-server[1046]: 2026/09/23 04:42:25 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 53.043416] niks3-server[1046]: 2026/09/23 04:42:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 53.048785] niks3-server[1046]: 2026/09/23 04:42:25 INFO Signed narinfos id=11 count=1 worker1 # [ 53.014358] nix-grpc-daemon[873]: time=2026-09-23T04:42:24.265Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.060142] niks3-server[1046]: 2026/09/23 04:42:25 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 53.071249] niks3-server[1046]: 2026/09/23 04:42:25 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 53.077548] niks3-server[1046]: 2026/09/23 04:42:25 INFO Completed upload id=11 lb # [ 53.081112] niks3-server[1046]: 2026/09/23 04:42:25 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker1 # [ 53.043345] nix-grpc-daemon[873]: time=2026-09-23T04:42:24.294Z level=INFO msg="Upload complete. (177ms)" worker1 # [ 53.047570] nix-grpc-daemon[779]: ts=2026-09-23T04:42:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 53.053401] nix-grpc-daemon[779]: ts=2026-09-23T04:42:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 53.063695] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 53.072657] nix-daemon[847]: reaped child process 913, status = succeeded worker1 # [ 53.077483] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 53.919690] nix-daemon[847]: reaped child process 922, status = succeeded worker1 # [ 53.994714] nix-daemon[847]: accepted connection from pid 938, user nix-grpc-daemon (trusted) worker1 # [ 54.007773] nix-daemon[847]: reaped child process 941, status = succeeded lb # [ 54.053653] niks3-server[1046]: 2026/09/23 04:42:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.030754] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.282Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 54.032397] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.283Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 54.097679] niks3-server[1046]: 2026/09/23 04:42:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 54.102104] niks3-server[1046]: 2026/09/23 04:42:26 INFO Signed narinfos id=12 count=1 worker1 # [ 54.067451] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.318Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.114640] niks3-server[1046]: 2026/09/23 04:42:26 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 54.120760] niks3-server[1046]: 2026/09/23 04:42:26 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 54.124627] niks3-server[1046]: 2026/09/23 04:42:26 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 54.128940] niks3-server[1046]: 2026/09/23 04:42:26 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 54.132228] niks3-server[1046]: 2026/09/23 04:42:26 INFO Completed upload id=12 worker1 # [ 54.094930] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.346Z level=INFO msg="Upload complete. (210ms)" lb # [ 54.134365] niks3-server[1046]: 2026/09/23 04:42:26 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker1 # [ 54.099885] nix-grpc-daemon[779]: ts=2026-09-23T04:42:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 54.146817] nix-grpc-daemon[783]: ts=2026-09-23T04:42:26Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 54.113206] nix-daemon[847]: reaped child process 920, status = succeeded worker2 # [ 54.151154] nix-grpc-daemon[783]: ts=2026-09-23T04:42:26Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 54.151407] nix-grpc-daemon[779]: ts=2026-09-23T04:42:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 54.164204] nix-grpc-daemon[779]: ts=2026-09-23T04:42:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 54.178171] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.429Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker1 # [ 54.187302] nix-grpc-daemon[779]: ts=2026-09-23T04:42:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 54.197182] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 54.293966] nix-daemon[847]: accepted connection from pid 945, user nix-grpc-daemon (trusted) worker1 # [ 54.307436] nix-daemon[847]: reaped child process 948, status = succeeded lb # [ 54.351429] niks3-server[1046]: 2026/09/23 04:42:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.322336] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.573Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 54.323806] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.575Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 54.382572] niks3-server[1046]: 2026/09/23 04:42:26 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 54.392746] niks3-server[1046]: 2026/09/23 04:42:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 54.360778] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.612Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.398300] niks3-server[1046]: 2026/09/23 04:42:26 INFO Signed narinfos id=13 count=1 lb # [ 54.405736] niks3-server[1046]: 2026/09/23 04:42:26 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 54.415507] niks3-server[1046]: 2026/09/23 04:42:26 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 54.419664] niks3-server[1046]: 2026/09/23 04:42:26 INFO Completed upload id=13 worker1 # [ 54.382336] nix-grpc-daemon[873]: time=2026-09-23T04:42:25.633Z level=INFO msg="Upload complete. (173ms)" lb # [ 54.421233] niks3-server[1046]: 2026/09/23 04:42:26 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker1 # [ 54.386341] nix-grpc-daemon[779]: ts=2026-09-23T04:42:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 54.391155] nix-grpc-daemon[779]: ts=2026-09-23T04:42:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 54.400689] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 54.406532] nix-daemon[847]: reaped child process 943, status = succeeded worker1 # [ 54.411280] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 55.626101] nix-daemon[847]: reaped child process 952, status = succeeded worker1 # [ 55.701253] nix-daemon[847]: accepted connection from pid 968, user nix-grpc-daemon (trusted) worker1 # [ 55.714791] nix-daemon[847]: reaped child process 971, status = succeeded lb # [ 55.760507] niks3-server[1046]: 2026/09/23 04:42:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.730178] nix-grpc-daemon[873]: time=2026-09-23T04:42:26.981Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 55.731723] nix-grpc-daemon[873]: time=2026-09-23T04:42:26.983Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 55.802530] niks3-server[1046]: 2026/09/23 04:42:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 55.809267] niks3-server[1046]: 2026/09/23 04:42:27 INFO Signed narinfos id=14 count=1 worker1 # [ 55.775133] nix-grpc-daemon[873]: time=2026-09-23T04:42:27.026Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.821287] niks3-server[1046]: 2026/09/23 04:42:27 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 55.829699] niks3-server[1046]: 2026/09/23 04:42:27 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 55.834323] niks3-server[1046]: 2026/09/23 04:42:27 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 55.840643] niks3-server[1046]: 2026/09/23 04:42:27 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 55.845687] niks3-server[1046]: 2026/09/23 04:42:27 INFO Completed upload id=14 worker1 # [ 55.808441] nix-grpc-daemon[873]: time=2026-09-23T04:42:27.059Z level=INFO msg="Upload complete. (190ms)" lb # [ 55.849957] niks3-server[1046]: 2026/09/23 04:42:27 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker1 # [ 55.814567] nix-grpc-daemon[779]: ts=2026-09-23T04:42:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker1 # [ 55.829090] nix-daemon[847]: reaped child process 950, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 4.78 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 56.053980] nix-grpc-daemon[779]: ts=2026-09-23T04:42:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:40164 worker1 # [ 56.095783] nix-grpc-daemon[779]: ts=2026-09-23T04:42:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:40164 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.21 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 56.315073] nix-grpc-daemon[783]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57688 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 56.347722] nix-grpc-daemon[783]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57688 worker2 # [ 56.354718] nix-grpc-daemon[783]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker2 # [ 56.368875] nix-grpc-daemon[783]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker2 # [ 56.381527] nix-grpc-daemon[783]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.22 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/809" client # removing stale temporary roots file "/nix/var/nix/temproots/878" client # removing stale temporary roots file "/nix/var/nix/temproots/901" client # removing stale temporary roots file "/nix/var/nix/temproots/886" client # removing stale temporary roots file "/nix/var/nix/temproots/845" client # removing stale temporary roots file "/nix/var/nix/temproots/865" client # removing stale temporary roots file "/nix/var/nix/temproots/824" client # removing stale temporary roots file "/nix/var/nix/temproots/857" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 56.698779] nix-grpc-daemon[783]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 56.706271] nix-grpc-daemon[783]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 56.804186] nix-grpc-daemon[889]: time=2026-09-23T04:42:28.887Z level=INFO msg="All 1 paths already cached" worker1 # [ 56.773628] nix-grpc-daemon[779]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 56.781111] nix-grpc-daemon[779]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40946 client # copying 3 paths... worker1 # [ 56.791727] nix-grpc-daemon[779]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40946 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker2 # [ 56.848779] nix-grpc-daemon[783]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 56.854228] nix-grpc-daemon[783]: ts=2026-09-23T04:42:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_out=232 worker1 # [ 56.817414] nix-grpc-daemon[779]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 56.823179] nix-grpc-daemon[779]: ts=2026-09-23T04:42:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 56.829564] nix-grpc-daemon[779]: ts=2026-09-23T04:42:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 56.833290] nix-grpc-daemon[779]: ts=2026-09-23T04:42:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.54 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 5.85 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 56.973970] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: cca64235fee44b469333edeb47b446ac client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.04 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup worker2 # [ 57.111215] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46108 client # [ 57.107208] nix[953]: don't know how to build these paths: client # [ 57.108145] nix[953]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 57.125876] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 57.131268] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.170934] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 57.184376] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 client # [ 57.184392] nix[953]: copying 1 paths to 'lb:50051'... worker2 # [ 57.195947] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 client # [ 57.186623] nix[953]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 57.208847] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 57.316405] nix-daemon[874]: accepted connection from pid 1067, user nix-grpc-daemon (trusted) worker2 # [ 57.331545] nix-daemon[874]: reaped child process 1070, status = succeeded lb # [ 57.338382] niks3-server[1046]: 2026/09/23 04:42:29 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 57.407230] envoy[926]: conn peer=[2001:db8:1::1]:35560 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=44 lb # [ 57.410993] envoy[926]: conn peer=[2001:db8:1::1]:35564 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4165 tx=1879 ms=2157 lb # [ 57.414661] envoy[926]: conn peer=[2001:db8:1::1]:35570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=4379 ms=4625 lb # [ 57.418303] envoy[926]: conn peer=[2001:db8:1::1]:48154 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2887 ms=238 lb # [ 57.422571] envoy[926]: conn peer=[2001:db8:1::1]:48168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=88 lb # [ 57.426119] envoy[926]: conn peer=[2001:db8:1::1]:48184 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=81 lb # [ 57.429572] envoy[926]: conn peer=[2001:db8:1::1]:48192 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=74 worker2 # [ 57.644167] nix-grpc-daemon[889]: time=2026-09-23T04:42:29.728Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.649166] nix-grpc-daemon[889]: time=2026-09-23T04:42:29.728Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 57.668797] niks3-server[1046]: 2026/09/23 04:42:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker2 # [ 57.679932] nix-grpc-daemon[889]: time=2026-09-23T04:42:29.764Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.679140] niks3-server[1046]: 2026/09/23 04:42:29 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 57.683435] niks3-server[1046]: 2026/09/23 04:42:29 INFO Signed narinfos id=15 count=1 lb # [ 57.695159] niks3-server[1046]: 2026/09/23 04:42:29 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 57.702604] niks3-server[1046]: 2026/09/23 04:42:29 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 57.708529] niks3-server[1046]: 2026/09/23 04:42:29 INFO Completed upload id=15 worker2 # [ 57.710527] nix-grpc-daemon[889]: time=2026-09-23T04:42:29.794Z level=INFO msg="Upload complete. (490ms)" worker2 # [ 57.718959] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 57.724093] nix-grpc-daemon[783]: ts=2026-09-23T04:42:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 lb # [ 57.723445] niks3-server[1046]: 2026/09/23 04:42:29 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 57.737488] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 57.747303] nix-daemon[874]: reaped child process 1065, status = succeeded client # [ 57.746221] nix[953]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker2 # [ 57.758208] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # [ 58.017656] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: c01c6e55fbfa44729d95dd672ec90430 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.04 seconds) worker1 # [ 58.126585] nix-grpc-daemon[779]: ts=2026-09-23T04:42:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40946 client # [ 58.160848] nix[969]: don't know how to build these paths: client # [ 58.162418] nix[969]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 58.179692] nix-grpc-daemon[783]: ts=2026-09-23T04:42:30Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 58.189171] nix-grpc-daemon[783]: ts=2026-09-23T04:42:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 client # [ 58.184127] nix[969]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.02 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 61.380173] nix-daemon[874]: reaped child process 1074, status = succeeded worker2 # [ 61.454830] nix-daemon[874]: accepted connection from pid 1106, user nix-grpc-daemon (trusted) worker2 # [ 61.468162] nix-daemon[874]: reaped child process 1109, status = succeeded lb # [ 61.473953] niks3-server[1046]: 2026/09/23 04:42:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.486983] nix-grpc-daemon[889]: time=2026-09-23T04:42:33.571Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 61.490059] nix-grpc-daemon[889]: time=2026-09-23T04:42:33.573Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 61.524312] niks3-server[1046]: 2026/09/23 04:42:33 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 61.528751] niks3-server[1046]: 2026/09/23 04:42:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 61.533636] niks3-server[1046]: 2026/09/23 04:42:33 INFO Signed narinfos id=16 count=1 worker2 # [ 61.538867] nix-grpc-daemon[889]: time=2026-09-23T04:42:33.623Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.541375] niks3-server[1046]: 2026/09/23 04:42:33 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 61.549045] niks3-server[1046]: 2026/09/23 04:42:33 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 61.558883] niks3-server[1046]: 2026/09/23 04:42:33 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 61.562148] niks3-server[1046]: 2026/09/23 04:42:33 INFO Completed upload id=16 worker2 # [ 61.564004] nix-grpc-daemon[889]: time=2026-09-23T04:42:33.648Z level=INFO msg="Upload complete. (191ms)" lb # [ 61.564277] niks3-server[1046]: 2026/09/23 04:42:33 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 61.570705] nix-grpc-daemon[783]: ts=2026-09-23T04:42:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 61.580301] nix-grpc-daemon[783]: ts=2026-09-23T04:42:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 61.592229] nix-daemon[874]: reaped child process 1072, status = succeeded client # [ 61.610400] systemd[1]: dedup1.service: Deactivated successfully. client # [ 61.614169] systemd[1]: dedup1.service: Consumed 117ms CPU time over 4.639s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.6K outgoing IP traffic. client # [ 61.620716] systemd[1]: dedup2.service: Deactivated successfully. client # [ 61.623631] systemd[1]: dedup2.service: Consumed 128ms CPU time over 3.605s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.71 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 62.811805] nix-grpc-daemon[783]: ts=2026-09-23T04:42:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 62.824737] nix-grpc-daemon[783]: ts=2026-09-23T04:42:34Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 62.829343] nix-grpc-daemon[783]: ts=2026-09-23T04:42:34Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 62.793870] nix-grpc-daemon[779]: ts=2026-09-23T04:42:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 62.807917] nix-grpc-daemon[779]: ts=2026-09-23T04:42:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 62.820134] nix-grpc-daemon[779]: ts=2026-09-23T04:42:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 62.831599] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 62.935649] nix-daemon[847]: accepted connection from pid 996, user nix-grpc-daemon (trusted) worker1 # [ 62.950712] nix-daemon[847]: reaped child process 999, status = succeeded lb # [ 62.993121] niks3-server[1046]: 2026/09/23 04:42:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 62.960161] nix-grpc-daemon[873]: time=2026-09-23T04:42:34.211Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 62.962186] nix-grpc-daemon[873]: time=2026-09-23T04:42:34.213Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 63.008940] niks3-server[1046]: 2026/09/23 04:42:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 63.013257] niks3-server[1046]: 2026/09/23 04:42:35 INFO Signed narinfos id=17 count=1 worker1 # [ 62.975821] nix-grpc-daemon[873]: time=2026-09-23T04:42:34.227Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.015754] niks3-server[1046]: 2026/09/23 04:42:35 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 63.018518] niks3-server[1046]: 2026/09/23 04:42:35 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 63.023775] niks3-server[1046]: 2026/09/23 04:42:35 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 63.028123] niks3-server[1046]: 2026/09/23 04:42:35 INFO Completed upload id=17 worker1 # [ 62.990753] nix-grpc-daemon[873]: time=2026-09-23T04:42:34.242Z level=INFO msg="Upload complete. (147ms)" lb # [ 63.030505] niks3-server[1046]: 2026/09/23 04:42:35 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker1 # [ 62.993487] nix-grpc-daemon[779]: ts=2026-09-23T04:42:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 62.998225] nix-grpc-daemon[779]: ts=2026-09-23T04:42:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 63.004876] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 63.007374] nix-daemon[847]: reaped child process 994, status = succeeded worker1 # [ 63.013718] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) lb # [ 67.407808] envoy[926]: conn peer=[2001:db8:1::1]:48194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2998 tx=1563 ms=4477 lb # [ 67.411708] envoy[926]: conn peer=[2001:db8:1::1]:48208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=3425 worker1 # [ 68.824429] nix-grpc-daemon[779]: ts=2026-09-23T04:42:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=5 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker1 # [ 68.844426] nix-daemon[847]: reaped child process 1001, status = succeeded worker1 # [ 68.845784] nix-daemon[847]: reaped child process 1003, status = succeeded worker1 # [ 69.031277] nix-grpc-daemon[779]: ts=2026-09-23T04:42:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40946 worker2 # [ 69.079898] nix-grpc-daemon[783]: ts=2026-09-23T04:42:41Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 69.086140] nix-grpc-daemon[783]: ts=2026-09-23T04:42:41Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 69.092925] nix-grpc-daemon[783]: ts=2026-09-23T04:42:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 69.104103] nix-grpc-daemon[783]: ts=2026-09-23T04:42:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 69.114822] nix-grpc-daemon[783]: ts=2026-09-23T04:42:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 69.125814] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 69.229638] nix-daemon[874]: accepted connection from pid 1126, user nix-grpc-daemon (trusted) worker2 # [ 69.245573] nix-daemon[874]: reaped child process 1129, status = succeeded lb # [ 69.250790] niks3-server[1046]: 2026/09/23 04:42:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.262452] nix-grpc-daemon[889]: time=2026-09-23T04:42:41.346Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 69.263843] nix-grpc-daemon[889]: time=2026-09-23T04:42:41.346Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 69.284242] niks3-server[1046]: 2026/09/23 04:42:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 69.292982] niks3-server[1046]: 2026/09/23 04:42:41 INFO Signed narinfos id=18 count=1 worker2 # [ 69.298673] nix-grpc-daemon[889]: time=2026-09-23T04:42:41.383Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.300123] niks3-server[1046]: 2026/09/23 04:42:41 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 69.307667] niks3-server[1046]: 2026/09/23 04:42:41 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 69.319266] niks3-server[1046]: 2026/09/23 04:42:41 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 69.327654] niks3-server[1046]: 2026/09/23 04:42:41 INFO Completed upload id=18 lb # [ 69.329479] niks3-server[1046]: 2026/09/23 04:42:41 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker2 # [ 69.331084] nix-grpc-daemon[889]: time=2026-09-23T04:42:41.415Z level=INFO msg="Upload complete. (193ms)" worker2 # [ 69.337337] nix-grpc-daemon[783]: ts=2026-09-23T04:42:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 69.342401] nix-grpc-daemon[783]: ts=2026-09-23T04:42:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 69.354114] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 69.362226] nix-daemon[874]: reaped child process 1124, status = succeeded worker2 # [ 69.367377] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 75.379321] nix-grpc-daemon[783]: ts=2026-09-23T04:42:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker2 # [ 75.391071] nix-daemon[874]: reaped child process 1131, status = succeeded worker2 # [ 75.392702] nix-daemon[874]: reaped child process 1133, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 12.84 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 75.541904] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 5b1eef9e0c654260983fd82bec86e88e client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share worker2 # [ 75.695660] nix-grpc-daemon[783]: ts=2026-09-23T04:42:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46108 client # [ 75.692141] nix[1043]: don't know how to build these paths: client # [ 75.693035] nix[1043]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 75.710370] nix-grpc-daemon[783]: ts=2026-09-23T04:42:47Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 75.714985] nix-grpc-daemon[783]: ts=2026-09-23T04:42:47Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.680414] nix-grpc-daemon[779]: ts=2026-09-23T04:42:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 75.692414] nix-grpc-daemon[779]: ts=2026-09-23T04:42:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 client # [ 75.731621] nix[1043]: copying 1 paths to 'lb:50051'... client # [ 75.732578] nix[1043]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker1 # [ 75.704370] nix-grpc-daemon[779]: ts=2026-09-23T04:42:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 75.715232] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 75.817343] nix-daemon[847]: accepted connection from pid 1026, user nix-grpc-daemon (trusted) worker1 # [ 75.830092] nix-daemon[847]: reaped child process 1029, status = succeeded lb # [ 75.875499] niks3-server[1046]: 2026/09/23 04:42:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.889667] nix-grpc-daemon[873]: time=2026-09-23T04:42:47.140Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 75.893100] nix-grpc-daemon[873]: time=2026-09-23T04:42:47.143Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 75.957580] niks3-server[1046]: 2026/09/23 04:42:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 75.965358] niks3-server[1046]: 2026/09/23 04:42:47 INFO Signed narinfos id=19 count=1 worker1 # [ 75.932295] nix-grpc-daemon[873]: time=2026-09-23T04:42:47.183Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.974102] niks3-server[1046]: 2026/09/23 04:42:47 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 75.983822] niks3-server[1046]: 2026/09/23 04:42:47 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 75.992617] niks3-server[1046]: 2026/09/23 04:42:47 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 75.998478] niks3-server[1046]: 2026/09/23 04:42:48 INFO Completed upload id=19 worker1 # [ 75.961297] nix-grpc-daemon[873]: time=2026-09-23T04:42:47.212Z level=INFO msg="Upload complete. (234ms)" lb # [ 76.004856] niks3-server[1046]: 2026/09/23 04:42:48 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker1 # [ 75.966511] nix-grpc-daemon[779]: ts=2026-09-23T04:42:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 75.972978] nix-grpc-daemon[779]: ts=2026-09-23T04:42:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 75.987205] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 75.995264] nix-daemon[847]: reaped child process 1024, status = succeeded client # [ 76.032266] nix[1043]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker1 # [ 76.006130] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # [ 76.611882] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 6466d0ca403e4d00baed16553b314d27 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) worker2 # [ 76.763311] nix-grpc-daemon[783]: ts=2026-09-23T04:42:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46108 client # [ 76.758842] nix[1059]: don't know how to build these paths: client # [ 76.759723] nix[1059]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 76.775949] nix-grpc-daemon[783]: ts=2026-09-23T04:42:48Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 76.740351] nix-grpc-daemon[779]: ts=2026-09-23T04:42:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 client # [ 76.774139] nix[1059]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... lb # [ 77.407408] envoy[926]: conn peer=[2001:db8:1::1]:50610 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=935 ms=6108 lb # [ 77.411512] envoy[926]: conn peer=[2001:db8:1::1]:50612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=935 ms=6326 client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 79.863862] systemd[1]: share1.service: Sent signal SIGINT to main process 1043 (nix) on client request. client # [ 79.870843] nix[1043]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 79.878664] nix[1043]: error: interrupted by the user client # [ 79.920387] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 79.921844] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 79.923819] systemd[1]: share1.service: Consumed 118ms CPU time over 4.381s wall clock time, 41.5M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker1 # [ 81.256469] nix-daemon[847]: reaped child process 1033, status = succeeded worker1 # [ 81.331183] nix-daemon[847]: accepted connection from pid 1068, user nix-grpc-daemon (trusted) worker1 # [ 81.343693] nix-daemon[847]: reaped child process 1071, status = succeeded lb # [ 81.389191] niks3-server[1046]: 2026/09/23 04:42:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 81.360687] nix-grpc-daemon[873]: time=2026-09-23T04:42:52.612Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 81.362250] nix-grpc-daemon[873]: time=2026-09-23T04:42:52.613Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 81.432074] niks3-server[1046]: 2026/09/23 04:42:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker1 # [ 81.401798] nix-grpc-daemon[873]: time=2026-09-23T04:42:52.653Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.438819] niks3-server[1046]: 2026/09/23 04:42:53 INFO Signed narinfos id=20 count=1 lb # [ 81.453521] niks3-server[1046]: 2026/09/23 04:42:53 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 81.457161] niks3-server[1046]: 2026/09/23 04:42:53 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 81.467783] niks3-server[1046]: 2026/09/23 04:42:53 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 81.472165] niks3-server[1046]: 2026/09/23 04:42:53 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 81.474633] niks3-server[1046]: 2026/09/23 04:42:53 INFO Completed upload id=20 worker1 # [ 81.438693] nix-grpc-daemon[873]: time=2026-09-23T04:42:52.690Z level=INFO msg="Upload complete. (217ms)" lb # [ 81.480871] niks3-server[1046]: 2026/09/23 04:42:53 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker1 # [ 81.445833] nix-grpc-daemon[779]: ts=2026-09-23T04:42:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker1 # [ 81.453311] nix-grpc-daemon[779]: ts=2026-09-23T04:42:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker1 # [ 81.465553] nix-daemon[847]: reaped child process 1031, status = succeeded client # [ 81.548492] systemd[1]: share2.service: Deactivated successfully. client # [ 81.552749] systemd[1]: share2.service: Consumed 119ms CPU time over 4.940s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.75 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 82.340092] systemd[1]: Started Nix Daemon. client # [ 82.429775] nix-daemon[1110]: accepted connection from pid 1107, user root (trusted) worker2 # [ 82.558638] nix-grpc-daemon[783]: ts=2026-09-23T04:42:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 82.563923] nix-grpc-daemon[783]: ts=2026-09-23T04:42:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 82.574213] nix-grpc-daemon[783]: ts=2026-09-23T04:42:54Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 82.579585] nix-grpc-daemon[783]: ts=2026-09-23T04:42:54Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 82.585380] nix-grpc-daemon[783]: ts=2026-09-23T04:42:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 82.597230] nix-grpc-daemon[783]: ts=2026-09-23T04:42:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 82.608523] nix-grpc-daemon[783]: ts=2026-09-23T04:42:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 82.617899] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 82.716841] nix-daemon[874]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2 # [ 82.730217] nix-daemon[874]: reaped child process 1181, status = succeeded lb # [ 82.735539] niks3-server[1046]: 2026/09/23 04:42:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 82.745116] nix-grpc-daemon[889]: time=2026-09-23T04:42:54.829Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 82.746552] nix-grpc-daemon[889]: time=2026-09-23T04:42:54.829Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 82.778061] niks3-server[1046]: 2026/09/23 04:42:54 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls worker2 # [ 82.791001] nix-grpc-daemon[889]: time=2026-09-23T04:42:54.875Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.789062] niks3-server[1046]: 2026/09/23 04:42:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 82.792224] niks3-server[1046]: 2026/09/23 04:42:54 INFO Signed narinfos id=21 count=1 lb # [ 82.804665] niks3-server[1046]: 2026/09/23 04:42:54 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 82.942235] niks3-server[1046]: 2026/09/23 04:42:54 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 82.955272] niks3-server[1046]: 2026/09/23 04:42:54 INFO Completed upload id=21 worker2 # [ 82.956902] nix-grpc-daemon[889]: time=2026-09-23T04:42:55.041Z level=INFO msg="Upload complete. (325ms)" worker2 # [ 82.961886] nix-grpc-daemon[783]: ts=2026-09-23T04:42:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 82.961864] niks3-server[1046]: 2026/09/23 04:42:54 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker2 # [ 82.970187] nix-grpc-daemon[783]: ts=2026-09-23T04:42:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 82.982130] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 82.990754] nix-daemon[874]: reaped child process 1176, status = succeeded worker2 # [ 83.001754] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 84.042865] nix-daemon[874]: reaped child process 1185, status = succeeded worker2 # [ 84.128903] nix-daemon[874]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker2 # [ 84.141366] nix-daemon[874]: reaped child process 1204, status = succeeded lb # [ 84.147920] niks3-server[1046]: 2026/09/23 04:42:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 84.158092] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.242Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 84.159565] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.244Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 84.190862] niks3-server[1046]: 2026/09/23 04:42:56 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 84.197566] niks3-server[1046]: 2026/09/23 04:42:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker2 # [ 84.204424] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.288Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.202426] niks3-server[1046]: 2026/09/23 04:42:56 INFO Signed narinfos id=22 count=1 lb # [ 84.210892] niks3-server[1046]: 2026/09/23 04:42:56 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 84.223177] niks3-server[1046]: 2026/09/23 04:42:56 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 84.228883] niks3-server[1046]: 2026/09/23 04:42:56 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 84.234570] niks3-server[1046]: 2026/09/23 04:42:56 INFO Completed upload id=22 worker2 # [ 84.237914] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.322Z level=INFO msg="Upload complete. (223ms)" lb # [ 84.238403] niks3-server[1046]: 2026/09/23 04:42:56 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker2 # [ 84.244753] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker2 # [ 84.259565] nix-daemon[874]: reaped child process 1183, status = succeeded worker1 # [ 84.253564] nix-grpc-daemon[779]: ts=2026-09-23T04:42:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 84.265251] nix-grpc-daemon[779]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 84.294373] nix-grpc-daemon[779]: ts=2026-09-23T04:42:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 84.299525] nix-grpc-daemon[779]: ts=2026-09-23T04:42:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 84.511383] nix-grpc-daemon[779]: ts=2026-09-23T04:42:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 84.518101] nix-grpc-daemon[779]: ts=2026-09-23T04:42:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 84.523607] nix-grpc-daemon[873]: time=2026-09-23T04:42:55.773Z level=INFO msg="All 1 paths already cached" worker2 # [ 84.572694] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 84.578721] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 84.584700] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 84.597277] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 84.609664] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.694Z level=INFO msg="All 1 paths already cached" worker2 # [ 84.617406] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 84.628135] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 84.731496] nix-daemon[874]: accepted connection from pid 1210, user nix-grpc-daemon (trusted) worker2 # [ 84.745908] nix-daemon[874]: reaped child process 1213, status = succeeded lb # [ 84.750103] niks3-server[1046]: 2026/09/23 04:42:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 84.759775] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.844Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 84.761314] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.845Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 84.780947] niks3-server[1046]: 2026/09/23 04:42:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 84.790353] niks3-server[1046]: 2026/09/23 04:42:56 INFO Signed narinfos id=23 count=1 worker2 # [ 84.795161] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.879Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.795715] niks3-server[1046]: 2026/09/23 04:42:56 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 84.801216] niks3-server[1046]: 2026/09/23 04:42:56 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 84.815124] niks3-server[1046]: 2026/09/23 04:42:56 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 84.823248] niks3-server[1046]: 2026/09/23 04:42:56 INFO Completed upload id=23 worker2 # [ 84.825173] nix-grpc-daemon[889]: time=2026-09-23T04:42:56.909Z level=INFO msg="Upload complete. (184ms)" lb # [ 84.829083] niks3-server[1046]: 2026/09/23 04:42:56 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker2 # [ 84.829315] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 84.835641] nix-grpc-daemon[783]: ts=2026-09-23T04:42:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 84.847142] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 84.854689] nix-daemon[874]: reaped child process 1208, status = succeeded worker2 # [ 84.859601] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 85.901671] nix-daemon[874]: reaped child process 1217, status = succeeded worker2 # [ 85.979688] nix-daemon[874]: accepted connection from pid 1233, user nix-grpc-daemon (trusted) worker2 # [ 85.991199] nix-daemon[874]: reaped child process 1236, status = succeeded lb # [ 85.997533] niks3-server[1046]: 2026/09/23 04:42:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.009036] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.093Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 86.010540] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.095Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 86.046456] niks3-server[1046]: 2026/09/23 04:42:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 86.055825] niks3-server[1046]: 2026/09/23 04:42:58 INFO Signed narinfos id=24 count=1 worker2 # [ 86.060757] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.145Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.063836] niks3-server[1046]: 2026/09/23 04:42:58 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 86.068095] niks3-server[1046]: 2026/09/23 04:42:58 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 86.076452] niks3-server[1046]: 2026/09/23 04:42:58 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 86.086063] niks3-server[1046]: 2026/09/23 04:42:58 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 86.089859] niks3-server[1046]: 2026/09/23 04:42:58 INFO Completed upload id=24 worker2 # [ 86.091590] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.175Z level=INFO msg="Upload complete. (224ms)" lb # [ 86.091862] niks3-server[1046]: 2026/09/23 04:42:58 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker2 # [ 86.098798] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker2 # [ 86.112747] nix-daemon[874]: reaped child process 1215, status = succeeded worker2 # [ 86.144144] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46108 worker1 # [ 86.124532] nix-grpc-daemon[779]: ts=2026-09-23T04:42:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 86.136175] nix-grpc-daemon[779]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker1 # [ 86.149542] nix-grpc-daemon[779]: ts=2026-09-23T04:42:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 86.398779] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46108 worker1 # [ 86.367383] nix-grpc-daemon[779]: ts=2026-09-23T04:42:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 86.378204] nix-grpc-daemon[873]: time=2026-09-23T04:42:57.629Z level=INFO msg="All 2 paths already cached" worker2 # [ 86.431181] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 86.436587] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 86.442897] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 86.455681] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 86.468196] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.552Z level=INFO msg="All 2 paths already cached" worker2 # [ 86.476551] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 86.486168] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 86.583786] nix-daemon[874]: accepted connection from pid 1242, user nix-grpc-daemon (trusted) worker2 # [ 86.597508] nix-daemon[874]: reaped child process 1245, status = succeeded lb # [ 86.602619] niks3-server[1046]: 2026/09/23 04:42:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.612723] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.697Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 86.614813] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.698Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 86.635514] niks3-server[1046]: 2026/09/23 04:42:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 86.641750] niks3-server[1046]: 2026/09/23 04:42:58 INFO Signed narinfos id=25 count=1 worker2 # [ 86.646682] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.731Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.647488] niks3-server[1046]: 2026/09/23 04:42:58 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 86.660179] niks3-server[1046]: 2026/09/23 04:42:58 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 86.669770] niks3-server[1046]: 2026/09/23 04:42:58 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 86.677301] niks3-server[1046]: 2026/09/23 04:42:58 INFO Completed upload id=25 lb # [ 86.680377] niks3-server[1046]: 2026/09/23 04:42:58 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker2 # [ 86.681510] nix-grpc-daemon[889]: time=2026-09-23T04:42:58.765Z level=INFO msg="Upload complete. (182ms)" worker2 # [ 86.685956] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 86.692596] nix-grpc-daemon[783]: ts=2026-09-23T04:42:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 86.703495] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 86.713384] nix-daemon[874]: reaped child process 1240, status = succeeded worker2 # [ 86.718431] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) lb # [ 87.407576] envoy[926]: conn peer=[2001:db8:1::1]:34024 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=771 ms=4201 lb # [ 87.412501] envoy[926]: conn peer=[2001:db8:1::1]:34028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1194 ms=4774 lb # [ 87.416458] envoy[926]: conn peer=[2001:db8:1::1]:47188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=58 lb # [ 87.420299] envoy[926]: conn peer=[2001:db8:1::1]:34038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3426 tx=1939 ms=1834 lb # [ 87.424460] envoy[926]: conn peer=[2001:db8:1::1]:47192 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3876 tx=2140 ms=1690 lb # [ 87.428968] envoy[926]: conn peer=[2001:db8:1::1]:47208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=79 worker2 # [ 87.535188] nix-daemon[874]: reaped child process 1249, status = succeeded worker2 # [ 87.609379] nix-daemon[874]: accepted connection from pid 1265, user nix-grpc-daemon (trusted) worker2 # [ 87.623611] nix-daemon[874]: reaped child process 1268, status = succeeded lb # [ 87.630395] niks3-server[1046]: 2026/09/23 04:42:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.640054] nix-grpc-daemon[889]: time=2026-09-23T04:42:59.724Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 87.641739] nix-grpc-daemon[889]: time=2026-09-23T04:42:59.726Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 87.675804] niks3-server[1046]: 2026/09/23 04:42:59 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 87.679638] niks3-server[1046]: 2026/09/23 04:42:59 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 87.685315] niks3-server[1046]: 2026/09/23 04:42:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 87.691090] niks3-server[1046]: 2026/09/23 04:42:59 INFO Signed narinfos id=26 count=1 worker2 # [ 87.695467] nix-grpc-daemon[889]: time=2026-09-23T04:42:59.779Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.696447] niks3-server[1046]: 2026/09/23 04:42:59 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 87.706339] niks3-server[1046]: 2026/09/23 04:42:59 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 87.710913] niks3-server[1046]: 2026/09/23 04:42:59 INFO Completed upload id=26 worker2 # [ 87.712885] nix-grpc-daemon[889]: time=2026-09-23T04:42:59.797Z level=INFO msg="Upload complete. (188ms)" lb # [ 87.712803] niks3-server[1046]: 2026/09/23 04:42:59 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker2 # [ 87.719328] nix-grpc-daemon[783]: ts=2026-09-23T04:42:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker1 # [ 87.689846] nix-grpc-daemon[779]: ts=2026-09-23T04:42:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40946 worker2 # [ 87.732174] nix-daemon[874]: reaped child process 1247, status = succeeded worker1 # [ 87.699749] nix-grpc-daemon[779]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 87.762858] nix-grpc-daemon[783]: ts=2026-09-23T04:42:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 87.768336] nix-grpc-daemon[783]: ts=2026-09-23T04:42:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 paths=1 nar_bytes_out=232 client # [ 87.827972] nix-daemon[1110]: reaped child process 1112, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.59 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.65 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 88.506199] nix-daemon[1110]: accepted connection from pid 1193, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker1 # [ 88.602807] nix-grpc-daemon[779]: ts=2026-09-23T04:42:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40946 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 88.608892] nix-grpc-daemon[779]: ts=2026-09-23T04:42:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 88.713042] nix-daemon[847]: accepted connection from pid 1081, user nix-grpc-daemon (trusted) worker1 # [ 88.724892] nix-daemon[847]: reaped child process 1084, status = succeeded lb # [ 88.769345] niks3-server[1046]: 2026/09/23 04:43:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 88.742040] nix-grpc-daemon[873]: time=2026-09-23T04:42:59.993Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 88.743496] nix-grpc-daemon[873]: time=2026-09-23T04:42:59.993Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 88.798483] niks3-server[1046]: 2026/09/23 04:43:00 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 88.805806] niks3-server[1046]: 2026/09/23 04:43:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 88.811828] niks3-server[1046]: 2026/09/23 04:43:00 INFO Signed narinfos id=27 count=1 worker1 # [ 88.777184] nix-grpc-daemon[873]: time=2026-09-23T04:43:00.028Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.819505] niks3-server[1046]: 2026/09/23 04:43:00 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 88.830331] niks3-server[1046]: 2026/09/23 04:43:00 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 88.833241] niks3-server[1046]: 2026/09/23 04:43:00 INFO Completed upload id=27 worker1 # [ 88.797168] nix-grpc-daemon[873]: time=2026-09-23T04:43:00.048Z level=INFO msg="Upload complete. (189ms)" lb # [ 88.835911] niks3-server[1046]: 2026/09/23 04:43:00 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 88.854807] nix-grpc-daemon[783]: ts=2026-09-23T04:43:00Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 88.859474] nix-grpc-daemon[783]: ts=2026-09-23T04:43:00Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 88.860578] nix-grpc-daemon[779]: ts=2026-09-23T04:43:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 88.873589] nix-grpc-daemon[779]: ts=2026-09-23T04:43:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 88.890085] nix-grpc-daemon[779]: ts=2026-09-23T04:43:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 88.905159] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 89.010769] nix-daemon[847]: accepted connection from pid 1088, user nix-grpc-daemon (trusted) worker1 # [ 89.024747] nix-daemon[847]: reaped child process 1091, status = succeeded lb # [ 89.068432] niks3-server[1046]: 2026/09/23 04:43:01 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 89.077380] niks3-server[1046]: 2026/09/23 04:43:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 89.049099] nix-grpc-daemon[873]: time=2026-09-23T04:43:00.300Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 89.050623] nix-grpc-daemon[873]: time=2026-09-23T04:43:00.302Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker1 # [ 89.052910] nix-grpc-daemon[873]: time=2026-09-23T04:43:00.303Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 89.111428] niks3-server[1046]: 2026/09/23 04:43:01 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 89.122153] niks3-server[1046]: 2026/09/23 04:43:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 89.124484] niks3-server[1046]: 2026/09/23 04:43:01 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 89.128385] niks3-server[1046]: 2026/09/23 04:43:01 INFO Signed narinfos id=28 count=1 lb # [ 89.129738] niks3-server[1046]: 2026/09/23 04:43:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 89.132100] niks3-server[1046]: 2026/09/23 04:43:01 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 89.135055] niks3-server[1046]: 2026/09/23 04:43:01 INFO Signed narinfos id=29 count=2 lb # [ 89.137286] niks3-server[1046]: 2026/09/23 04:43:01 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls worker1 # [ 89.100090] nix-grpc-daemon[873]: time=2026-09-23T04:43:00.350Z level=INFO msg="Uploading 3 narinfos" lb # [ 89.151938] niks3-server[1046]: 2026/09/23 04:43:01 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 89.153592] niks3-server[1046]: 2026/09/23 04:43:01 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 89.157051] niks3-server[1046]: 2026/09/23 04:43:01 INFO Completed upload id=28 lb # [ 89.158599] niks3-server[1046]: 2026/09/23 04:43:01 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 89.160960] niks3-server[1046]: 2026/09/23 04:43:01 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 89.163019] niks3-server[1046]: 2026/09/23 04:43:01 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 89.164759] niks3-server[1046]: 2026/09/23 04:43:01 INFO Completed upload id=29 worker1 # [ 89.129117] nix-grpc-daemon[873]: time=2026-09-23T04:43:00.380Z level=INFO msg="Upload complete. (209ms)" worker1 # [ 89.134453] nix-grpc-daemon[779]: ts=2026-09-23T04:43:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=2 nar_bytes_in=976 worker1 # [ 89.140128] nix-grpc-daemon[779]: ts=2026-09-23T04:43:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 89.152166] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 89.161338] nix-daemon[847]: reaped child process 1086, status = succeeded worker1 # [ 89.166533] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 89.999898] nix-daemon[847]: reaped child process 1095, status = succeeded worker1 # [ 90.086471] nix-daemon[847]: accepted connection from pid 1111, user nix-grpc-daemon (trusted) worker1 # [ 90.097479] nix-daemon[847]: reaped child process 1114, status = succeeded lb # [ 90.143901] niks3-server[1046]: 2026/09/23 04:43:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 90.116824] nix-grpc-daemon[873]: time=2026-09-23T04:43:01.368Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 90.176515] niks3-server[1046]: 2026/09/23 04:43:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker1 # [ 90.146933] nix-grpc-daemon[873]: time=2026-09-23T04:43:01.398Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.184199] niks3-server[1046]: 2026/09/23 04:43:02 INFO Signed narinfos id=30 count=1 lb # [ 90.192584] niks3-server[1046]: 2026/09/23 04:43:02 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 90.200104] niks3-server[1046]: 2026/09/23 04:43:02 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 90.210528] niks3-server[1046]: 2026/09/23 04:43:02 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 90.216574] niks3-server[1046]: 2026/09/23 04:43:02 INFO Completed upload id=30 worker1 # [ 90.179501] nix-grpc-daemon[873]: time=2026-09-23T04:43:01.430Z level=INFO msg="Upload complete. (205ms)" lb # [ 90.221408] niks3-server[1046]: 2026/09/23 04:43:02 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker1 # [ 90.185435] nix-grpc-daemon[779]: ts=2026-09-23T04:43:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 client # copying 1 paths... worker2 # [ 90.233903] nix-grpc-daemon[783]: ts=2026-09-23T04:43:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46108 worker1 # [ 90.199654] nix-daemon[847]: reaped child process 1093, status = succeeded worker2 # [ 90.242837] nix-grpc-daemon[783]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 90.229826] nix-grpc-daemon[779]: ts=2026-09-23T04:43:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 90.234968] nix-grpc-daemon[779]: ts=2026-09-23T04:43:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_out=120 client # [ 90.334439] nix-daemon[1110]: reaped child process 1196, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 1.95 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 90.429942] nix-daemon[1110]: accepted connection from pid 1215, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 90.559499] nix-grpc-daemon[783]: ts=2026-09-23T04:43:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46108 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 90.528911] nix-grpc-daemon[779]: ts=2026-09-23T04:43:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 90.537988] nix-grpc-daemon[873]: time=2026-09-23T04:43:01.789Z level=INFO msg="All 1 paths already cached" worker2 # [ 90.592107] nix-grpc-daemon[783]: ts=2026-09-23T04:43:02Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 90.597883] nix-grpc-daemon[783]: ts=2026-09-23T04:43:02Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 90.603804] nix-grpc-daemon[783]: ts=2026-09-23T04:43:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 90.615870] nix-grpc-daemon[783]: ts=2026-09-23T04:43:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46108 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 90.633410] nix-grpc-daemon[783]: ts=2026-09-23T04:43:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 90.644381] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 90.660511] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5) worker2 # [ 90.713946] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5) worker2 # [ 90.881289] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 3/5) worker2 # [ 90.952515] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 751 ms (attempt 4/5) worker2 # [ 91.713084] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 91.716457] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 91.721759] nix-grpc-daemon[783]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 91.845496] nix-daemon[874]: accepted connection from pid 1285, user nix-grpc-daemon (trusted) worker2 # [ 91.860095] nix-daemon[874]: reaped child process 1288, status = succeeded lb # [ 91.866937] niks3-server[1046]: 2026/09/23 04:43:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.878525] nix-grpc-daemon[889]: time=2026-09-23T04:43:03.962Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 91.880441] nix-grpc-daemon[889]: time=2026-09-23T04:43:03.964Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 91.899098] niks3-server[1046]: 2026/09/23 04:43:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 91.904940] niks3-server[1046]: 2026/09/23 04:43:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 91.912938] niks3-server[1046]: 2026/09/23 04:43:03 INFO Signed narinfos id=31 count=1 worker2 # [ 91.918356] nix-grpc-daemon[889]: time=2026-09-23T04:43:04.002Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.921075] niks3-server[1046]: 2026/09/23 04:43:03 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 91.932713] niks3-server[1046]: 2026/09/23 04:43:03 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 91.942174] niks3-server[1046]: 2026/09/23 04:43:03 INFO Completed upload id=31 worker2 # [ 91.944166] nix-grpc-daemon[889]: time=2026-09-23T04:43:04.028Z level=INFO msg="Upload complete. (204ms)" lb # [ 91.945056] niks3-server[1046]: 2026/09/23 04:43:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker2 # [ 91.948494] nix-grpc-daemon[783]: ts=2026-09-23T04:43:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=1 paths=1 nar_bytes_in=560 worker2 # [ 91.954610] nix-grpc-daemon[783]: ts=2026-09-23T04:43:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 worker2 # [ 91.962460] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 91.977235] nix-daemon[874]: reaped child process 1278, status = succeeded worker2 # [ 91.981635] nix-grpc-daemon[783]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 91.989724] nix-daemon[874]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 92.616549] nix-daemon[874]: reaped child process 1293, status = succeeded worker2 # [ 92.709686] nix-daemon[874]: accepted connection from pid 1309, user nix-grpc-daemon (trusted) worker2 # [ 92.721169] nix-daemon[874]: reaped child process 1312, status = succeeded lb # [ 92.727346] niks3-server[1046]: 2026/09/23 04:43:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 92.833271] nix-grpc-daemon[889]: time=2026-09-23T04:43:04.917Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 92.854746] niks3-server[1046]: 2026/09/23 04:43:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 92.863381] niks3-server[1046]: 2026/09/23 04:43:04 INFO Signed narinfos id=32 count=1 worker2 # [ 92.869583] nix-grpc-daemon[889]: time=2026-09-23T04:43:04.953Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.877287] niks3-server[1046]: 2026/09/23 04:43:04 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 92.890325] niks3-server[1046]: 2026/09/23 04:43:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 92.902128] niks3-server[1046]: 2026/09/23 04:43:04 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 92.915599] niks3-server[1046]: 2026/09/23 04:43:04 INFO Completed upload id=32 worker2 # [ 92.918318] nix-grpc-daemon[889]: time=2026-09-23T04:43:05.001Z level=INFO msg="Upload complete. (319ms)" lb # [ 92.922767] niks3-server[1046]: 2026/09/23 04:43:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo client # copying 1 paths... worker2 # [ 92.925493] nix-grpc-daemon[783]: ts=2026-09-23T04:43:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46108 duration_s=0 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 worker2 # [ 92.934989] nix-grpc-daemon[783]: ts=2026-09-23T04:43:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46108 client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 92.946734] nix-daemon[874]: reaped child process 1290, status = succeeded worker1 # [ 92.919556] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 92.931555] nix-grpc-daemon[779]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... worker1 # [ 92.945161] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_out=120 client # [ 93.085381] nix-daemon[1110]: reaped child process 1218, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.75 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 93.193777] nix-daemon[1110]: accepted connection from pid 1236, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 93.325961] nix-grpc-daemon[783]: ts=2026-09-23T04:43:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46108 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 93.290409] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 93.300820] nix-grpc-daemon[873]: time=2026-09-23T04:43:04.551Z level=INFO msg="All 1 paths already cached" worker2 # [ 93.354559] nix-grpc-daemon[783]: ts=2026-09-23T04:43:05Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 93.359216] nix-grpc-daemon[783]: ts=2026-09-23T04:43:05Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 93.359957] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 93.372574] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 93.385542] nix-grpc-daemon[873]: time=2026-09-23T04:43:04.637Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 93.395248] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 93.406583] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 93.509168] nix-daemon[847]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker1 # [ 93.522390] nix-daemon[847]: reaped child process 1122, status = succeeded lb # [ 93.565941] niks3-server[1046]: 2026/09/23 04:43:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 93.578590] nix-grpc-daemon[873]: time=2026-09-23T04:43:04.830Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 93.581095] nix-grpc-daemon[873]: time=2026-09-23T04:43:04.831Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" worker1 # [ 93.604260] nix-grpc-daemon[873]: time=2026-09-23T04:43:04.855Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.641169] niks3-server[1046]: 2026/09/23 04:43:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 93.645089] niks3-server[1046]: 2026/09/23 04:43:05 INFO Signed narinfos id=33 count=1 lb # [ 93.652604] niks3-server[1046]: 2026/09/23 04:43:05 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 93.663603] niks3-server[1046]: 2026/09/23 04:43:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 93.670763] niks3-server[1046]: 2026/09/23 04:43:05 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 93.676128] niks3-server[1046]: 2026/09/23 04:43:05 INFO Completed upload id=33 worker1 # [ 93.638748] nix-grpc-daemon[873]: time=2026-09-23T04:43:04.890Z level=INFO msg="Upload complete. (220ms)" worker1 # [ 93.643430] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 93.683794] niks3-server[1046]: 2026/09/23 04:43:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker1 # [ 93.651365] nix-grpc-daemon[779]: ts=2026-09-23T04:43:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 93.662119] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker1 # [ 93.674287] nix-daemon[847]: reaped child process 1117, status = succeeded client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 93.681897] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 94.522396] nix-daemon[847]: reaped child process 1126, status = succeeded worker1 # [ 94.606908] nix-daemon[847]: accepted connection from pid 1142, user nix-grpc-daemon (trusted) worker1 # [ 94.619222] nix-daemon[847]: reaped child process 1145, status = succeeded lb # [ 94.663764] niks3-server[1046]: 2026/09/23 04:43:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 94.842552] nix-grpc-daemon[873]: time=2026-09-23T04:43:06.093Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 94.903359] niks3-server[1046]: 2026/09/23 04:43:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 94.910075] niks3-server[1046]: 2026/09/23 04:43:06 INFO Signed narinfos id=34 count=1 worker1 # [ 94.872415] nix-grpc-daemon[873]: time=2026-09-23T04:43:06.123Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.929322] niks3-server[1046]: 2026/09/23 04:43:06 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 94.947481] niks3-server[1046]: 2026/09/23 04:43:06 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 94.953552] niks3-server[1046]: 2026/09/23 04:43:06 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo lb # [ 94.967592] niks3-server[1046]: 2026/09/23 04:43:06 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 94.975864] niks3-server[1046]: 2026/09/23 04:43:06 INFO Completed upload id=34 worker1 # [ 94.938854] nix-grpc-daemon[873]: time=2026-09-23T04:43:06.190Z level=INFO msg="Upload complete. (447ms)" client # copying 1 paths... worker1 # [ 94.946376] nix-grpc-daemon[779]: ts=2026-09-23T04:43:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker2 # [ 94.992601] nix-grpc-daemon[783]: ts=2026-09-23T04:43:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46108 worker1 # [ 94.960971] nix-daemon[847]: reaped child process 1124, status = succeeded worker2 # [ 95.004361] nix-grpc-daemon[783]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 94.996587] nix-grpc-daemon[779]: ts=2026-09-23T04:43:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 worker1 # [ 95.001626] nix-grpc-daemon[779]: ts=2026-09-23T04:43:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40946 duration_s=0 paths=1 nar_bytes_out=120 client # [ 95.099816] nix-daemon[1110]: reaped child process 1239, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.01 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.21 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.25 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.27 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds) worker2 # [ 95.905937] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 96.651914] nix-grpc-daemon[783]: ts=2026-09-23T04:43:08Z level=info event=signal_exit lb # [ 97.408588] envoy[926]: conn peer=[2001:db8:1::1]:47212 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4324 tx=2394 ms=1380 lb # [ 97.412719] envoy[926]: conn peer=[2001:db8:1::1]:47216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=18 lb # [ 97.416357] envoy[926]: conn peer=[2001:db8:1::1]:47224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3852 tx=2043 ms=1644 lb # [ 97.419930] envoy[926]: conn peer=[2001:db8:1::1]:47228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=16 lb # [ 97.423406] envoy[926]: conn peer=[2001:db8:1::1]:47230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3726 tx=2103 ms=2477 lb # [ 97.426877] envoy[926]: conn peer=[2001:db8:1::1]:42190 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=80 lb # [ 97.430871] envoy[926]: conn peer=[2001:db8:1::1]:42206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3731 tx=2125 ms=1727 lb # [ 97.434355] envoy[926]: conn peer=[2001:db8:1::1]:42208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=20 lb # [ 97.535818] niks3-server[1046]: 2026/09/23 04:43:09 INFO lead: released remote=192.168.1.4:56356 lb # [ 97.540755] niks3-server[1046]: 2026/09/23 04:43:09 INFO lead: acquired remote=192.168.1.3:60602 worker1 # [ 97.504775] nix-grpc-daemon[779]: ts=2026-09-23T04:43:08Z level=info event=scheduler_take_over worker1 # [ 98.499223] nix-grpc-daemon[779]: ts=2026-09-23T04:43:09Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 98.536856] nix-grpc-daemon[783]: ts=2026-09-23T04:43:10Z level=info event=scheduler_restarting worker2 # [ 98.546526] nix-grpc-daemon[783]: ts=2026-09-23T04:43:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46104 worker2 # [ 98.550604] nix-grpc-daemon[783]: ts=2026-09-23T04:43:10Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 98.553617] nix-grpc-daemon[783]: ts=2026-09-23T04:43:10Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 98.556709] nix-grpc-daemon[783]: ts=2026-09-23T04:43:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46104 worker2 # [ 98.560265] nix-grpc-daemon[783]: ts=2026-09-23T04:43:10Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 98.578226] nix-daemon[874]: reaped child process 877, status = succeeded worker1 # [ 98.701314] nix-grpc-daemon[779]: ts=2026-09-23T04:43:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.705545] nix-grpc-daemon[779]: ts=2026-09-23T04:43:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.759285] nix-grpc-daemon[783]: ts=2026-09-23T04:43:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 98.798134] nix-grpc-daemon[783]: E0000 00:00:1790138590.882122 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 98.803511] nix-grpc-daemon[783]: E0000 00:00:1790138590.882372 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 98.905978] nix-grpc-daemon[779]: ts=2026-09-23T04:43:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.918993] nix-grpc-daemon[779]: ts=2026-09-23T04:43:10Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36272 worker1 # [ 98.923889] nix-grpc-daemon[779]: ts=2026-09-23T04:43:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 100.730469] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 100.734497] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 100.738729] systemd[1]: nix-grpc-daemon.service: Consumed 2.585s CPU time over 1min 23.268s wall clock time, 72.1M memory peak, 117.1K incoming IP traffic, 321.3K outgoing IP traffic. worker2 # [ 100.750164] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 100.754477] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 100.757959] systemd[1]: nix-grpc-daemon.socket: Consumed 335us CPU time over 1min 33.157s wall clock time, 256K memory peak, 120.5K incoming IP traffic, 100.6K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 100.919604] nix-grpc-daemon[779]: ts=2026-09-23T04:43:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40946 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 100.924950] nix-grpc-daemon[779]: ts=2026-09-23T04:43:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40946 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 101.044896] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 101.053442] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 101.570662] nix-grpc-daemon[779]: ts=2026-09-23T04:43:12Z level=info event=signal_exit worker2 # [ 101.727182] systemd[1]: Starting scheduler-token.service... worker2 # [ 101.788783] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 101.791840] systemd[1]: Finished scheduler-token.service. worker2 # [ 101.794354] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 64ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 101.802785] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 101.881370] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 101.883441] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 101.886624] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 101.891029] nix-grpc-daemon[1339]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 101.892386] nix-grpc-daemon[1339]: E0000 00:00:1790138593.975148 1339 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 101.898169] nix-grpc-daemon[1339]: E0000 00:00:1790138593.980649 1339 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 101.901757] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 101.904720] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 101.910063] nix-grpc-daemon[1339]: E0000 00:00:1790138593.993984 1380 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 101.923573] nix-grpc-daemon[1339]: E0000 00:00:1790138594.008028 1380 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 101.928107] nix-grpc-daemon[1339]: E0000 00:00:1790138594.010380 1380 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 101.937819] nix-grpc-daemon[1339]: E0000 00:00:1790138594.022282 1380 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 101.947358] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 101.948925] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.150333] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.154412] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.355349] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.359302] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 102.537369] niks3-server[1046]: 2026/09/23 04:43:14 INFO lead: released remote=192.168.1.3:60602 worker2 # [ 102.560515] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.564372] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.765505] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.769370] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.970858] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.974766] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.175961] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.179880] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.381303] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.385336] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.504908] nix-grpc-daemon[779]: ts=2026-09-23T04:43:14Z level=info event=scheduler_restarting worker1 # [ 103.508955] nix-grpc-daemon[779]: ts=2026-09-23T04:43:14Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 103.512841] nix-grpc-daemon[779]: ts=2026-09-23T04:43:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36272 worker1 # [ 103.516482] nix-grpc-daemon[779]: ts=2026-09-23T04:43:14Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 103.585813] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.587674] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.557862] nix-daemon[847]: reaped child process 849, status = succeeded worker1 # [ 103.715808] nix-grpc-daemon[779]: ts=2026-09-23T04:43:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 103.723987] nix-grpc-daemon[779]: E0000 00:00:1790138594.975248 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 103.728745] nix-grpc-daemon[779]: E0000 00:00:1790138594.975453 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 103.788446] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.790298] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.991331] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.993098] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.194205] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.198232] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.399234] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.403289] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.604650] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.608616] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.650772] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 104.653826] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 104.658279] systemd[1]: nix-grpc-daemon.service: Consumed 2.064s CPU time over 1min 27.282s wall clock time, 61.6M memory peak, 92.5K incoming IP traffic, 170.7K outgoing IP traffic. worker1 # [ 104.669860] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 104.674353] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 104.677513] systemd[1]: nix-grpc-daemon.socket: Consumed 316us CPU time over 1min 36.200s wall clock time, 256K memory peak, 99.2K incoming IP traffic, 89.1K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 104.809635] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.813610] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.924773] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 104.936400] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 104.952726] nix-grpc-daemon[1339]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 1/5) worker2 # [ 105.009114] nix-grpc-daemon[1339]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5) worker2 # [ 105.015529] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.019280] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.136610] nix-grpc-daemon[1339]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 266 ms (attempt 3/5) worker2 # [ 105.220538] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.224474] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.404736] nix-grpc-daemon[1339]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 761 ms (attempt 4/5) worker2 # [ 105.425322] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.429126] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.630395] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.634335] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.835452] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.839343] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.040924] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.044889] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.168321] nix-grpc-daemon[1339]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 106.171918] nix-grpc-daemon[1339]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 106.195657] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 106.205821] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 106.230428] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=niks3_push_started pid=1400 worker2 # [ 106.247366] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.251987] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.341278] nix-grpc-daemon[1400]: time=2026-09-23T04:43:18.423Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 106.427078] nix-daemon[874]: accepted connection from pid 1412, user nix-grpc-daemon (trusted) worker2 # [ 106.438905] nix-daemon[874]: reaped child process 1415, status = succeeded lb # [ 106.445277] niks3-server[1046]: 2026/09/23 04:43:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 106.451398] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.453918] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 106.458900] niks3-server[1046]: 2026/09/23 04:43:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 106.468353] nix-grpc-daemon[1400]: time=2026-09-23T04:43:18.552Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 106.471059] nix-grpc-daemon[1400]: time=2026-09-23T04:43:18.554Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 106.472660] nix-grpc-daemon[1400]: time=2026-09-23T04:43:18.554Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" lb # [ 106.516707] niks3-server[1046]: 2026/09/23 04:43:18 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 106.519542] niks3-server[1046]: 2026/09/23 04:43:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 106.521877] niks3-server[1046]: 2026/09/23 04:43:18 INFO Signed narinfos id=35 count=1 lb # [ 106.523973] niks3-server[1046]: 2026/09/23 04:43:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 106.527542] niks3-server[1046]: 2026/09/23 04:43:18 INFO Signed narinfos id=36 count=2 worker2 # [ 106.529075] nix-grpc-daemon[1400]: time=2026-09-23T04:43:18.612Z level=INFO msg="Uploading 3 narinfos" lb # [ 106.528582] niks3-server[1046]: 2026/09/23 04:43:18 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 106.543094] niks3-server[1046]: 2026/09/23 04:43:18 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 106.547911] niks3-server[1046]: 2026/09/23 04:43:18 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 106.556059] niks3-server[1046]: 2026/09/23 04:43:18 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 106.560418] niks3-server[1046]: 2026/09/23 04:43:18 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 106.562975] niks3-server[1046]: 2026/09/23 04:43:18 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 106.567412] niks3-server[1046]: 2026/09/23 04:43:18 INFO Completed upload id=35 lb # [ 106.570334] niks3-server[1046]: 2026/09/23 04:43:18 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 106.572697] niks3-server[1046]: 2026/09/23 04:43:18 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 106.575557] niks3-server[1046]: 2026/09/23 04:43:18 INFO Completed upload id=36 worker2 # [ 106.577583] nix-grpc-daemon[1400]: time=2026-09-23T04:43:18.661Z level=INFO msg="Upload complete. (237ms)" worker2 # [ 106.582787] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 106.596711] nix-daemon[874]: reaped child process 1398, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.84 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker2 # [ 106.656756] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.660671] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.642832] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 106.652689] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 106.737400] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 106.741742] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 106.745318] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 106.747316] nix-grpc-daemon[1168]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 106.748642] nix-grpc-daemon[1168]: E0000 00:00:1790138597.996127 1168 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 106.757369] nix-grpc-daemon[1168]: E0000 00:00:1790138598.003488 1168 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.760127] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 106.797300] niks3-server[1046]: 2026/09/23 04:43:18 INFO lead: acquired remote=192.168.1.3:40682 worker1 # [ 106.764147] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 106.764912] nix-grpc-daemon[1168]: E0000 00:00:1790138598.013992 1210 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 106.771101] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_take_over worker1 # [ 106.779187] nix-grpc-daemon[1168]: E0000 00:00:1790138598.029508 1210 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.783128] nix-grpc-daemon[1168]: E0000 00:00:1790138598.029755 1210 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 106.792926] nix-grpc-daemon[1168]: E0000 00:00:1790138598.044494 1210 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.805403] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.807076] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.861870] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.865795] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 107.008206] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.012177] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.067802] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.071695] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.212920] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.216975] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.272878] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.276892] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 107.409429] envoy[926]: conn peer=[2001:db8:1::4]:42470 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=84117 tx=4489 ms=81083 lb # [ 107.413983] envoy[926]: conn peer=[2001:db8:1::1]:42212 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=16 lb # [ 107.417533] envoy[926]: conn peer=[2001:db8:1::3]:39768 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=22239 tx=4335 ms=86109 lb # [ 107.421500] envoy[926]: conn peer=[2001:db8:1::1]:35180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1008 tx=305 ms=1671 worker1 # [ 107.417859] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.421943] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.478092] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.482126] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.622856] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.626944] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.683141] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.687228] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.828636] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.835466] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45414 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 107.840074] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 107.888205] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.857154] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 107.861387] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45414 worker1 # [ 107.865377] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.82 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 108.010588] niks3-server[1046]: 2026/09/23 04:43:20 INFO Shutdown signal received, draining in-flight requests timeout=10s worker1 # [ 107.973307] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=info event=scheduler_lock_lost status=200 worker2 # [ 108.012539] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:20Z level=info event=scheduler_lock_lost status=200 lb # [ 108.013254] niks3-server[1046]: 2026/09/23 04:43:20 INFO lead: released remote=192.168.1.3:40682 lb # [ 108.014680] systemd[1]: Stopping niks3 server... lb # [ 108.027215] systemd[1]: niks3.service: Deactivated successfully. lb # [ 108.028814] systemd[1]: Stopped niks3 server. lb # [ 108.029620] systemd[1]: niks3.service: Consumed 771ms CPU time over 1min 20.713s wall clock time, 28.7M memory peak, 98.5K incoming IP traffic, 141K outgoing IP traffic. lb # [ 108.037351] systemd[1]: Starting niks3 server... lb # [ 108.087698] niks3-server[1185]: 2026/09/23 04:43:20 goose: no migrations to run. current version: 20260920000000 lb # [ 108.093914] niks3-server[1185]: 2026/09/23 04:43:20 OK 1_commit_pending_closure.sql (4.36ms) lb # [ 108.097766] niks3-server[1185]: 2026/09/23 04:43:20 OK 2_object_stats_trigger.sql (2.19ms) lb # [ 108.098864] niks3-server[1185]: 2026/09/23 04:43:20 goose: up to current file version: 2 lb # [ 108.100530] niks3-server[1185]: 2026/09/23 04:43:20 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 108.111493] niks3-server[1185]: 2026/09/23 04:43:20 INFO Read proxy enabled — serving cache objects from S3 lb # [ 108.112861] niks3-server[1185]: 2026/09/23 04:43:20 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 108.115217] systemd[1]: Started niks3 server. lb # [ 108.116096] niks3-server[1185]: 2026/09/23 04:43:20 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 108.119076] niks3-server[1185]: 2026/09/23 04:43:20 INFO systemd watchdog enabled interval=15s lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 108.409172] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 108.420897] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 108.476831] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55110 worker1 # [ 108.464899] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 108.469725] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 108.513925] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 108.526089] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5) worker1 # [ 108.615993] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 2/5) worker1 # [ 108.705268] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 369 ms (attempt 3/5) lb # [ 109.018408] niks3-server[1185]: 2026/09/23 04:43:21 INFO lead: acquired remote=192.168.1.3:40690 worker1 # [ 109.082978] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 389 ms (attempt 4/5) worker1 # [ 109.473716] nix-grpc-daemon[1168]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 109.477537] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 109.494777] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45416 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker1 # [ 109.508342] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 109.519364] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 109.539813] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:20Z level=info event=niks3_push_started pid=1241 worker1 # [ 109.643646] nix-grpc-daemon[1241]: time=2026-09-23T04:43:20.893Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 109.740662] nix-daemon[847]: accepted connection from pid 1254, user nix-grpc-daemon (trusted) worker1 # [ 109.753421] nix-daemon[847]: reaped child process 1257, status = succeeded lb # [ 109.798863] niks3-server[1185]: 2026/09/23 04:43:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 109.774040] nix-grpc-daemon[1241]: time=2026-09-23T04:43:21.025Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 109.775627] nix-grpc-daemon[1241]: time=2026-09-23T04:43:21.027Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 109.840096] niks3-server[1185]: 2026/09/23 04:43:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 109.869835] niks3-server[1185]: 2026/09/23 04:43:21 INFO Signed narinfos id=37 count=1 lb # [ 109.871595] niks3-server[1185]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst worker1 # [ 109.835095] nix-grpc-daemon[1241]: time=2026-09-23T04:43:21.085Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.879348] niks3-server[1185]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 109.881641] niks3-server[1185]: 2026/09/23 04:43:21 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 109.887457] niks3-server[1185]: 2026/09/23 04:43:21 INFO Completed upload id=37 worker1 # [ 109.850324] nix-grpc-daemon[1241]: time=2026-09-23T04:43:21.101Z level=INFO msg="Upload complete. (207ms)" lb # [ 109.889556] niks3-server[1185]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker1 # [ 109.855718] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45416 duration_s=0 paths=1 nar_bytes_in=536 worker1 # [ 109.861898] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 109.874113] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 109.880437] nix-daemon[847]: reaped child process 1239, status = succeeded worker1 # [ 109.885825] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 110.728827] nix-daemon[847]: reaped child process 1261, status = succeeded worker1 # [ 110.803193] nix-daemon[847]: accepted connection from pid 1277, user nix-grpc-daemon (trusted) worker1 # [ 110.815691] nix-daemon[847]: reaped child process 1280, status = succeeded lb # [ 110.862520] niks3-server[1185]: 2026/09/23 04:43:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.836159] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.087Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 110.837942] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.089Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 110.911791] niks3-server[1185]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 110.919321] niks3-server[1185]: 2026/09/23 04:43:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 110.926927] niks3-server[1185]: 2026/09/23 04:43:22 INFO Signed narinfos id=38 count=1 worker1 # [ 110.892542] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.143Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.934866] niks3-server[1185]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 110.939801] niks3-server[1185]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 110.947494] niks3-server[1185]: 2026/09/23 04:43:22 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 110.953582] niks3-server[1185]: 2026/09/23 04:43:22 INFO Completed upload id=38 worker1 # [ 110.916539] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.168Z level=INFO msg="Upload complete. (223ms)" lb # [ 110.956043] niks3-server[1185]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker1 # [ 110.923841] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker1 # [ 110.937937] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 110.943204] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 110.952454] nix-daemon[847]: reaped child process 1259, status = succeeded worker1 # [ 110.983168] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 110.996806] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 111.010524] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.261Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker1 # [ 111.019499] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 111.027809] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 111.123904] nix-daemon[847]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker1 # [ 111.136559] nix-daemon[847]: reaped child process 1289, status = succeeded lb # [ 111.181505] niks3-server[1185]: 2026/09/23 04:43:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.153481] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.405Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 111.154963] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.406Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 111.214180] niks3-server[1185]: 2026/09/23 04:43:23 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 111.220322] niks3-server[1185]: 2026/09/23 04:43:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker1 # [ 111.187689] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.439Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.224638] niks3-server[1185]: 2026/09/23 04:43:23 INFO Signed narinfos id=39 count=1 lb # [ 111.235195] niks3-server[1185]: 2026/09/23 04:43:23 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 111.238846] niks3-server[1185]: 2026/09/23 04:43:23 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 111.242926] niks3-server[1185]: 2026/09/23 04:43:23 INFO Completed upload id=39 worker1 # [ 111.205790] nix-grpc-daemon[1241]: time=2026-09-23T04:43:22.457Z level=INFO msg="Upload complete. (165ms)" lb # [ 111.245412] niks3-server[1185]: 2026/09/23 04:43:23 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker1 # [ 111.209771] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45416 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 111.214700] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 111.223124] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 111.229213] nix-daemon[847]: reaped child process 1284, status = succeeded worker1 # [ 111.232457] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 112.247700] nix-daemon[847]: reaped child process 1293, status = succeeded worker1 # [ 112.322534] nix-daemon[847]: accepted connection from pid 1309, user nix-grpc-daemon (trusted) worker1 # [ 112.334101] nix-daemon[847]: reaped child process 1312, status = succeeded lb # [ 112.381691] niks3-server[1185]: 2026/09/23 04:43:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.352811] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.604Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 112.354514] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.605Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 112.418081] niks3-server[1185]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 112.429303] niks3-server[1185]: 2026/09/23 04:43:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 112.433833] niks3-server[1185]: 2026/09/23 04:43:24 INFO Signed narinfos id=40 count=1 worker1 # [ 112.399049] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.650Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.440585] niks3-server[1185]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 112.450103] niks3-server[1185]: 2026/09/23 04:43:24 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 112.453310] niks3-server[1185]: 2026/09/23 04:43:24 INFO Completed upload id=40 worker1 # [ 112.416183] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.667Z level=INFO msg="Upload complete. (176ms)" lb # [ 112.457073] niks3-server[1185]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo lb # [ 112.460128] niks3-server[1185]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls worker1 # [ 112.421061] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker1 # [ 112.433373] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 112.436945] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 112.443272] nix-daemon[847]: reaped child process 1291, status = succeeded worker1 # [ 112.477597] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 112.490607] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 112.505172] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.756Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker1 # [ 112.514355] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 112.522694] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 112.616981] nix-daemon[847]: accepted connection from pid 1318, user nix-grpc-daemon (trusted) worker1 # [ 112.630232] nix-daemon[847]: reaped child process 1321, status = succeeded lb # [ 112.673967] niks3-server[1185]: 2026/09/23 04:43:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.646169] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.897Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 112.647690] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.899Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 112.710427] niks3-server[1185]: 2026/09/23 04:43:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 112.713351] niks3-server[1185]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 112.719829] niks3-server[1185]: 2026/09/23 04:43:24 INFO Signed narinfos id=41 count=1 worker1 # [ 112.684986] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.936Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.725348] niks3-server[1185]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 112.736110] niks3-server[1185]: 2026/09/23 04:43:24 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 112.740146] niks3-server[1185]: 2026/09/23 04:43:24 INFO Completed upload id=41 worker1 # [ 112.702879] nix-grpc-daemon[1241]: time=2026-09-23T04:43:23.954Z level=INFO msg="Upload complete. (167ms)" lb # [ 112.741445] niks3-server[1185]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker1 # [ 112.706859] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45416 duration_s=0 paths=1 nar_bytes_in=784 worker1 # [ 112.711619] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 worker1 # [ 112.723626] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 112.726736] nix-daemon[847]: reaped child process 1316, status = succeeded worker1 # [ 112.730926] nix-daemon[847]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 113.768665] nix-daemon[847]: reaped child process 1325, status = succeeded worker1 # [ 113.854076] nix-daemon[847]: accepted connection from pid 1341, user nix-grpc-daemon (trusted) worker1 # [ 113.866147] nix-daemon[847]: reaped child process 1344, status = succeeded lb # [ 113.911912] niks3-server[1185]: 2026/09/23 04:43:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 113.883940] nix-grpc-daemon[1241]: time=2026-09-23T04:43:25.135Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 113.887510] nix-grpc-daemon[1241]: time=2026-09-23T04:43:25.137Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 113.951171] niks3-server[1185]: 2026/09/23 04:43:25 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 113.965161] niks3-server[1185]: 2026/09/23 04:43:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker1 # [ 113.934716] nix-grpc-daemon[1241]: time=2026-09-23T04:43:25.186Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.971912] niks3-server[1185]: 2026/09/23 04:43:25 INFO Signed narinfos id=42 count=1 lb # [ 113.975774] niks3-server[1185]: 2026/09/23 04:43:25 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 113.982547] niks3-server[1185]: 2026/09/23 04:43:25 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 113.990446] niks3-server[1185]: 2026/09/23 04:43:25 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 113.994235] niks3-server[1185]: 2026/09/23 04:43:25 INFO Completed upload id=42 worker1 # [ 113.958224] nix-grpc-daemon[1241]: time=2026-09-23T04:43:25.209Z level=INFO msg="Upload complete. (219ms)" lb # [ 113.997728] niks3-server[1185]: 2026/09/23 04:43:26 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker1 # [ 113.964725] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45416 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker1 # [ 113.980590] nix-daemon[847]: reaped child process 1323, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.74 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.23 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 114.288302] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 114.756444] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:26Z level=info event=signal_exit lb # [ 115.021957] niks3-server[1185]: 2026/09/23 04:43:27 INFO lead: released remote=192.168.1.3:40690 worker2 # [ 116.024846] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 115.989255] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:27Z level=info event=scheduler_restarting worker1 # [ 115.992736] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:27Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 115.996234] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45414 worker1 # [ 115.999917] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:27Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 116.003308] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45414 worker1 # [ 116.006915] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:27Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 116.024283] nix-daemon[847]: reaped child process 1229, status = succeeded worker2 # [ 116.225200] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.229464] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 116.197474] nix-grpc-daemon[1168]: ts=2026-09-23T04:43:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 116.430706] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.434647] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.635771] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.639653] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 116.676420] nix-grpc-daemon[1168]: E0000 00:00:1790138607.927730 1214 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker1 # [ 116.681366] nix-grpc-daemon[1168]: E0000 00:00:1790138607.927894 1214 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 116.840960] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.845094] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.046802] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.050650] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.251425] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.255302] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 117.409877] envoy[926]: conn peer=[2001:db8:1::1]:35182 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9709 tx=4439 ms=5579 lb # [ 117.413726] envoy[926]: conn peer=[2001:db8:1::3]:40958 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2124 tx=648 ms=9390 worker2 # [ 117.456286] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.460223] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.661070] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.664881] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.865913] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.869910] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.071796] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.075628] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.213312] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 118.217240] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 118.221331] systemd[1]: nix-grpc-daemon.service: Consumed 797ms CPU time over 11.566s wall clock time, 37.1M memory peak, 36.3K incoming IP traffic, 61.2K outgoing IP traffic. worker1 # [ 118.232741] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 118.237168] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 118.276731] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.240650] systemd[1]: nix-grpc-daemon.socket: Consumed 557us CPU time over 11.600s wall clock time, 256K memory peak, 32.8K incoming IP traffic, 23.3K outgoing IP traffic. worker2 # [ 118.280770] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 118.481909] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.485902] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.686906] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.690859] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.891890] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.896242] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.022104] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_take_over lb # [ 119.020835] niks3-server[1185]: 2026/09/23 04:43:31 INFO lead: acquired remote=192.168.1.4:51754 worker2 # [ 119.098295] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.102439] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.303956] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.308129] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 119.509428] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.513593] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.714814] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.718798] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.919729] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.923905] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.125886] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.143151] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 120.147261] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37674 worker2 # [ 120.151231] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker2 # [ 120.599231] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55110 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 120.608114] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 120.631472] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 120.636678] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 120.675818] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 120.688788] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55110 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 120.701468] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 120.712309] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 120.814673] nix-daemon[874]: accepted connection from pid 1441, user nix-grpc-daemon (trusted) worker2 # [ 120.827718] nix-daemon[874]: reaped child process 1444, status = succeeded lb # [ 120.833396] niks3-server[1185]: 2026/09/23 04:43:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.843952] nix-grpc-daemon[1400]: time=2026-09-23T04:43:32.928Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.846170] nix-grpc-daemon[1400]: time=2026-09-23T04:43:32.930Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 120.864625] niks3-server[1185]: 2026/09/23 04:43:32 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 120.871436] niks3-server[1185]: 2026/09/23 04:43:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 120.880793] nix-grpc-daemon[1400]: time=2026-09-23T04:43:32.964Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.878644] niks3-server[1185]: 2026/09/23 04:43:32 INFO Signed narinfos id=43 count=1 lb # [ 120.899350] niks3-server[1185]: 2026/09/23 04:43:32 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 120.901040] niks3-server[1185]: 2026/09/23 04:43:32 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 120.904886] niks3-server[1185]: 2026/09/23 04:43:32 INFO Completed upload id=43 worker2 # [ 120.906656] nix-grpc-daemon[1400]: time=2026-09-23T04:43:32.991Z level=INFO msg="Upload complete. (182ms)" lb # [ 120.907770] niks3-server[1185]: 2026/09/23 04:43:32 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker2 # [ 120.910319] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 120.915474] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 120.923590] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 120.929176] nix-daemon[874]: reaped child process 1439, status = succeeded client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... worker2 # [ 120.934163] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 121.367915] nix-daemon[874]: reaped child process 1448, status = succeeded worker2 # [ 121.442863] nix-daemon[874]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 121.456453] nix-daemon[874]: reaped child process 1467, status = succeeded lb # [ 121.461323] niks3-server[1185]: 2026/09/23 04:43:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 121.471843] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.556Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 121.473380] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.557Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 121.502775] niks3-server[1185]: 2026/09/23 04:43:33 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 121.509343] niks3-server[1185]: 2026/09/23 04:43:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker2 # [ 121.520400] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.604Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.518699] niks3-server[1185]: 2026/09/23 04:43:33 INFO Signed narinfos id=44 count=1 lb # [ 121.523354] niks3-server[1185]: 2026/09/23 04:43:33 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 121.527954] niks3-server[1185]: 2026/09/23 04:43:33 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 121.537986] niks3-server[1185]: 2026/09/23 04:43:33 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 121.541303] niks3-server[1185]: 2026/09/23 04:43:33 INFO Completed upload id=44 worker2 # [ 121.544408] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.628Z level=INFO msg="Upload complete. (204ms)" lb # [ 121.544582] niks3-server[1185]: 2026/09/23 04:43:33 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker2 # [ 121.552222] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=0 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker2 # [ 121.564104] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 121.568217] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 121.577704] nix-daemon[874]: reaped child process 1446, status = succeeded worker2 # [ 121.608387] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 121.621665] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 121.634485] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.718Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 121.643123] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 121.651398] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 121.745747] nix-daemon[874]: accepted connection from pid 1474, user nix-grpc-daemon (trusted) worker2 # [ 121.758642] nix-daemon[874]: reaped child process 1477, status = succeeded lb # [ 121.763805] niks3-server[1185]: 2026/09/23 04:43:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 121.773228] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.857Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 121.774682] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.859Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 121.793792] niks3-server[1185]: 2026/09/23 04:43:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 121.799660] niks3-server[1185]: 2026/09/23 04:43:33 INFO Signed narinfos id=45 count=1 worker2 # [ 121.804280] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.888Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.810892] niks3-server[1185]: 2026/09/23 04:43:33 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 121.820201] niks3-server[1185]: 2026/09/23 04:43:33 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 121.828149] niks3-server[1185]: 2026/09/23 04:43:33 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 121.840190] niks3-server[1185]: 2026/09/23 04:43:33 INFO Completed upload id=45 worker2 # [ 121.841926] nix-grpc-daemon[1400]: time=2026-09-23T04:43:33.926Z level=INFO msg="Upload complete. (178ms)" lb # [ 121.842096] niks3-server[1185]: 2026/09/23 04:43:33 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 121.846880] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 121.852784] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 121.862667] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 121.872778] nix-daemon[874]: reaped child process 1471, status = succeeded worker2 # [ 121.877498] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 123.120842] nix-daemon[874]: reaped child process 1481, status = succeeded worker2 # [ 123.199470] nix-daemon[874]: accepted connection from pid 1497, user nix-grpc-daemon (trusted) worker2 # [ 123.212190] nix-daemon[874]: reaped child process 1500, status = succeeded lb # [ 123.218539] niks3-server[1185]: 2026/09/23 04:43:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.230968] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.315Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 123.232439] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.316Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 123.262136] niks3-server[1185]: 2026/09/23 04:43:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 123.271778] niks3-server[1185]: 2026/09/23 04:43:35 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst worker2 # [ 123.280770] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.280667] niks3-server[1185]: 2026/09/23 04:43:35 INFO Signed narinfos id=46 count=1 lb # [ 123.282650] niks3-server[1185]: 2026/09/23 04:43:35 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 123.293749] niks3-server[1185]: 2026/09/23 04:43:35 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 123.301226] niks3-server[1185]: 2026/09/23 04:43:35 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo lb # [ 123.304078] niks3-server[1185]: 2026/09/23 04:43:35 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 123.308110] niks3-server[1185]: 2026/09/23 04:43:35 INFO Completed upload id=46 worker2 # [ 123.311433] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.395Z level=INFO msg="Upload complete. (226ms)" worker2 # [ 123.318205] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker2 # [ 123.330865] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 123.334353] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 123.343643] nix-daemon[874]: reaped child process 1479, status = succeeded worker2 # [ 123.374678] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 123.387471] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 123.402232] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.486Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 123.411490] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 123.419874] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 123.516298] nix-daemon[874]: accepted connection from pid 1506, user nix-grpc-daemon (trusted) worker2 # [ 123.529675] nix-daemon[874]: reaped child process 1509, status = succeeded lb # [ 123.534706] niks3-server[1185]: 2026/09/23 04:43:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.548698] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.633Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 123.550231] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.634Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 123.571206] niks3-server[1185]: 2026/09/23 04:43:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 123.575215] niks3-server[1185]: 2026/09/23 04:43:35 INFO Signed narinfos id=47 count=1 worker2 # [ 123.579761] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.664Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.585087] niks3-server[1185]: 2026/09/23 04:43:35 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 123.589708] niks3-server[1185]: 2026/09/23 04:43:35 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 123.598389] niks3-server[1185]: 2026/09/23 04:43:35 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 123.602959] niks3-server[1185]: 2026/09/23 04:43:35 INFO Completed upload id=47 worker2 # [ 123.605000] nix-grpc-daemon[1400]: time=2026-09-23T04:43:35.689Z level=INFO msg="Upload complete. (171ms)" lb # [ 123.605403] niks3-server[1185]: 2026/09/23 04:43:35 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 123.609648] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 123.614380] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 123.625933] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 123.629819] nix-daemon[874]: reaped child process 1504, status = succeeded worker2 # [ 123.634685] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 124.248890] nix-daemon[874]: reaped child process 1513, status = succeeded worker2 # [ 124.323024] nix-daemon[874]: accepted connection from pid 1529, user nix-grpc-daemon (trusted) worker2 # [ 124.338176] nix-daemon[874]: reaped child process 1532, status = succeeded lb # [ 124.340977] niks3-server[1185]: 2026/09/23 04:43:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 124.351886] nix-grpc-daemon[1400]: time=2026-09-23T04:43:36.435Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 124.353295] nix-grpc-daemon[1400]: time=2026-09-23T04:43:36.435Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 124.381948] niks3-server[1185]: 2026/09/23 04:43:36 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 124.387930] niks3-server[1185]: 2026/09/23 04:43:36 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 124.391247] niks3-server[1185]: 2026/09/23 04:43:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker2 # [ 124.397644] nix-grpc-daemon[1400]: time=2026-09-23T04:43:36.481Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.395734] niks3-server[1185]: 2026/09/23 04:43:36 INFO Signed narinfos id=48 count=1 lb # [ 124.404855] niks3-server[1185]: 2026/09/23 04:43:36 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 124.410063] niks3-server[1185]: 2026/09/23 04:43:36 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 124.413913] niks3-server[1185]: 2026/09/23 04:43:36 INFO Completed upload id=48 lb # [ 124.416289] niks3-server[1185]: 2026/09/23 04:43:36 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 124.417341] nix-grpc-daemon[1400]: time=2026-09-23T04:43:36.501Z level=INFO msg="Upload complete. (176ms)" worker2 # [ 124.425560] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=0 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker2 # [ 124.437843] nix-daemon[874]: reaped child process 1511, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 4.01 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.12 seconds) worker1 # [ 124.595896] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 124.604165] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 124.694124] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 124.696123] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 124.699858] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 124.704058] nix-grpc-daemon[1362]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 124.705423] nix-grpc-daemon[1362]: E0000 00:00:1790138615.955115 1362 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 124.711201] nix-grpc-daemon[1362]: E0000 00:00:1790138615.960312 1362 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.715106] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 124.716673] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 124.722109] nix-grpc-daemon[1362]: E0000 00:00:1790138615.972760 1404 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 124.734171] nix-grpc-daemon[1362]: E0000 00:00:1790138615.985728 1404 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.738150] nix-grpc-daemon[1362]: E0000 00:00:1790138615.987981 1404 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 124.748335] nix-grpc-daemon[1362]: E0000 00:00:1790138615.999912 1404 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.758524] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.799751] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:36Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37674 worker2 # [ 124.804077] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 10.81 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 125.016597] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 964fc14fe0f04a548e5b139789d0a1c3 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) client # [ 125.162455] nix[1363]: don't know how to build these paths: client # [ 125.163337] nix[1363]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 125.171556] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 125.181884] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 125.186695] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 125.226285] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 125.238574] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55110 client # [ 125.238189] nix[1363]: copying 1 paths to 'lb:50051'... worker2 # [ 125.250272] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 client # [ 125.241147] nix[1363]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 125.262959] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 125.363383] nix-daemon[874]: accepted connection from pid 1545, user nix-grpc-daemon (trusted) worker2 # [ 125.376272] nix-daemon[874]: reaped child process 1548, status = succeeded lb # [ 125.382480] niks3-server[1185]: 2026/09/23 04:43:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 125.393375] nix-grpc-daemon[1400]: time=2026-09-23T04:43:37.477Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 125.395336] nix-grpc-daemon[1400]: time=2026-09-23T04:43:37.479Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 125.411819] niks3-server[1185]: 2026/09/23 04:43:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 125.422307] niks3-server[1185]: 2026/09/23 04:43:37 INFO Signed narinfos id=49 count=1 worker2 # [ 125.427187] nix-grpc-daemon[1400]: time=2026-09-23T04:43:37.511Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.427389] niks3-server[1185]: 2026/09/23 04:43:37 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 125.435819] niks3-server[1185]: 2026/09/23 04:43:37 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 125.445110] niks3-server[1185]: 2026/09/23 04:43:37 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 125.452506] niks3-server[1185]: 2026/09/23 04:43:37 INFO Completed upload id=49 worker2 # [ 125.454447] nix-grpc-daemon[1400]: time=2026-09-23T04:43:37.538Z level=INFO msg="Upload complete. (179ms)" lb # [ 125.454821] niks3-server[1185]: 2026/09/23 04:43:37 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 125.458845] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 125.464280] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 worker2 # [ 125.475107] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 125.481075] nix-daemon[874]: reaped child process 1543, status = succeeded worker2 # [ 125.484052] nix-daemon[874]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) client # [ 125.473397] nix[1363]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb # [ 127.411197] envoy[926]: conn peer=[2001:db8:1::1]:40056 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9543 tx=4359 ms=3836 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 127.655625] systemd-journald[282]: Received client request to rotate journal, rotating. worker1 # [ 127.675311] systemd-journald[282]: Vacuuming done, freed 0B of archived journals from /var/log/journal/d01b1d4f78524b4fa22d224a2f3d8216. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 127.616105] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds) client: must succeed: sleep 5.0 worker2 # [ 127.906405] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:39Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 132.907994] nix-daemon[874]: reaped child process 1552, status = succeeded worker2 # [ 132.986090] nix-daemon[874]: accepted connection from pid 1593, user nix-grpc-daemon (trusted) worker2 # [ 132.999953] nix-daemon[874]: reaped child process 1596, status = succeeded lb # [ 133.003363] niks3-server[1185]: 2026/09/23 04:43:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 133.013931] nix-grpc-daemon[1400]: time=2026-09-23T04:43:45.098Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 133.017061] nix-grpc-daemon[1400]: time=2026-09-23T04:43:45.100Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 133.045138] niks3-server[1185]: 2026/09/23 04:43:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 133.056170] niks3-server[1185]: 2026/09/23 04:43:45 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst worker2 # [ 133.062608] nix-grpc-daemon[1400]: time=2026-09-23T04:43:45.146Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.060712] niks3-server[1185]: 2026/09/23 04:43:45 INFO Signed narinfos id=50 count=1 lb # [ 133.064518] niks3-server[1185]: 2026/09/23 04:43:45 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 133.068906] niks3-server[1185]: 2026/09/23 04:43:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 133.079706] niks3-server[1185]: 2026/09/23 04:43:45 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 133.084373] niks3-server[1185]: 2026/09/23 04:43:45 INFO Completed upload id=50 worker2 # [ 133.086201] nix-grpc-daemon[1400]: time=2026-09-23T04:43:45.170Z level=INFO msg="Upload complete. (189ms)" lb # [ 133.086444] niks3-server[1185]: 2026/09/23 04:43:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 133.093917] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55110 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 133.109383] nix-daemon[874]: reaped child process 1550, status = succeeded client # [ 133.122630] systemd[1]: rs.service: Deactivated successfully. client # [ 133.126849] systemd[1]: rs.service: Consumed 133ms CPU time over 8.109s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 133.908307] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:45Z level=info event=signal_exit lb # [ 134.021873] niks3-server[1185]: 2026/09/23 04:43:46 INFO lead: released remote=192.168.1.4:51754 lb # [ 134.760765] niks3-server[1185]: 2026/09/23 04:43:46 INFO lead: acquired remote=192.168.1.3:55000 worker1 # [ 134.724572] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:45Z level=info event=scheduler_take_over worker1 # [ 134.984495] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:46Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 135.028313] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:47Z level=info event=scheduler_restarting worker2 # [ 135.032360] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:47Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 135.036500] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37674 worker2 # [ 135.040420] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 135.043863] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37674 worker2 # [ 135.047526] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:47Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 135.066704] nix-daemon[874]: reaped child process 1392, status = succeeded worker1 # [ 135.185545] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 135.189949] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 135.238805] nix-grpc-daemon[1339]: ts=2026-09-23T04:43:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 135.390829] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 135.397685] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:46Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42756 worker1 # [ 135.402595] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 135.979425] nix-grpc-daemon[1339]: E0000 00:00:1790138628.063647 1385 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker2 # [ 135.984749] nix-grpc-daemon[1339]: E0000 00:00:1790138628.063807 1385 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.17 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 136.908869] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 136.912870] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 136.915124] systemd[1]: nix-grpc-daemon.service: Consumed 1.220s CPU time over 35.105s wall clock time, 38.4M memory peak, 64.9K incoming IP traffic, 174.6K outgoing IP traffic. worker2 # [ 136.930708] systemd[1]: Starting scheduler-token.service... worker2 # [ 136.977735] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 136.979372] systemd[1]: Finished scheduler-token.service. worker2 # [ 136.980659] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 48ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 136.985221] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 137.065157] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 137.070092] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 137.073179] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 137.075232] nix-grpc-daemon[1606]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 137.076624] nix-grpc-daemon[1606]: E0000 00:00:1790138629.156961 1606 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 137.084164] nix-grpc-daemon[1606]: E0000 00:00:1790138629.164502 1606 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 137.087155] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 137.090062] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 137.090870] nix-grpc-daemon[1606]: E0000 00:00:1790138629.173877 1648 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 137.102854] nix-grpc-daemon[1606]: E0000 00:00:1790138629.187301 1648 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 137.106210] nix-grpc-daemon[1606]: E0000 00:00:1790138629.189491 1648 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 137.117513] nix-grpc-daemon[1606]: E0000 00:00:1790138629.201979 1648 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 137.127206] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 137.096827] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:48Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 137.101297] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:48Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42756 worker1 # [ 137.105274] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:48Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.31 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 137.319606] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: e4b49f13c90647f0a9c5033d1dd01f11 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) lb # [ 137.411130] envoy[926]: conn peer=[2001:db8:1::1]:54770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=1499 ms=7942 lb # [ 137.415122] envoy[926]: conn peer=[2001:db8:1::4]:42492 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=42525 tx=2265 ms=33284 worker1 # [ 137.436166] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42758 worker1 # [ 137.447710] nix-daemon[847]: accepted connection from pid 1362, user nix-grpc-daemon (trusted) client # [ 137.489053] nix[1399]: don't know how to build these paths: client # [ 137.490259] nix[1399]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 137.467797] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:48Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 137.472726] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:48Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 137.518767] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42758 worker1 # [ 137.530425] nix-grpc-daemon[1362]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5) worker1 # [ 137.554873] nix-grpc-daemon[1362]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 2/5) worker1 # [ 137.618953] nix-grpc-daemon[1362]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 200 ms (attempt 3/5) worker1 # [ 137.821230] nix-grpc-daemon[1362]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 313 ms (attempt 4/5) worker1 # [ 138.143877] nix-grpc-daemon[1362]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 138.147407] nix-grpc-daemon[1362]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 138.165817] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42758 client # [ 138.205285] nix[1399]: copying 1 paths to 'lb:50051'... worker1 # [ 138.177899] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42758 client # [ 138.207834] nix[1399]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 138.189179] nix-daemon[847]: accepted connection from pid 1362, user nix-grpc-daemon (trusted) worker1 # [ 138.211411] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:49Z level=info event=niks3_push_started pid=1491 worker1 # [ 138.317726] nix-grpc-daemon[1491]: time=2026-09-23T04:43:49.567Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 138.401446] nix-daemon[847]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker1 # [ 138.418748] nix-daemon[847]: reaped child process 1506, status = succeeded lb # [ 138.459851] niks3-server[1185]: 2026/09/23 04:43:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.432828] nix-grpc-daemon[1491]: time=2026-09-23T04:43:49.684Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.436594] nix-grpc-daemon[1491]: time=2026-09-23T04:43:49.686Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 138.502438] niks3-server[1185]: 2026/09/23 04:43:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 138.510145] niks3-server[1185]: 2026/09/23 04:43:50 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 138.525178] niks3-server[1185]: 2026/09/23 04:43:50 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst worker1 # [ 138.495782] nix-grpc-daemon[1491]: time=2026-09-23T04:43:49.747Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.533163] niks3-server[1185]: 2026/09/23 04:43:50 INFO Signed narinfos id=51 count=1 lb # [ 138.541753] niks3-server[1185]: 2026/09/23 04:43:50 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 138.546786] niks3-server[1185]: 2026/09/23 04:43:50 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo lb # [ 138.553556] niks3-server[1185]: 2026/09/23 04:43:50 INFO Completed upload id=51 worker1 # [ 138.516451] nix-grpc-daemon[1491]: time=2026-09-23T04:43:49.767Z level=INFO msg="Upload complete. (199ms)" worker1 # [ 138.520676] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42758 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 138.526281] nix-grpc-daemon[1362]: ts=2026-09-23T04:43:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42758 worker1 # [ 138.534543] nix-daemon[847]: accepted connection from pid 1362, user nix-grpc-daemon (trusted) worker1 # [ 138.541773] nix-daemon[847]: reaped child process 1489, status = succeeded worker1 # [ 138.544705] nix-daemon[847]: accepted connection from pid 1362, user nix-grpc-daemon (trusted) client # [ 138.573671] nix[1399]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 140.890364] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1362 (nix-grpc-daemon) on client request. worker1 # [ 140.894397] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 140.937916] niks3-server[1185]: 2026/09/23 04:43:52 INFO lead: released remote=192.168.1.3:55000 worker1 # [ 140.911084] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL client # [ 140.937518] nix[1399]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 140.912534] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 140.947595] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:53Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker1 # [ 140.913766] systemd[1]: nix-grpc-daemon.service: Consumed 378ms CPU time over 16.302s wall clock time, 35.6M memory peak, 15.4K incoming IP traffic, 27.4K outgoing IP traffic. client # [ 140.942272] nix[1399]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 140.919331] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 140.922548] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 140.957181] nix-daemon[847]: reaped child process 1512, status = succeeded worker1 # [ 140.958883] nix-daemon[847]: reaped child process 1481, status = succeeded worker1 # [ 140.965529] nix-daemon[1514]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 140.974198] nix-daemon[847]: reaped child process 1514, status = failed with exit code 1 worker1 # [ 141.014254] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 141.016204] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 141.019561] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 141.023784] nix-grpc-daemon[1550]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 141.025203] nix-grpc-daemon[1550]: E0000 00:00:1790138632.275109 1550 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 141.033276] nix-grpc-daemon[1550]: E0000 00:00:1790138632.280531 1550 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 141.037111] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 141.038768] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 141.076446] niks3-server[1185]: 2026/09/23 04:43:53 INFO lead: acquired remote=192.168.1.3:43776 worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.18 seconds) client: must succeed: sleep 5.0 worker1 # [ 141.044248] nix-grpc-daemon[1550]: E0000 00:00:1790138632.292199 1593 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 141.047114] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=scheduler_take_over worker1 # [ 141.054623] nix-grpc-daemon[1550]: E0000 00:00:1790138632.306198 1593 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 141.059056] nix-grpc-daemon[1550]: E0000 00:00:1790138632.308561 1593 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 141.068731] nix-grpc-daemon[1550]: E0000 00:00:1790138632.320270 1593 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 141.078254] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.084649] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42774 worker1 # [ 141.086450] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 141.148078] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.113726] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 141.115186] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42774 worker1 # [ 141.116741] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 141.423582] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 141.428809] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 141.472899] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42802 worker1 # [ 141.483176] nix-daemon[847]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 141.497647] nix-daemon[847]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) client # [ 141.539766] nix[1399]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 141.512466] nix-daemon[847]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 146.335612] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:57Z level=info event=niks3_push_started pid=1635 worker1 # [ 146.366771] nix-daemon[847]: reaped child process 1610, status = succeeded worker1 # [ 146.444648] nix-grpc-daemon[1635]: time=2026-09-23T04:43:57.695Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 146.529461] nix-daemon[847]: accepted connection from pid 1648, user nix-grpc-daemon (trusted) worker1 # [ 146.542654] nix-daemon[847]: reaped child process 1651, status = succeeded lb # [ 146.589856] niks3-server[1185]: 2026/09/23 04:43:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.560094] nix-grpc-daemon[1635]: time=2026-09-23T04:43:57.811Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.561680] nix-grpc-daemon[1635]: time=2026-09-23T04:43:57.813Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 146.636308] niks3-server[1185]: 2026/09/23 04:43:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 146.607224] nix-grpc-daemon[1635]: time=2026-09-23T04:43:57.858Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.644978] niks3-server[1185]: 2026/09/23 04:43:58 INFO Signed narinfos id=52 count=1 lb # [ 146.658450] niks3-server[1185]: 2026/09/23 04:43:58 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 146.660952] niks3-server[1185]: 2026/09/23 04:43:58 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 146.665981] niks3-server[1185]: 2026/09/23 04:43:58 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 146.671465] niks3-server[1185]: 2026/09/23 04:43:58 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 146.675322] niks3-server[1185]: 2026/09/23 04:43:58 INFO Completed upload id=52 worker1 # [ 146.638063] nix-grpc-daemon[1635]: time=2026-09-23T04:43:57.889Z level=INFO msg="Upload complete. (190ms)" lb # [ 146.677950] niks3-server[1185]: 2026/09/23 04:43:58 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 146.645126] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42802 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 146.658419] nix-daemon[847]: reaped child process 1608, status = succeeded client # [ 146.710724] systemd[1]: mid.service: Deactivated successfully. client # [ 146.714533] systemd[1]: mid.service: Consumed 146ms CPU time over 9.394s wall clock time, 43.5M memory peak, 8.7K incoming IP traffic, 10.3K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.13 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr lb # [ 147.412187] envoy[926]: conn peer=[2001:db8:1::3]:37008 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1010 tx=393 ms=16153 lb # [ 147.416610] envoy[926]: conn peer=[2001:db8:1::1]:58130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3891 tx=1923 ms=9230 client # [ 147.421432] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: d5502ae8dd584a35a017f537b380e275 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker2 # [ 147.565174] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 147.575593] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # [ 147.577934] nix[1435]: don't know how to build these paths: client # [ 147.578941] nix[1435]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 147.558915] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:58Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 147.563574] nix-grpc-daemon[1550]: ts=2026-09-23T04:43:58Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 147.647195] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 147.658555] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5) worker2 # [ 147.726858] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 2/5) worker2 # [ 147.745609] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 3/5) worker2 # [ 147.782364] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 4/5) worker2 # [ 147.846907] nix-grpc-daemon[1606]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 147.850632] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 147.867465] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 client # [ 147.867199] nix[1435]: copying 1 paths to 'lb:50051'... client # [ 147.870313] nix[1435]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 147.881510] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 147.890332] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 147.912754] nix-grpc-daemon[1606]: ts=2026-09-23T04:43:59Z level=info event=niks3_push_started pid=1699 worker2 # [ 148.018487] nix-grpc-daemon[1699]: time=2026-09-23T04:44:00.102Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 148.106106] nix-daemon[874]: accepted connection from pid 1712, user nix-grpc-daemon (trusted) worker2 # [ 148.118164] nix-daemon[874]: reaped child process 1715, status = succeeded lb # [ 148.126570] niks3-server[1185]: 2026/09/23 04:44:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.135527] nix-grpc-daemon[1699]: time=2026-09-23T04:44:00.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 148.137028] nix-grpc-daemon[1699]: time=2026-09-23T04:44:00.221Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 148.165226] niks3-server[1185]: 2026/09/23 04:44:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 148.170869] niks3-server[1185]: 2026/09/23 04:44:00 INFO Signed narinfos id=53 count=1 worker2 # [ 148.176450] nix-grpc-daemon[1699]: time=2026-09-23T04:44:00.260Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.177381] niks3-server[1185]: 2026/09/23 04:44:00 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 148.192247] niks3-server[1185]: 2026/09/23 04:44:00 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 148.198136] niks3-server[1185]: 2026/09/23 04:44:00 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 148.204588] niks3-server[1185]: 2026/09/23 04:44:00 INFO Completed upload id=53 worker2 # [ 148.206243] nix-grpc-daemon[1699]: time=2026-09-23T04:44:00.290Z level=INFO msg="Upload complete. (184ms)" lb # [ 148.208553] niks3-server[1185]: 2026/09/23 04:44:00 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 148.210749] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 148.215677] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 148.227061] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 148.231036] nix-daemon[874]: reaped child process 1697, status = succeeded worker2 # [ 148.235849] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # [ 148.225089] nix[1435]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr worker2 # [ 149.761227] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:01Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 149.747889] systemd[1]: intr.service: Sent signal SIGINT to main process 1435 (nix) on client request. client # [ 149.755799] nix[1435]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 149.760964] nix[1435]: error: interrupted by the user client # [ 149.790900] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 149.793970] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 149.797787] systemd[1]: intr.service: Consumed 119ms CPU time over 2.372s wall clock time, 41.3M memory peak, 6.4K incoming IP traffic, 8.4K outgoing IP traffic. (finished: subtest: interrupting the client stops the build on the worker, in 2.45 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw worker2 # [ 149.863528] nix-daemon[874]: reaped child process 1717, status = succeeded worker2 # [ 149.865628] nix-daemon[1719]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 149.870393] nix-daemon[874]: reaped child process 1719, status = failed with exit code 1 client # [ 149.887449] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: b26128f4581c4ca49654d8f7345e64c2 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.05 seconds) client # [ 150.011233] nix[1456]: don't know how to build these paths: client # [ 150.012146] nix[1456]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 150.019965] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58736 worker1 # [ 149.990908] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:01Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 149.996818] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:01Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.040100] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42802 worker1 # [ 150.051589] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5) worker1 # [ 150.090835] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 2/5) worker1 # [ 150.123883] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 211 ms (attempt 3/5) worker1 # [ 150.336997] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 585 ms (attempt 4/5) worker1 # [ 150.924254] nix-grpc-daemon[1550]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 150.928155] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 150.945514] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42802 client # [ 150.987303] nix[1456]: copying 1 paths to 'lb:50051'... worker1 # [ 150.959690] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42802 client # [ 150.990945] nix[1456]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 150.975844] nix-daemon[847]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 151.081536] nix-daemon[847]: accepted connection from pid 1687, user nix-grpc-daemon (trusted) worker1 # [ 151.095154] nix-daemon[847]: reaped child process 1690, status = succeeded lb # [ 151.139268] niks3-server[1185]: 2026/09/23 04:44:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.112511] nix-grpc-daemon[1635]: time=2026-09-23T04:44:02.363Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.113992] nix-grpc-daemon[1635]: time=2026-09-23T04:44:02.363Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 151.172807] niks3-server[1185]: 2026/09/23 04:44:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 151.179281] niks3-server[1185]: 2026/09/23 04:44:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 151.191756] niks3-server[1185]: 2026/09/23 04:44:03 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 151.195282] niks3-server[1185]: 2026/09/23 04:44:03 INFO Signed narinfos id=54 count=1 worker1 # [ 151.159070] nix-grpc-daemon[1635]: time=2026-09-23T04:44:02.409Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.200979] niks3-server[1185]: 2026/09/23 04:44:03 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 151.207580] niks3-server[1185]: 2026/09/23 04:44:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo lb # [ 151.211518] niks3-server[1185]: 2026/09/23 04:44:03 INFO Completed upload id=54 worker1 # [ 151.174491] nix-grpc-daemon[1635]: time=2026-09-23T04:44:02.425Z level=INFO msg="Upload complete. (183ms)" worker1 # [ 151.178678] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42802 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 151.184379] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42802 worker1 # [ 151.194061] nix-daemon[847]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 151.198131] nix-daemon[847]: reaped child process 1684, status = succeeded worker1 # [ 151.202700] nix-daemon[847]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) client # [ 151.231773] nix[1456]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 153.379595] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 153.409498] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker2 # [ 153.642945] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58736 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker1 # [ 153.613607] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42802 worker1 # [ 153.635699] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:04Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 153.637782] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:04Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 153.725593] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 153.739679] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 client # copying 1 paths to 'lb:50051'... worker2 # [ 153.754243] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 153.775821] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 153.887432] nix-daemon[874]: accepted connection from pid 1770, user nix-grpc-daemon (trusted) worker2 # [ 153.901172] nix-daemon[874]: reaped child process 1773, status = succeeded lb # [ 153.907549] niks3-server[1185]: 2026/09/23 04:44:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 153.922726] nix-grpc-daemon[1699]: time=2026-09-23T04:44:06.006Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 153.924233] nix-grpc-daemon[1699]: time=2026-09-23T04:44:06.006Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 153.941403] niks3-server[1185]: 2026/09/23 04:44:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker2 # [ 153.952608] nix-grpc-daemon[1699]: time=2026-09-23T04:44:06.036Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.950909] niks3-server[1185]: 2026/09/23 04:44:05 INFO Signed narinfos id=55 count=1 lb # [ 153.958234] niks3-server[1185]: 2026/09/23 04:44:05 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 153.963354] niks3-server[1185]: 2026/09/23 04:44:05 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 153.969868] niks3-server[1185]: 2026/09/23 04:44:05 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 153.973784] niks3-server[1185]: 2026/09/23 04:44:05 INFO Completed upload id=55 worker2 # [ 153.975758] nix-grpc-daemon[1699]: time=2026-09-23T04:44:06.060Z level=INFO msg="Upload complete. (184ms)" lb # [ 153.975944] niks3-server[1185]: 2026/09/23 04:44:05 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 153.979887] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 153.984871] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 153.996221] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 154.000088] nix-daemon[874]: reaped child process 1768, status = succeeded worker2 # [ 154.004222] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 154.035414] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:05Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 155.447380] nix-daemon[874]: reaped child process 1777, status = succeeded worker2 # [ 155.527948] nix-daemon[874]: accepted connection from pid 1793, user nix-grpc-daemon (trusted) worker2 # [ 155.541640] nix-daemon[874]: reaped child process 1796, status = succeeded lb # [ 155.549986] niks3-server[1185]: 2026/09/23 04:44:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 155.559183] nix-grpc-daemon[1699]: time=2026-09-23T04:44:07.643Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 155.560799] nix-grpc-daemon[1699]: time=2026-09-23T04:44:07.645Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 155.591984] niks3-server[1185]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 155.596712] niks3-server[1185]: 2026/09/23 04:44:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 155.604191] niks3-server[1185]: 2026/09/23 04:44:07 INFO Signed narinfos id=56 count=1 worker2 # [ 155.609071] nix-grpc-daemon[1699]: time=2026-09-23T04:44:07.693Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.612453] niks3-server[1185]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 155.623210] niks3-server[1185]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 155.630441] niks3-server[1185]: 2026/09/23 04:44:07 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 155.634651] niks3-server[1185]: 2026/09/23 04:44:07 INFO Completed upload id=56 worker2 # [ 155.637926] nix-grpc-daemon[1699]: time=2026-09-23T04:44:07.722Z level=INFO msg="Upload complete. (225ms)" worker2 # [ 155.644722] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker1 # [ 155.611124] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:06Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 155.612958] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:06Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 155.662052] nix-daemon[874]: reaped child process 1775, status = succeeded worker2 # [ 155.694778] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 155.708878] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 155.722285] nix-grpc-daemon[1699]: time=2026-09-23T04:44:07.806Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 155.731306] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 155.751176] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 155.856719] nix-daemon[874]: accepted connection from pid 1800, user nix-grpc-daemon (trusted) worker2 # [ 155.870925] nix-daemon[874]: reaped child process 1803, status = succeeded lb # [ 155.876115] niks3-server[1185]: 2026/09/23 04:44:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 155.886688] nix-grpc-daemon[1699]: time=2026-09-23T04:44:07.971Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 155.888293] nix-grpc-daemon[1699]: time=2026-09-23T04:44:07.972Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 155.913647] niks3-server[1185]: 2026/09/23 04:44:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 155.919831] niks3-server[1185]: 2026/09/23 04:44:07 INFO Signed narinfos id=57 count=1 worker2 # [ 155.924927] nix-grpc-daemon[1699]: time=2026-09-23T04:44:08.009Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.927717] niks3-server[1185]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 155.934187] niks3-server[1185]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 155.946117] niks3-server[1185]: 2026/09/23 04:44:07 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 155.952135] niks3-server[1185]: 2026/09/23 04:44:07 INFO Completed upload id=57 lb # [ 155.956156] niks3-server[1185]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 155.956547] nix-grpc-daemon[1699]: time=2026-09-23T04:44:08.040Z level=INFO msg="Upload complete. (191ms)" worker2 # [ 155.961474] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 155.967761] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 155.981114] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 155.989468] nix-daemon[874]: reaped child process 1798, status = succeeded worker2 # [ 155.993892] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 157.223574] nix-daemon[874]: reaped child process 1807, status = succeeded worker2 # [ 157.298155] nix-daemon[874]: accepted connection from pid 1823, user nix-grpc-daemon (trusted) worker2 # [ 157.311832] nix-daemon[874]: reaped child process 1826, status = succeeded lb # [ 157.318371] niks3-server[1185]: 2026/09/23 04:44:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 157.331374] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.415Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 157.332886] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.417Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 157.362983] niks3-server[1185]: 2026/09/23 04:44:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker2 # [ 157.369469] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.453Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.368247] niks3-server[1185]: 2026/09/23 04:44:09 INFO Signed narinfos id=58 count=1 lb # [ 157.380629] niks3-server[1185]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 157.384744] niks3-server[1185]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 157.395660] niks3-server[1185]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 157.399059] niks3-server[1185]: 2026/09/23 04:44:09 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 157.403449] niks3-server[1185]: 2026/09/23 04:44:09 INFO Completed upload id=58 lb # [ 157.405804] niks3-server[1185]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 157.406952] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.491Z level=INFO msg="Upload complete. (205ms)" lb # [ 157.412351] envoy[926]: conn peer=[2001:db8:1::1]:52616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2980 tx=828 ms=2228 worker2 # [ 157.413776] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker1 # [ 157.382162] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:08Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 157.384154] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:08Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 157.430805] nix-daemon[874]: reaped child process 1805, status = succeeded worker2 # [ 157.471822] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 157.485661] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 157.501086] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.584Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 157.510680] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 157.528586] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 157.637164] nix-daemon[874]: accepted connection from pid 1830, user nix-grpc-daemon (trusted) worker2 # [ 157.651963] nix-daemon[874]: reaped child process 1833, status = succeeded lb # [ 157.655812] niks3-server[1185]: 2026/09/23 04:44:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 157.666683] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.751Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 157.668307] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.752Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 157.692259] niks3-server[1185]: 2026/09/23 04:44:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 157.697553] niks3-server[1185]: 2026/09/23 04:44:09 INFO Signed narinfos id=59 count=1 worker2 # [ 157.702621] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.702493] niks3-server[1185]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 157.711523] niks3-server[1185]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 157.722916] niks3-server[1185]: 2026/09/23 04:44:09 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 157.730067] niks3-server[1185]: 2026/09/23 04:44:09 INFO Completed upload id=59 worker2 # [ 157.731869] nix-grpc-daemon[1699]: time=2026-09-23T04:44:09.816Z level=INFO msg="Upload complete. (187ms)" lb # [ 157.733286] niks3-server[1185]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 157.736945] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 157.742892] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 157.755115] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 157.762072] nix-daemon[874]: reaped child process 1828, status = succeeded worker2 # [ 157.767425] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 158.982850] nix-daemon[874]: reaped child process 1837, status = succeeded worker2 # [ 159.062413] nix-daemon[874]: accepted connection from pid 1853, user nix-grpc-daemon (trusted) worker2 # [ 159.074721] nix-daemon[874]: reaped child process 1856, status = succeeded lb # [ 159.081373] niks3-server[1185]: 2026/09/23 04:44:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 159.091990] nix-grpc-daemon[1699]: time=2026-09-23T04:44:11.176Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 159.093653] nix-grpc-daemon[1699]: time=2026-09-23T04:44:11.178Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 159.122636] niks3-server[1185]: 2026/09/23 04:44:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 159.129645] niks3-server[1185]: 2026/09/23 04:44:11 INFO Signed narinfos id=60 count=1 worker2 # [ 159.134973] nix-grpc-daemon[1699]: time=2026-09-23T04:44:11.219Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.136799] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 159.143368] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 159.149860] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 159.159695] niks3-server[1185]: 2026/09/23 04:44:11 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 159.164324] niks3-server[1185]: 2026/09/23 04:44:11 INFO Completed upload id=60 worker2 # [ 159.166354] nix-grpc-daemon[1699]: time=2026-09-23T04:44:11.250Z level=INFO msg="Upload complete. (191ms)" lb # [ 159.166644] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 159.174129] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 159.188477] nix-daemon[874]: reaped child process 1835, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 5.72 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 159.437935] nix-daemon[847]: reaped child process 1694, status = succeeded worker1 # [ 159.514574] nix-daemon[847]: accepted connection from pid 1742, user nix-grpc-daemon (trusted) worker1 # [ 159.527719] nix-daemon[847]: reaped child process 1745, status = succeeded lb # [ 159.572403] niks3-server[1185]: 2026/09/23 04:44:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.543842] nix-grpc-daemon[1635]: time=2026-09-23T04:44:10.795Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.545537] nix-grpc-daemon[1635]: time=2026-09-23T04:44:10.796Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 159.613930] niks3-server[1185]: 2026/09/23 04:44:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 159.618927] niks3-server[1185]: 2026/09/23 04:44:11 INFO Signed narinfos id=61 count=1 worker1 # [ 159.584720] nix-grpc-daemon[1635]: time=2026-09-23T04:44:10.836Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.630556] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 159.635604] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 159.641615] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 159.651128] niks3-server[1185]: 2026/09/23 04:44:11 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 159.654962] niks3-server[1185]: 2026/09/23 04:44:11 INFO Completed upload id=61 lb # [ 159.657306] niks3-server[1185]: 2026/09/23 04:44:11 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 159.619425] nix-grpc-daemon[1635]: time=2026-09-23T04:44:10.870Z level=INFO msg="Upload complete. (202ms)" worker1 # [ 159.627920] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42802 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 159.642118] nix-daemon[847]: reaped child process 1692, status = succeeded client # [ 159.686682] systemd[1]: sw.service: Deactivated successfully. client # [ 159.690533] systemd[1]: sw.service: Consumed 127ms CPU time over 9.802s wall clock time, 43.4M memory peak, 7.4K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 160.037251] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:11Z level=info event=signal_exit lb # [ 160.083886] niks3-server[1185]: 2026/09/23 04:44:12 INFO lead: released remote=192.168.1.3:43776 client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 161.086764] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 161.051535] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:12Z level=info event=scheduler_restarting worker1 # [ 161.055609] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42774 worker1 # [ 161.059465] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:12Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 161.063543] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:12Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 161.066797] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42774 worker1 # [ 161.070480] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:12Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 161.088887] nix-daemon[847]: reaped child process 1606, status = succeeded worker2 # [ 161.287301] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.291771] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 161.261290] nix-grpc-daemon[1550]: ts=2026-09-23T04:44:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 161.306076] nix-grpc-daemon[1550]: E0000 00:00:1790138652.557279 1597 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 161.310983] nix-grpc-daemon[1550]: E0000 00:00:1790138652.557431 1597 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 161.492883] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.497222] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 161.698311] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.702469] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 161.903663] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.907844] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 162.085724] niks3-server[1185]: 2026/09/23 04:44:14 INFO lead: acquired remote=192.168.1.4:59554 worker2 # [ 162.091634] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_take_over worker2 # [ 162.108757] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.112874] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.314429] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.318653] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.519771] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.523942] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.725157] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.729317] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.930337] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.935504] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 163.065343] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 163.069376] systemd[1]: nix-grpc-daemon.service: Consumed 573ms CPU time over 22.162s wall clock time, 35.8M memory peak, 24.9K incoming IP traffic, 32.8K outgoing IP traffic. worker1 # [ 163.085286] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 163.135995] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 163.153988] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 163.157270] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:51984 worker2 # [ 163.161872] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 163.177673] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 163.182131] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 163.185498] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 163.187494] nix-grpc-daemon[1759]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 163.188817] nix-grpc-daemon[1759]: E0000 00:00:1790138654.436236 1759 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 163.197707] nix-grpc-daemon[1759]: E0000 00:00:1790138654.443824 1759 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 163.203076] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 163.204751] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 163.205664] nix-grpc-daemon[1759]: E0000 00:00:1790138654.452745 1801 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 163.216978] nix-grpc-daemon[1759]: E0000 00:00:1790138654.468551 1801 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 163.222215] nix-grpc-daemon[1759]: E0000 00:00:1790138654.468778 1801 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.81 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 163.232508] nix-grpc-daemon[1759]: E0000 00:00:1790138654.484031 1801 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 163.245968] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 163.287172] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:51984 worker2 # [ 163.291919] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:15Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.59 seconds) subtest: queue gauges show a burst while every build blocks lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]' client # [ 164.590930] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # Running as unit: burst.service; invocation ID: 6c048fec59f548ba8cb35d555107cd5d client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 164.744807] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58736 client # [ 164.740339] nix[1512]: don't know how to build these paths: client # [ 164.741397] nix[1512]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv client # [ 164.742567] nix[1512]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv client # [ 164.743627] nix[1512]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv client # [ 164.744802] nix[1512]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker2 # [ 164.756881] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=want client=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=0 worker2 # [ 164.761274] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 164.765761] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=want client=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=0 worker2 # [ 164.770746] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 164.773344] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=want client=1 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=0 worker2 # [ 164.775116] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=want client=1 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 164.806505] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker1 # [ 164.771808] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker2 # [ 164.819602] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 worker1 # [ 164.783591] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) client # [ 164.820313] nix[1512]: copying 1 paths to 'lb:50051'... worker2 # [ 164.831892] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 client # [ 164.823887] nix[1512]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'... worker1 # [ 164.800344] nix-grpc-daemon[1759]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5) worker2 # [ 164.843697] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 164.844156] nix-grpc-daemon[1759]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 2/5) worker2 # [ 164.942467] nix-daemon[874]: accepted connection from pid 1871, user nix-grpc-daemon (trusted) worker2 # [ 164.956620] nix-daemon[874]: reaped child process 1874, status = succeeded lb # [ 164.962783] niks3-server[1185]: 2026/09/23 04:44:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 164.974666] nix-grpc-daemon[1699]: time=2026-09-23T04:44:17.058Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 164.976506] nix-grpc-daemon[1699]: time=2026-09-23T04:44:17.060Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)" lb # [ 164.994535] niks3-server[1185]: 2026/09/23 04:44:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 165.004722] niks3-server[1185]: 2026/09/23 04:44:17 INFO Signed narinfos id=62 count=1 worker2 # [ 165.009730] nix-grpc-daemon[1699]: time=2026-09-23T04:44:17.094Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.008540] niks3-server[1185]: 2026/09/23 04:44:17 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls lb # [ 165.015950] niks3-server[1185]: 2026/09/23 04:44:17 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst lb # [ 165.024607] niks3-server[1185]: 2026/09/23 04:44:17 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 165.033377] niks3-server[1185]: 2026/09/23 04:44:17 INFO Completed upload id=62 worker2 # [ 165.035293] nix-grpc-daemon[1699]: time=2026-09-23T04:44:17.119Z level=INFO msg="Upload complete. (181ms)" lb # [ 165.035874] niks3-server[1185]: 2026/09/23 04:44:17 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo worker2 # [ 165.039668] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 165.044654] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 165.055572] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 165.060233] nix-daemon[874]: reaped child process 1869, status = succeeded worker2 # [ 165.064668] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 165.022365] nix-grpc-daemon[1759]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 3/5) client # [ 165.053842] nix[1512]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051... worker1 # [ 165.089095] nix-grpc-daemon[1759]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 586 ms (attempt 4/5) worker1 # [ 165.677258] nix-grpc-daemon[1759]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 165.680585] nix-grpc-daemon[1759]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 165.699479] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 client # [ 165.738239] nix[1512]: copying 1 paths to 'lb:50051'... client # [ 165.742748] nix[1512]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'... worker1 # [ 165.713897] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 165.724203] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 165.744745] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:16Z level=info event=niks3_push_started pid=1820 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 165.849851] nix-grpc-daemon[1820]: time=2026-09-23T04:44:17.101Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 165.951171] nix-daemon[847]: accepted connection from pid 1833, user nix-grpc-daemon (trusted) worker1 # [ 165.963299] nix-daemon[847]: reaped child process 1840, status = succeeded lb # [ 166.008578] niks3-server[1185]: 2026/09/23 04:44:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.979421] nix-grpc-daemon[1820]: time=2026-09-23T04:44:17.230Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 165.981419] nix-grpc-daemon[1820]: time=2026-09-23T04:44:17.232Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)" lb # [ 166.051923] niks3-server[1185]: 2026/09/23 04:44:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 166.058148] niks3-server[1185]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst worker1 # [ 166.030323] nix-grpc-daemon[1820]: time=2026-09-23T04:44:17.281Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.067124] niks3-server[1185]: 2026/09/23 04:44:18 INFO Signed narinfos id=63 count=1 lb # [ 166.082074] niks3-server[1185]: 2026/09/23 04:44:18 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 166.088282] niks3-server[1185]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls lb # [ 166.091248] niks3-server[1185]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo lb # [ 166.095607] niks3-server[1185]: 2026/09/23 04:44:18 INFO Completed upload id=63 worker1 # [ 166.058482] nix-grpc-daemon[1820]: time=2026-09-23T04:44:17.309Z level=INFO msg="Upload complete. (205ms)" worker1 # [ 166.063829] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 166.073117] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 166.081845] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 166.089522] nix-daemon[847]: reaped child process 1818, status = succeeded worker1 # [ 166.094490] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) client # [ 166.123096] nix[1512]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051... worker1 # [ 167.108180] nix-daemon[847]: reaped child process 1844, status = succeeded worker1 # [ 167.184626] nix-daemon[847]: accepted connection from pid 1865, user nix-grpc-daemon (trusted) worker1 # [ 167.195813] nix-daemon[847]: reaped child process 1868, status = succeeded lb # [ 167.242650] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.216583] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.467Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 167.218116] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.469Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)" worker2 # [ 167.282545] nix-daemon[874]: reaped child process 1878, status = succeeded lb # [ 167.285796] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst lb # [ 167.296281] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 167.299766] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker1 # [ 167.269402] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.520Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.306387] niks3-server[1185]: 2026/09/23 04:44:19 INFO Signed narinfos id=64 count=1 lb # [ 167.316463] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls lb # [ 167.317918] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 167.323340] niks3-server[1185]: 2026/09/23 04:44:19 INFO Completed upload id=64 worker1 # [ 167.285980] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.537Z level=INFO msg="Upload complete. (185ms)" lb # [ 167.324740] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo worker2 # [ 167.331300] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 167.291188] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=2 outputs=1 worker1 # [ 167.303261] nix-daemon[847]: reaped child process 1842, status = succeeded worker2 # [ 167.368122] nix-daemon[874]: accepted connection from pid 1906, user nix-grpc-daemon (trusted) worker1 # [ 167.336922] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker2 # [ 167.381858] nix-daemon[874]: reaped child process 1909, status = succeeded lb # [ 167.385369] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.353168] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker2 # [ 167.396881] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.481Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 167.399889] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.482Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)" client # [ 167.392982] nix[1512]: copying 1 paths to 'lb:50051'... worker1 # [ 167.364933] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 client # [ 167.396246] nix[1512]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'... worker1 # [ 167.373248] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) lb # [ 167.413598] envoy[926]: conn peer=[2001:db8:1::1]:34910 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=4359 ms=5551 lb # [ 167.417470] envoy[926]: conn peer=[2001:db8:1::1]:52628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=1540 ms=9658 lb # [ 167.421179] envoy[926]: conn peer=[2001:db8:1::3]:46970 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=975 tx=361 ms=20178 lb # [ 167.432817] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv lb # [ 167.435187] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 167.438119] niks3-server[1185]: 2026/09/23 04:44:19 INFO Signed narinfos id=65 count=1 worker2 # [ 167.441322] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.525Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.441588] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls lb # [ 167.446842] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 167.452263] niks3-server[1185]: 2026/09/23 04:44:19 INFO Completed upload id=65 worker2 # [ 167.454051] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.538Z level=INFO msg="Upload complete. (180ms)" lb # [ 167.453804] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst worker2 # [ 167.457323] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=2 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=1 outputs=1 lb # [ 167.457689] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo worker2 # [ 167.460690] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 167.464964] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 167.471793] nix-daemon[874]: reaped child process 1876, status = succeeded worker2 # [ 167.473284] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 client # [ 167.468220] nix[1512]: copying 1 paths to 'lb:50051'... worker2 # [ 167.478939] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 client # [ 167.470328] nix[1512]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'... worker2 # [ 167.488072] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 167.471307] nix-daemon[847]: accepted connection from pid 1872, user nix-grpc-daemon (trusted) worker1 # [ 167.483923] nix-daemon[847]: reaped child process 1875, status = succeeded lb # [ 167.528826] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.499519] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.751Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 167.501433] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.752Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)" lb # [ 167.557148] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 167.563365] niks3-server[1185]: 2026/09/23 04:44:19 INFO Signed narinfos id=66 count=1 worker1 # [ 167.528791] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.780Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.568316] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst lb # [ 167.573410] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls worker2 # [ 167.576513] nix-daemon[874]: accepted connection from pid 1913, user nix-grpc-daemon (trusted) lb # [ 167.579912] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 167.582906] niks3-server[1185]: 2026/09/23 04:44:19 INFO Completed upload id=66 worker1 # [ 167.545621] nix-grpc-daemon[1820]: time=2026-09-23T04:44:18.797Z level=INFO msg="Upload complete. (159ms)" lb # [ 167.584642] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo worker1 # [ 167.547908] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 167.590546] nix-daemon[874]: reaped child process 1916, status = succeeded worker1 # [ 167.551681] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 167.558110] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) lb # [ 167.595508] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.560387] nix-daemon[847]: reaped child process 1870, status = succeeded worker2 # [ 167.600654] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.685Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 167.602641] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.686Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)" worker1 # [ 167.565471] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) client # [ 167.593984] nix[1512]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051... lb # [ 167.608751] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 167.611559] niks3-server[1185]: 2026/09/23 04:44:19 INFO Signed narinfos id=67 count=1 worker2 # [ 167.613685] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.698Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.615273] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst lb # [ 167.619633] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls lb # [ 167.623160] niks3-server[1185]: 2026/09/23 04:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 167.626764] niks3-server[1185]: 2026/09/23 04:44:19 INFO Completed upload id=67 worker2 # [ 167.628493] nix-grpc-daemon[1699]: time=2026-09-23T04:44:19.712Z level=INFO msg="Upload complete. (135ms)" lb # [ 167.628597] niks3-server[1185]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo worker2 # [ 167.630512] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 167.634478] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 167.641721] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 167.643132] nix-daemon[874]: reaped child process 1911, status = succeeded worker2 # [ 167.648681] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # [ 167.637958] nix[1512]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051... worker1 # [ 169.380263] nix-daemon[847]: reaped child process 1879, status = succeeded worker2 # [ 169.465504] nix-daemon[874]: reaped child process 1920, status = succeeded worker1 # [ 169.458330] nix-daemon[847]: accepted connection from pid 1904, user nix-grpc-daemon (trusted) worker1 # [ 169.470128] nix-daemon[847]: reaped child process 1907, status = succeeded lb # [ 169.515946] niks3-server[1185]: 2026/09/23 04:44:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.487397] nix-grpc-daemon[1820]: time=2026-09-23T04:44:20.738Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 169.489165] nix-grpc-daemon[1820]: time=2026-09-23T04:44:20.740Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)" worker2 # [ 169.543661] nix-daemon[874]: accepted connection from pid 1945, user nix-grpc-daemon (trusted) worker2 # [ 169.556612] nix-daemon[874]: reaped child process 1948, status = succeeded lb # [ 169.558950] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv lb # [ 169.563751] niks3-server[1185]: 2026/09/23 04:44:21 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 169.570285] niks3-server[1185]: 2026/09/23 04:44:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker1 # [ 169.543695] nix-grpc-daemon[1820]: time=2026-09-23T04:44:20.795Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.580697] niks3-server[1185]: 2026/09/23 04:44:21 INFO Signed narinfos id=68 count=1 lb # [ 169.585557] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls worker2 # [ 169.593234] nix-grpc-daemon[1699]: time=2026-09-23T04:44:21.677Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" lb # [ 169.592267] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst worker2 # [ 169.596452] nix-grpc-daemon[1699]: time=2026-09-23T04:44:21.679Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)" lb # [ 169.601494] niks3-server[1185]: 2026/09/23 04:44:21 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 169.605191] niks3-server[1185]: 2026/09/23 04:44:21 INFO Completed upload id=68 worker1 # [ 169.568300] nix-grpc-daemon[1820]: time=2026-09-23T04:44:20.819Z level=INFO msg="Upload complete. (195ms)" lb # [ 169.609893] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo worker1 # [ 169.574681] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=3 outputs=1 lb # [ 169.619546] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv lb # [ 169.623455] niks3-server[1185]: 2026/09/23 04:44:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 169.625817] niks3-server[1185]: 2026/09/23 04:44:21 INFO Signed narinfos id=69 count=1 worker2 # [ 169.629028] nix-grpc-daemon[1699]: time=2026-09-23T04:44:21.713Z level=INFO msg="Uploading 1 narinfos" worker1 # [ 169.589697] nix-daemon[847]: reaped child process 1877, status = succeeded lb # [ 169.629157] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 169.634297] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls lb # [ 169.636829] niks3-server[1185]: 2026/09/23 04:44:21 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 169.640587] niks3-server[1185]: 2026/09/23 04:44:21 INFO Completed upload id=69 worker2 # [ 169.642489] nix-grpc-daemon[1699]: time=2026-09-23T04:44:21.726Z level=INFO msg="Upload complete. (186ms)" lb # [ 169.642732] niks3-server[1185]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo worker2 # [ 169.647973] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=4 outputs=1 worker2 # [ 169.659372] nix-daemon[874]: reaped child process 1918, status = succeeded client # [ 169.673298] systemd[1]: burst.service: Deactivated successfully. client # [ 169.677116] systemd[1]: burst.service: Consumed 166ms CPU time over 5.086s wall clock time, 55.9M memory peak, 14.1K incoming IP traffic, 18.5K outgoing IP traffic. client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; } client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: queue gauges show a burst while every build blocks, in 6.33 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 170.926175] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 170.932672] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 170.974894] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:23Z level=debug event=want client=2 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 170.980287] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:23Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 170.985090] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:23Z level=debug event=want client=2 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 170.990943] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:23Z level=debug event=want client=2 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 170.987728] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 171.001668] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 171.013550] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 171.024154] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 171.127755] nix-daemon[847]: accepted connection from pid 1915, user nix-grpc-daemon (trusted) worker1 # [ 171.140460] nix-daemon[847]: reaped child process 1918, status = succeeded lb # [ 171.188371] niks3-server[1185]: 2026/09/23 04:44:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.158592] nix-grpc-daemon[1820]: time=2026-09-23T04:44:22.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 171.160658] nix-grpc-daemon[1820]: time=2026-09-23T04:44:22.411Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 171.217593] niks3-server[1185]: 2026/09/23 04:44:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 171.192527] nix-grpc-daemon[1820]: time=2026-09-23T04:44:22.443Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.229712] niks3-server[1185]: 2026/09/23 04:44:23 INFO Signed narinfos id=70 count=1 lb # [ 171.237230] niks3-server[1185]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 171.242118] niks3-server[1185]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 171.255679] niks3-server[1185]: 2026/09/23 04:44:23 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 171.259856] niks3-server[1185]: 2026/09/23 04:44:23 INFO Completed upload id=70 worker1 # [ 171.223877] nix-grpc-daemon[1820]: time=2026-09-23T04:44:22.475Z level=INFO msg="Upload complete. (188ms)" lb # [ 171.262880] niks3-server[1185]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 171.227809] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 171.232632] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 171.244295] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 171.252471] nix-daemon[847]: reaped child process 1913, status = succeeded worker1 # [ 171.256514] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 172.286590] nix-daemon[847]: reaped child process 1922, status = succeeded worker1 # [ 172.362156] nix-daemon[847]: accepted connection from pid 1938, user nix-grpc-daemon (trusted) worker1 # [ 172.375441] nix-daemon[847]: reaped child process 1941, status = succeeded lb # [ 172.420906] niks3-server[1185]: 2026/09/23 04:44:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.392852] nix-grpc-daemon[1820]: time=2026-09-23T04:44:23.644Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.394433] nix-grpc-daemon[1820]: time=2026-09-23T04:44:23.646Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 172.466302] niks3-server[1185]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 172.474067] niks3-server[1185]: 2026/09/23 04:44:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign worker1 # [ 172.443047] nix-grpc-daemon[1820]: time=2026-09-23T04:44:23.694Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.480211] niks3-server[1185]: 2026/09/23 04:44:24 INFO Signed narinfos id=71 count=1 lb # [ 172.488663] niks3-server[1185]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 172.496337] niks3-server[1185]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 172.505127] niks3-server[1185]: 2026/09/23 04:44:24 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 172.511431] niks3-server[1185]: 2026/09/23 04:44:24 INFO Completed upload id=71 worker1 # [ 172.473957] nix-grpc-daemon[1820]: time=2026-09-23T04:44:23.725Z level=INFO msg="Upload complete. (210ms)" lb # [ 172.517598] niks3-server[1185]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 172.479728] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=5 outputs=1 worker2 # [ 172.523074] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:24Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 172.496262] nix-daemon[847]: reaped child process 1920, status = succeeded worker2 # [ 172.533873] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:24Z level=debug event=want client=2 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 172.530441] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 172.542780] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 172.554483] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 172.562683] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 172.663978] nix-daemon[847]: accepted connection from pid 1945, user nix-grpc-daemon (trusted) worker1 # [ 172.676269] nix-daemon[847]: reaped child process 1948, status = succeeded lb # [ 172.722256] niks3-server[1185]: 2026/09/23 04:44:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.692448] nix-grpc-daemon[1820]: time=2026-09-23T04:44:23.944Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.693897] nix-grpc-daemon[1820]: time=2026-09-23T04:44:23.945Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 172.754349] niks3-server[1185]: 2026/09/23 04:44:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign worker1 # [ 172.722728] nix-grpc-daemon[1820]: time=2026-09-23T04:44:23.974Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.760552] niks3-server[1185]: 2026/09/23 04:44:24 INFO Signed narinfos id=72 count=1 lb # [ 172.768920] niks3-server[1185]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 172.783660] niks3-server[1185]: 2026/09/23 04:44:24 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 172.791923] niks3-server[1185]: 2026/09/23 04:44:24 INFO Completed upload id=72 worker1 # [ 172.754432] nix-grpc-daemon[1820]: time=2026-09-23T04:44:24.005Z level=INFO msg="Upload complete. (178ms)" lb # [ 172.795335] niks3-server[1185]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls worker1 # [ 172.758354] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 172.800290] niks3-server[1185]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 172.765683] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 172.775789] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 172.778212] nix-daemon[847]: reaped child process 1943, status = succeeded worker1 # [ 172.783464] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 174.218521] nix-daemon[847]: reaped child process 1952, status = succeeded worker1 # [ 174.305333] nix-daemon[847]: accepted connection from pid 1968, user nix-grpc-daemon (trusted) worker1 # [ 174.317878] nix-daemon[847]: reaped child process 1971, status = succeeded lb # [ 174.365709] niks3-server[1185]: 2026/09/23 04:44:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.335494] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.586Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 174.337096] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.588Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 174.407755] niks3-server[1185]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 174.416268] niks3-server[1185]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 174.424211] niks3-server[1185]: 2026/09/23 04:44:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign worker1 # [ 174.393607] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.644Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.430131] niks3-server[1185]: 2026/09/23 04:44:26 INFO Signed narinfos id=73 count=1 lb # [ 174.436451] niks3-server[1185]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 174.446457] niks3-server[1185]: 2026/09/23 04:44:26 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 174.449486] niks3-server[1185]: 2026/09/23 04:44:26 INFO Completed upload id=73 worker1 # [ 174.412452] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.663Z level=INFO msg="Upload complete. (219ms)" lb # [ 174.452365] niks3-server[1185]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 174.418909] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=6 outputs=1 worker2 # [ 174.458877] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:26Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 174.469382] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:26Z level=debug event=want client=2 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 174.433551] nix-daemon[847]: reaped child process 1950, status = succeeded worker1 # [ 174.471271] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 174.483471] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 174.494873] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 174.502993] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 174.603219] nix-daemon[847]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker1 # [ 174.616702] nix-daemon[847]: reaped child process 1978, status = succeeded lb # [ 174.661576] niks3-server[1185]: 2026/09/23 04:44:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.632654] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.884Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 174.634221] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.885Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 174.692231] niks3-server[1185]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 174.699237] niks3-server[1185]: 2026/09/23 04:44:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 174.703549] niks3-server[1185]: 2026/09/23 04:44:26 INFO Signed narinfos id=74 count=1 worker1 # [ 174.669176] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.920Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.718778] niks3-server[1185]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 174.728521] niks3-server[1185]: 2026/09/23 04:44:26 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 174.734705] niks3-server[1185]: 2026/09/23 04:44:26 INFO Completed upload id=74 worker1 # [ 174.697526] nix-grpc-daemon[1820]: time=2026-09-23T04:44:25.949Z level=INFO msg="Upload complete. (181ms)" lb # [ 174.737813] niks3-server[1185]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 174.701262] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 174.705847] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 174.714698] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 174.723594] nix-daemon[847]: reaped child process 1973, status = succeeded worker1 # [ 174.728307] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 175.742280] nix-daemon[847]: reaped child process 1982, status = succeeded worker1 # [ 175.818520] nix-daemon[847]: accepted connection from pid 1998, user nix-grpc-daemon (trusted) worker1 # [ 175.831873] nix-daemon[847]: reaped child process 2001, status = succeeded lb # [ 175.877644] niks3-server[1185]: 2026/09/23 04:44:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 175.850293] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.100Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 175.851661] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.100Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 175.923153] niks3-server[1185]: 2026/09/23 04:44:27 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 175.929938] niks3-server[1185]: 2026/09/23 04:44:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 175.938364] niks3-server[1185]: 2026/09/23 04:44:27 INFO Signed narinfos id=75 count=1 worker1 # [ 175.904634] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.156Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.946522] niks3-server[1185]: 2026/09/23 04:44:27 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 175.951179] niks3-server[1185]: 2026/09/23 04:44:27 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 175.961084] niks3-server[1185]: 2026/09/23 04:44:27 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 175.965932] niks3-server[1185]: 2026/09/23 04:44:27 INFO Completed upload id=75 worker1 # [ 175.928723] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.180Z level=INFO msg="Upload complete. (193ms)" lb # [ 175.967680] niks3-server[1185]: 2026/09/23 04:44:27 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 175.934863] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=7 outputs=1 worker2 # [ 175.975713] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:28Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 175.943774] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker2 # [ 175.985948] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:28Z level=debug event=want client=2 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 175.954507] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 175.960393] nix-daemon[847]: reaped child process 1980, status = succeeded worker1 # [ 175.965790] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.217Z level=INFO msg="All 1 paths already cached" worker1 # [ 175.972192] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 175.979961] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 176.064296] nix-daemon[847]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker1 # [ 176.078595] nix-daemon[847]: reaped child process 2008, status = succeeded lb # [ 176.121566] niks3-server[1185]: 2026/09/23 04:44:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.092487] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.344Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 176.094461] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.345Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 176.151369] niks3-server[1185]: 2026/09/23 04:44:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign lb # [ 176.158342] niks3-server[1185]: 2026/09/23 04:44:28 INFO Signed narinfos id=76 count=1 worker1 # [ 176.124377] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.375Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.168134] niks3-server[1185]: 2026/09/23 04:44:28 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 176.173182] niks3-server[1185]: 2026/09/23 04:44:28 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 176.185114] niks3-server[1185]: 2026/09/23 04:44:28 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 176.190692] niks3-server[1185]: 2026/09/23 04:44:28 INFO Completed upload id=76 worker1 # [ 176.153564] nix-grpc-daemon[1820]: time=2026-09-23T04:44:27.405Z level=INFO msg="Upload complete. (168ms)" lb # [ 176.193158] niks3-server[1185]: 2026/09/23 04:44:28 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 176.158093] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 176.164197] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 176.172729] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 176.180204] nix-daemon[847]: reaped child process 2003, status = succeeded worker1 # [ 176.185331] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 177.223424] nix-daemon[847]: reaped child process 2012, status = succeeded worker1 # [ 177.306668] nix-daemon[847]: accepted connection from pid 2028, user nix-grpc-daemon (trusted) worker1 # [ 177.319525] nix-daemon[847]: reaped child process 2031, status = succeeded lb # [ 177.365829] niks3-server[1185]: 2026/09/23 04:44:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 177.339776] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.591Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 177.341348] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.592Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 177.405803] niks3-server[1185]: 2026/09/23 04:44:29 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 177.414722] envoy[926]: conn peer=[2001:db8:1::1]:51070 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9591 tx=5163 ms=4920 lb # [ 177.420871] niks3-server[1185]: 2026/09/23 04:44:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 177.426514] niks3-server[1185]: 2026/09/23 04:44:29 INFO Signed narinfos id=77 count=1 worker1 # [ 177.391845] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.643Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.433970] niks3-server[1185]: 2026/09/23 04:44:29 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 177.439950] niks3-server[1185]: 2026/09/23 04:44:29 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 177.446847] niks3-server[1185]: 2026/09/23 04:44:29 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 177.451556] niks3-server[1185]: 2026/09/23 04:44:29 INFO Completed upload id=77 worker1 # [ 177.414322] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.665Z level=INFO msg="Upload complete. (222ms)" lb # [ 177.453593] niks3-server[1185]: 2026/09/23 04:44:29 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 177.420870] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=8 outputs=1 worker2 # [ 177.461586] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:29Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 177.430148] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker2 # [ 177.471699] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:29Z level=debug event=want client=2 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 177.442533] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 177.449516] nix-daemon[847]: reaped child process 2010, status = succeeded worker1 # [ 177.452232] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.703Z level=INFO msg="All 1 paths already cached" worker1 # [ 177.458222] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 177.466495] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 177.551769] nix-daemon[847]: accepted connection from pid 2035, user nix-grpc-daemon (trusted) worker1 # [ 177.565796] nix-daemon[847]: reaped child process 2038, status = succeeded lb # [ 177.608645] niks3-server[1185]: 2026/09/23 04:44:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 177.579408] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.830Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 177.580846] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.832Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 177.640593] niks3-server[1185]: 2026/09/23 04:44:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign worker1 # [ 177.609525] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.860Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.646484] niks3-server[1185]: 2026/09/23 04:44:29 INFO Signed narinfos id=78 count=1 lb # [ 177.653925] niks3-server[1185]: 2026/09/23 04:44:29 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 177.666138] niks3-server[1185]: 2026/09/23 04:44:29 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 177.672946] niks3-server[1185]: 2026/09/23 04:44:29 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete lb # [ 177.678978] niks3-server[1185]: 2026/09/23 04:44:29 INFO Completed upload id=78 worker1 # [ 177.641958] nix-grpc-daemon[1820]: time=2026-09-23T04:44:28.893Z level=INFO msg="Upload complete. (170ms)" lb # [ 177.681787] niks3-server[1185]: 2026/09/23 04:44:29 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 177.645984] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 177.650929] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 177.658550] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 177.667256] nix-daemon[847]: reaped child process 2033, status = succeeded worker1 # [ 177.672254] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 178.914714] nix-daemon[847]: reaped child process 2042, status = succeeded worker1 # [ 178.989770] nix-daemon[847]: accepted connection from pid 2058, user nix-grpc-daemon (trusted) worker1 # [ 179.002548] nix-daemon[847]: reaped child process 2061, status = succeeded lb # [ 179.049528] niks3-server[1185]: 2026/09/23 04:44:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.019167] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.270Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 179.020877] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.272Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 179.092252] niks3-server[1185]: 2026/09/23 04:44:31 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 179.099271] niks3-server[1185]: 2026/09/23 04:44:31 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 179.105514] niks3-server[1185]: 2026/09/23 04:44:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign worker1 # [ 179.074207] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.325Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.111443] niks3-server[1185]: 2026/09/23 04:44:31 INFO Signed narinfos id=79 count=1 lb # [ 179.117662] niks3-server[1185]: 2026/09/23 04:44:31 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 179.125093] niks3-server[1185]: 2026/09/23 04:44:31 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 179.127971] niks3-server[1185]: 2026/09/23 04:44:31 INFO Completed upload id=79 worker1 # [ 179.090690] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.342Z level=INFO msg="Upload complete. (210ms)" lb # [ 179.130614] niks3-server[1185]: 2026/09/23 04:44:31 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker2 # [ 179.137680] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:31Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 179.096921] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=9 outputs=1 worker1 # [ 179.107474] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker2 # [ 179.148352] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:31Z level=debug event=want client=2 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 179.116716] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 179.125324] nix-daemon[847]: reaped child process 2040, status = succeeded worker1 # [ 179.127267] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.378Z level=INFO msg="All 1 paths already cached" worker1 # [ 179.131378] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 179.136196] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 179.222354] nix-daemon[847]: accepted connection from pid 2065, user nix-grpc-daemon (trusted) worker1 # [ 179.236221] nix-daemon[847]: reaped child process 2068, status = succeeded lb # [ 179.280465] niks3-server[1185]: 2026/09/23 04:44:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.251388] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.502Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 179.253656] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.504Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 179.314445] niks3-server[1185]: 2026/09/23 04:44:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign worker1 # [ 179.281972] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.533Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.320622] niks3-server[1185]: 2026/09/23 04:44:31 INFO Signed narinfos id=80 count=1 lb # [ 179.326979] niks3-server[1185]: 2026/09/23 04:44:31 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 179.331602] niks3-server[1185]: 2026/09/23 04:44:31 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 179.345130] niks3-server[1185]: 2026/09/23 04:44:31 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 179.349978] niks3-server[1185]: 2026/09/23 04:44:31 INFO Completed upload id=80 worker1 # [ 179.314797] nix-grpc-daemon[1820]: time=2026-09-23T04:44:30.566Z level=INFO msg="Upload complete. (173ms)" lb # [ 179.356093] niks3-server[1185]: 2026/09/23 04:44:31 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 179.319172] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 179.323935] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 179.335375] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 179.340771] nix-daemon[847]: reaped child process 2063, status = succeeded worker1 # [ 179.343692] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 180.783947] nix-daemon[847]: reaped child process 2072, status = succeeded worker1 # [ 180.867471] nix-daemon[847]: accepted connection from pid 2088, user nix-grpc-daemon (trusted) worker1 # [ 180.878678] nix-daemon[847]: reaped child process 2091, status = succeeded lb # [ 180.925379] niks3-server[1185]: 2026/09/23 04:44:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 180.896917] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.148Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 180.898593] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.150Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 180.969089] niks3-server[1185]: 2026/09/23 04:44:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 180.975343] niks3-server[1185]: 2026/09/23 04:44:32 INFO Signed narinfos id=81 count=1 worker1 # [ 180.940993] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.192Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.980749] niks3-server[1185]: 2026/09/23 04:44:32 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 180.988932] niks3-server[1185]: 2026/09/23 04:44:32 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 180.997053] niks3-server[1185]: 2026/09/23 04:44:33 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 181.005251] niks3-server[1185]: 2026/09/23 04:44:33 INFO Completed upload id=81 worker1 # [ 180.967837] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.219Z level=INFO msg="Upload complete. (215ms)" lb # [ 181.007575] niks3-server[1185]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 181.010654] niks3-server[1185]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 180.973786] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=10 outputs=1 worker2 # [ 181.017721] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:33Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 180.983445] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker2 # [ 181.026849] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:33Z level=debug event=want client=2 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 180.993372] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 181.002173] nix-daemon[847]: reaped child process 2070, status = succeeded worker1 # [ 181.004331] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.255Z level=INFO msg="All 2 paths already cached" worker1 # [ 181.009027] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 181.014391] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 181.098075] nix-daemon[847]: accepted connection from pid 2095, user nix-grpc-daemon (trusted) worker1 # [ 181.112163] nix-daemon[847]: reaped child process 2098, status = succeeded lb # [ 181.157335] niks3-server[1185]: 2026/09/23 04:44:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 181.128317] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.379Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 181.130236] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.381Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 181.187352] niks3-server[1185]: 2026/09/23 04:44:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign worker1 # [ 181.160170] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.411Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.198410] niks3-server[1185]: 2026/09/23 04:44:33 INFO Signed narinfos id=82 count=1 lb # [ 181.204612] niks3-server[1185]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 181.210052] niks3-server[1185]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 181.222073] niks3-server[1185]: 2026/09/23 04:44:33 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 181.227839] niks3-server[1185]: 2026/09/23 04:44:33 INFO Completed upload id=82 worker1 # [ 181.190576] nix-grpc-daemon[1820]: time=2026-09-23T04:44:32.442Z level=INFO msg="Upload complete. (171ms)" lb # [ 181.231425] niks3-server[1185]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 181.193066] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 181.198326] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 181.210245] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 181.213391] nix-daemon[847]: reaped child process 2093, status = succeeded worker1 # [ 181.219356] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 182.033099] nix-daemon[847]: reaped child process 2102, status = succeeded worker1 # [ 182.109324] nix-daemon[847]: accepted connection from pid 2118, user nix-grpc-daemon (trusted) worker1 # [ 182.124320] nix-daemon[847]: reaped child process 2121, status = succeeded lb # [ 182.168431] niks3-server[1185]: 2026/09/23 04:44:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.139499] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.390Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 182.141044] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.392Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 182.212102] niks3-server[1185]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 182.216568] niks3-server[1185]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 182.224402] niks3-server[1185]: 2026/09/23 04:44:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign worker1 # [ 182.192281] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.443Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.229548] niks3-server[1185]: 2026/09/23 04:44:34 INFO Signed narinfos id=83 count=1 lb # [ 182.233661] niks3-server[1185]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 182.242876] niks3-server[1185]: 2026/09/23 04:44:34 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 182.245571] niks3-server[1185]: 2026/09/23 04:44:34 INFO Completed upload id=83 lb # [ 182.248548] niks3-server[1185]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 182.209748] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.461Z level=INFO msg="Upload complete. (184ms)" worker1 # [ 182.215988] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=11 outputs=1 worker2 # [ 182.256664] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:34Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 182.229922] nix-daemon[847]: reaped child process 2100, status = succeeded worker1 # [ 182.268410] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 182.280966] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 182.294544] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.545Z level=INFO msg="All 2 paths already cached" worker1 # [ 182.302967] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 182.311289] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 182.408910] nix-daemon[847]: accepted connection from pid 2125, user nix-grpc-daemon (trusted) worker1 # [ 182.421503] nix-daemon[847]: reaped child process 2128, status = succeeded lb # [ 182.467722] niks3-server[1185]: 2026/09/23 04:44:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.438853] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.690Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 182.440820] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.691Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 182.500150] niks3-server[1185]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 182.503663] niks3-server[1185]: 2026/09/23 04:44:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign lb # [ 182.509260] niks3-server[1185]: 2026/09/23 04:44:34 INFO Signed narinfos id=84 count=1 worker1 # [ 182.474947] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.726Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.522292] niks3-server[1185]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 182.529218] niks3-server[1185]: 2026/09/23 04:44:34 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete worker1 # [ 182.497309] nix-grpc-daemon[1820]: time=2026-09-23T04:44:33.748Z level=INFO msg="Upload complete. (172ms)" lb # [ 182.534726] niks3-server[1185]: 2026/09/23 04:44:34 INFO Completed upload id=84 worker1 # [ 182.500652] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 182.542134] niks3-server[1185]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 182.506213] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 182.514770] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 182.524123] nix-daemon[847]: reaped child process 2123, status = succeeded worker1 # [ 182.527826] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 183.967241] nix-daemon[847]: reaped child process 2132, status = succeeded worker1 # [ 184.051309] nix-daemon[847]: accepted connection from pid 2148, user nix-grpc-daemon (trusted) worker1 # [ 184.063404] nix-daemon[847]: reaped child process 2151, status = succeeded lb # [ 184.108835] niks3-server[1185]: 2026/09/23 04:44:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 184.084282] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.335Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 184.086032] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.337Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 184.154179] niks3-server[1185]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 184.161361] niks3-server[1185]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 184.167637] niks3-server[1185]: 2026/09/23 04:44:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign lb # [ 184.171493] niks3-server[1185]: 2026/09/23 04:44:36 INFO Signed narinfos id=85 count=1 worker1 # [ 184.134351] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.385Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.177516] niks3-server[1185]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 184.182355] niks3-server[1185]: 2026/09/23 04:44:36 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 184.186626] niks3-server[1185]: 2026/09/23 04:44:36 INFO Completed upload id=85 worker1 # [ 184.149204] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.400Z level=INFO msg="Upload complete. (213ms)" lb # [ 184.188546] niks3-server[1185]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 184.155069] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=12 outputs=1 worker2 # [ 184.195556] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:36Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 184.169759] nix-daemon[847]: reaped child process 2130, status = succeeded worker1 # [ 184.206875] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 184.218856] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 184.231431] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.482Z level=INFO msg="All 2 paths already cached" worker1 # [ 184.239260] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 184.249179] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 184.344681] nix-daemon[847]: accepted connection from pid 2155, user nix-grpc-daemon (trusted) worker1 # [ 184.358293] nix-daemon[847]: reaped child process 2158, status = succeeded lb # [ 184.402303] niks3-server[1185]: 2026/09/23 04:44:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 184.373559] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.625Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 184.375047] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.626Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 184.437417] niks3-server[1185]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 184.444129] niks3-server[1185]: 2026/09/23 04:44:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/86/sign lb # [ 184.447988] niks3-server[1185]: 2026/09/23 04:44:36 INFO Signed narinfos id=86 count=1 worker1 # [ 184.413175] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.664Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.454157] niks3-server[1185]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 184.462881] niks3-server[1185]: 2026/09/23 04:44:36 INFO Received complete upload request method=POST path=/api/pending_closures/86/complete lb # [ 184.466217] niks3-server[1185]: 2026/09/23 04:44:36 INFO Completed upload id=86 worker1 # [ 184.428919] nix-grpc-daemon[1820]: time=2026-09-23T04:44:35.680Z level=INFO msg="Upload complete. (168ms)" lb # [ 184.469060] niks3-server[1185]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 184.432240] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 184.437129] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 worker1 # [ 184.446370] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 184.451749] nix-daemon[847]: reaped child process 2153, status = succeeded worker1 # [ 184.456446] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 185.271162] nix-daemon[847]: reaped child process 2162, status = succeeded worker1 # [ 185.347076] nix-daemon[847]: accepted connection from pid 2178, user nix-grpc-daemon (trusted) worker1 # [ 185.360330] nix-daemon[847]: reaped child process 2181, status = succeeded lb # [ 185.405665] niks3-server[1185]: 2026/09/23 04:44:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 185.377215] nix-grpc-daemon[1820]: time=2026-09-23T04:44:36.628Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 185.378947] nix-grpc-daemon[1820]: time=2026-09-23T04:44:36.630Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 185.446796] niks3-server[1185]: 2026/09/23 04:44:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/87/sign lb # [ 185.454581] niks3-server[1185]: 2026/09/23 04:44:37 INFO Signed narinfos id=87 count=1 worker1 # [ 185.420202] nix-grpc-daemon[1820]: time=2026-09-23T04:44:36.671Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.459228] niks3-server[1185]: 2026/09/23 04:44:37 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 185.465144] niks3-server[1185]: 2026/09/23 04:44:37 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 185.469537] niks3-server[1185]: 2026/09/23 04:44:37 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 185.475974] niks3-server[1185]: 2026/09/23 04:44:37 INFO Received complete upload request method=POST path=/api/pending_closures/87/complete lb # [ 185.479566] niks3-server[1185]: 2026/09/23 04:44:37 INFO Completed upload id=87 lb # [ 185.481935] niks3-server[1185]: 2026/09/23 04:44:37 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 185.443936] nix-grpc-daemon[1820]: time=2026-09-23T04:44:36.695Z level=INFO msg="Upload complete. (180ms)" worker1 # [ 185.450347] nix-grpc-daemon[1759]: ts=2026-09-23T04:44:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55032 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=13 outputs=1 worker1 # [ 185.462598] nix-daemon[847]: reaped child process 2160, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 14.76 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 185.610953] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 8ebd390a9e1e450da0ae6f48f597a14b client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client # [ 185.750468] nix[1582]: don't know how to build these paths: client # [ 185.751413] nix[1582]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 185.759922] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 185.765638] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 client # [ 185.776871] nix[1582]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker worker2 # [ 185.786725] nix-grpc-daemon[1606]: ts=2026-09-23T04:44:37Z level=debug event=want client=3 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 187.413635] envoy[926]: conn peer=[2001:db8:1::1]:51080 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27146 tx=12321 ms=14583 client # [ 215.779597] nix[1582]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 215.787841] nix[1582]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 215.820355] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 215.824340] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 215.829187] systemd[1]: gpu.service: Consumed 147ms CPU time over 30.213s wall clock time, 35.6M memory peak, 5.6K incoming IP traffic, 5.2K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.48 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.72 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill lb # [ 217.416992] envoy[926]: conn peer=[2001:db8:1::1]:56886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=929 tx=596 ms=30053 worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.01 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 218.215986] nix-grpc-daemon[1759]: ts=2026-09-23T04:45:09Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 worker1 # [ 218.694681] nix-grpc-daemon[1759]: ts=2026-09-23T04:45:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55032 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 218.744556] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 218.766841] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:10Z level=debug event=want client=4 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 218.772842] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:10Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 218.812171] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 218.825715] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 218.839338] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 218.851111] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 218.949934] nix-daemon[874]: accepted connection from pid 1986, user nix-grpc-daemon (trusted) worker2 # [ 218.963654] nix-daemon[874]: reaped child process 1989, status = succeeded lb # [ 218.970448] niks3-server[1185]: 2026/09/23 04:45:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 218.982262] nix-grpc-daemon[1699]: time=2026-09-23T04:45:11.066Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 218.984534] nix-grpc-daemon[1699]: time=2026-09-23T04:45:11.068Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 219.006587] niks3-server[1185]: 2026/09/23 04:45:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/88/sign worker2 # [ 219.018052] nix-grpc-daemon[1699]: time=2026-09-23T04:45:11.102Z level=INFO msg="Uploading 1 narinfos" lb # [ 219.015945] niks3-server[1185]: 2026/09/23 04:45:11 INFO Signed narinfos id=88 count=1 lb # [ 219.025410] niks3-server[1185]: 2026/09/23 04:45:11 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 219.029251] niks3-server[1185]: 2026/09/23 04:45:11 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 219.041300] niks3-server[1185]: 2026/09/23 04:45:11 INFO Received complete upload request method=POST path=/api/pending_closures/88/complete lb # [ 219.044144] niks3-server[1185]: 2026/09/23 04:45:11 INFO Completed upload id=88 worker2 # [ 219.046209] nix-grpc-daemon[1699]: time=2026-09-23T04:45:11.130Z level=INFO msg="Upload complete. (182ms)" lb # [ 219.046962] niks3-server[1185]: 2026/09/23 04:45:11 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 219.050677] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 219.056306] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 219.067588] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 219.071799] nix-daemon[874]: reaped child process 1984, status = succeeded worker2 # [ 219.076625] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 220.093267] nix-daemon[874]: reaped child process 1993, status = succeeded worker2 # [ 220.170827] nix-daemon[874]: accepted connection from pid 2009, user nix-grpc-daemon (trusted) worker2 # [ 220.183031] nix-daemon[874]: reaped child process 2012, status = succeeded lb # [ 220.189930] niks3-server[1185]: 2026/09/23 04:45:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 220.207371] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.291Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 220.209240] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.293Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 220.240314] niks3-server[1185]: 2026/09/23 04:45:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/89/sign lb # [ 220.245799] niks3-server[1185]: 2026/09/23 04:45:12 INFO Signed narinfos id=89 count=1 worker2 # [ 220.253535] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.337Z level=INFO msg="Uploading 1 narinfos" lb # [ 220.252502] niks3-server[1185]: 2026/09/23 04:45:12 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 220.256787] niks3-server[1185]: 2026/09/23 04:45:12 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 220.263196] niks3-server[1185]: 2026/09/23 04:45:12 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 220.268927] niks3-server[1185]: 2026/09/23 04:45:12 INFO Received complete upload request method=POST path=/api/pending_closures/89/complete lb # [ 220.273258] niks3-server[1185]: 2026/09/23 04:45:12 INFO Completed upload id=89 worker2 # [ 220.275108] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.359Z level=INFO msg="Upload complete. (191ms)" lb # [ 220.275151] niks3-server[1185]: 2026/09/23 04:45:12 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 220.282490] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=14 outputs=1 worker2 # [ 220.294975] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=debug event=want client=4 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 220.299205] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 220.309211] nix-daemon[874]: reaped child process 1991, status = succeeded worker2 # [ 220.338548] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 220.351657] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 220.366263] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.450Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 220.375358] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 220.385785] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 220.484454] nix-daemon[874]: accepted connection from pid 2018, user nix-grpc-daemon (trusted) worker2 # [ 220.498636] nix-daemon[874]: reaped child process 2021, status = succeeded lb # [ 220.503160] niks3-server[1185]: 2026/09/23 04:45:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 220.513845] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.598Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 220.515789] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.599Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 220.533225] niks3-server[1185]: 2026/09/23 04:45:12 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 220.540434] niks3-server[1185]: 2026/09/23 04:45:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/90/sign lb # [ 220.547269] niks3-server[1185]: 2026/09/23 04:45:12 INFO Signed narinfos id=90 count=1 worker2 # [ 220.552100] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.636Z level=INFO msg="Uploading 1 narinfos" lb # [ 220.555303] niks3-server[1185]: 2026/09/23 04:45:12 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 220.567949] niks3-server[1185]: 2026/09/23 04:45:12 INFO Received complete upload request method=POST path=/api/pending_closures/90/complete lb # [ 220.573312] niks3-server[1185]: 2026/09/23 04:45:12 INFO Completed upload id=90 worker2 # [ 220.575325] nix-grpc-daemon[1699]: time=2026-09-23T04:45:12.659Z level=INFO msg="Upload complete. (176ms)" lb # [ 220.577800] niks3-server[1185]: 2026/09/23 04:45:12 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 220.579947] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 220.586453] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 220.596714] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 220.605970] nix-daemon[874]: reaped child process 2016, status = succeeded worker2 # [ 220.610213] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 221.438551] nix-daemon[874]: reaped child process 2025, status = succeeded worker2 # [ 221.511677] nix-daemon[874]: accepted connection from pid 2041, user nix-grpc-daemon (trusted) worker2 # [ 221.525350] nix-daemon[874]: reaped child process 2044, status = succeeded lb # [ 221.531376] niks3-server[1185]: 2026/09/23 04:45:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 221.541942] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 221.544058] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.628Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 221.576075] niks3-server[1185]: 2026/09/23 04:45:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/91/sign worker2 # [ 221.583752] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.668Z level=INFO msg="Uploading 1 narinfos" lb # [ 221.582200] niks3-server[1185]: 2026/09/23 04:45:13 INFO Signed narinfos id=91 count=1 lb # [ 221.593604] niks3-server[1185]: 2026/09/23 04:45:13 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 221.597985] niks3-server[1185]: 2026/09/23 04:45:13 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 221.602397] niks3-server[1185]: 2026/09/23 04:45:13 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 221.611952] niks3-server[1185]: 2026/09/23 04:45:13 INFO Received complete upload request method=POST path=/api/pending_closures/91/complete lb # [ 221.616347] niks3-server[1185]: 2026/09/23 04:45:13 INFO Completed upload id=91 worker2 # [ 221.618512] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.702Z level=INFO msg="Upload complete. (201ms)" lb # [ 221.619181] niks3-server[1185]: 2026/09/23 04:45:13 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 221.625618] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=15 outputs=1 worker2 # [ 221.638623] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:13Z level=debug event=want client=4 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 221.642493] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:13Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 221.652726] nix-daemon[874]: reaped child process 2023, status = succeeded worker2 # [ 221.682235] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 221.695124] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 221.709305] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.793Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 221.720593] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 221.731178] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 221.829562] nix-daemon[874]: accepted connection from pid 2050, user nix-grpc-daemon (trusted) worker2 # [ 221.844117] nix-daemon[874]: reaped child process 2053, status = succeeded lb # [ 221.849075] niks3-server[1185]: 2026/09/23 04:45:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 221.859508] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.943Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 221.861026] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.945Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 221.883920] niks3-server[1185]: 2026/09/23 04:45:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/92/sign worker2 # [ 221.895519] nix-grpc-daemon[1699]: time=2026-09-23T04:45:13.979Z level=INFO msg="Uploading 1 narinfos" lb # [ 221.894254] niks3-server[1185]: 2026/09/23 04:45:13 INFO Signed narinfos id=92 count=1 lb # [ 221.898924] niks3-server[1185]: 2026/09/23 04:45:13 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 221.903636] niks3-server[1185]: 2026/09/23 04:45:13 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 221.915483] niks3-server[1185]: 2026/09/23 04:45:13 INFO Received complete upload request method=POST path=/api/pending_closures/92/complete lb # [ 221.921835] niks3-server[1185]: 2026/09/23 04:45:13 INFO Completed upload id=92 worker2 # [ 221.923056] nix-grpc-daemon[1699]: time=2026-09-23T04:45:14.007Z level=INFO msg="Upload complete. (180ms)" lb # [ 221.926714] niks3-server[1185]: 2026/09/23 04:45:13 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 221.927631] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 221.934315] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 worker2 # [ 221.947198] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker2 # [ 221.951827] nix-daemon[874]: reaped child process 2048, status = succeeded worker2 # [ 221.957194] nix-daemon[874]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 222.803801] nix-daemon[874]: reaped child process 2057, status = succeeded worker2 # [ 222.885094] nix-daemon[874]: accepted connection from pid 2074, user nix-grpc-daemon (trusted) worker2 # [ 222.899102] nix-daemon[874]: reaped child process 2077, status = succeeded lb # [ 222.903281] niks3-server[1185]: 2026/09/23 04:45:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 222.914779] nix-grpc-daemon[1699]: time=2026-09-23T04:45:14.999Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 222.917722] nix-grpc-daemon[1699]: time=2026-09-23T04:45:15.000Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 222.945554] niks3-server[1185]: 2026/09/23 04:45:14 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 222.951122] niks3-server[1185]: 2026/09/23 04:45:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/93/sign worker2 # [ 222.958553] nix-grpc-daemon[1699]: time=2026-09-23T04:45:15.042Z level=INFO msg="Uploading 1 narinfos" lb # [ 222.956316] niks3-server[1185]: 2026/09/23 04:45:14 INFO Signed narinfos id=93 count=1 lb # [ 222.963465] niks3-server[1185]: 2026/09/23 04:45:14 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 222.974149] niks3-server[1185]: 2026/09/23 04:45:14 INFO Received complete upload request method=POST path=/api/pending_closures/93/complete lb # [ 222.976376] niks3-server[1185]: 2026/09/23 04:45:14 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 222.980456] niks3-server[1185]: 2026/09/23 04:45:14 INFO Completed upload id=93 worker2 # [ 222.982267] nix-grpc-daemon[1699]: time=2026-09-23T04:45:15.066Z level=INFO msg="Upload complete. (216ms)" lb # [ 222.982964] niks3-server[1185]: 2026/09/23 04:45:14 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 222.989944] nix-grpc-daemon[1606]: ts=2026-09-23T04:45:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58736 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=16 outputs=1 worker2 # [ 223.005099] nix-daemon[874]: reaped child process 2055, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 4.45 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.12 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 224.218509] nix-grpc-daemon[1759]: ts=2026-09-23T04:45:15Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 7.90 seconds) (finished: run the VM test script, in 225.38 seconds) test script finished in 225.56s cleanup kill QemuMachine (pid 50) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 49) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T04:45:17Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-23T04:45:18Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T04:45:18Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T04:45:18Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.05 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh