tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2: QEMU running (pid 52) worker2 # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.2fOtyxRwgL', fmt=raw size=1073741824 worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) worker1 # Formatting '/build/vm-state-worker1/tmp.kTQ0W1BM0I', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 49) worker1 # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: c28dc7c7-33bd-4c82-abcb-54de9793e181 lb # Formatting '/build/vm-state-lb/tmp.oF03DsbxCP', fmt=raw size=1073741824 worker1 # Filesystem UUID: 2c76696f-d741-40ba-8b57-9f4ab0085c74 worker2 # Superblock backups stored on blocks: lb # mke2fs 1.47.4 (6-Mar-2025) worker1 # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 lb # Discarding device blocks: 0/262144 done worker1 # 32768, 98304, 163840, 229376 worker2 # lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # worker2 # Allocating group tables: 0/8 done lb # Filesystem UUID: f0540d8d-dc46-40b7-b3f7-f6f93ed7ab34 worker1 # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done lb # Superblock backups stored on blocks: worker1 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done lb # 32768, 98304, 163840, 229376 worker1 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # lb # Allocating group tables: 0/8 done worker1 # worker2 # Virtualisation disk image created. lb # Writing inode tables: 0/8 done worker1 # Virtualisation disk image created. client # Disk image does not exist, creating the virtualisation disk image... lb # Creating journal (8192 blocks): done client # Formatting '/build/vm-state-client/tmp.kCFLYdbFRY', fmt=raw size=1073741824 client: QEMU running (pid 50) client # mke2fs 1.47.4 (6-Mar-2025) lb # Writing superblocks and filesystem accounting information: 0/8 done client # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes (finished: start all VMs, in 0.20 seconds) client # Filesystem UUID: 0b5df678-f7c4-4cdd-9397-56990a5593ac client: waiting for unit network-addresses-eth1.service lb # client: waiting for the VM to finish booting lb # Virtualisation disk image created. client # Superblock backups stored on blocks: client # 32768, 98304, 163840, 229376 client # client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done client # client # Virtualisation disk image created. lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # client # lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)... lb # lb # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker1 # worker1 # worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker2 # worker2 # worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:08.0)... client # client # worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker1 # worker1 # lb # Booting from ROM... worker2 # Booting from ROM... client # Booting from ROM... worker1 # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j1nn9bbhrn5xz154akfhw453f8i07i4d-nixos-system-lb-test/init regInfo=/nix/store/hq8v7nws787a9kwd3h009z1n9dqal4fl-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test/init regInfo=/nix/store/8qcbhkhv67h7qfb5lww8vbzpf1w4p6d9-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/97sck759bskxrmqr38axr5kzb0p084pz-nixos-system-worker2-test/init regInfo=/nix/store/dfij3l6x15yx3kznbya019zn219wy845-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] kvm-clock: using sched offset of 475946022 cycles client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000004] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.002731] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pj67bngsjx4svw66my9vshw84i37agz7-nixos-system-worker1-test/init regInfo=/nix/store/j1ik3n9mca5rj6xyz1di0lygynxpmyha-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.002742] Using GB pages for direct mapping worker1 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.002845] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.002853] ACPI: Early table checksum verification disabled client # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.002856] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.002860] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.002864] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.002872] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.002874] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] kvm-clock: using sched offset of 471492823 cycles lb # [ 0.002875] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] kvm-clock: using sched offset of 472421457 cycles client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.002877] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.002878] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002880] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.002881] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.002742] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.002882] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.002752] Using GB pages for direct mapping worker2 # [ 0.002751] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.002883] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002871] RAMDISK: [mem 0x5e366000-0x5ffcffff] worker2 # [ 0.002762] Using GB pages for direct mapping worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002883] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002878] ACPI: Early table checksum verification disabled worker2 # [ 0.002889] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002880] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002898] ACPI: Early table checksum verification disabled lb # [ 0.002883] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.000000] kvm-clock: using sched offset of 490673306 cycles worker2 # [ 0.002901] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.002884] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.002884] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.002905] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002884] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.002888] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.003106] No NUMA configuration found worker1 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002909] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003107] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002894] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002896] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.003109] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.002916] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005350] Zone ranges: worker2 # [ 0.002918] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002898] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005351] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.002920] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005352] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.002899] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002745] Using GB pages for direct mapping lb # [ 0.005353] Normal empty lb # [ 0.005354] Device empty worker1 # [ 0.002830] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker2 # [ 0.002921] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005355] Movable zone start for each node client # [ 0.002901] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002838] ACPI: Early table checksum verification disabled lb # [ 0.005355] Early memory node ranges worker2 # [ 0.002923] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002902] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002840] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.005356] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.002925] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002904] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.005357] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.002844] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002926] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.002905] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.005358] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.002848] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002927] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.005378] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.002905] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002855] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005640] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002927] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002906] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.002857] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.031659] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.002906] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002928] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.032112] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.002858] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.032122] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.002907] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.002928] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.002860] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.032148] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.002907] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002929] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.003127] No NUMA configuration found lb # [ 0.032151] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.002861] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002929] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.003128] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.003153] No NUMA configuration found lb # [ 0.032152] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.002863] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003130] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.003154] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.032153] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.005340] Zone ranges: worker1 # [ 0.002864] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.003156] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.005340] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.032154] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.005588] Zone ranges: worker1 # [ 0.002865] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.005342] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.032155] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.005589] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.005343] Normal empty worker1 # [ 0.002866] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.005344] Device empty lb # [ 0.032157] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.005591] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.005344] Movable zone start for each node worker2 # [ 0.005600] Normal empty worker1 # [ 0.002866] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.032158] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.005600] Device empty client # [ 0.005345] Early memory node ranges lb # [ 0.032161] TSC deadline timer available worker2 # [ 0.005601] Movable zone start for each node worker1 # [ 0.002867] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.005345] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.032165] CPU topo: Max. logical packages: 1 worker2 # [ 0.005602] Early memory node ranges lb # [ 0.032166] CPU topo: Max. logical dies: 1 worker1 # [ 0.002867] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.005346] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.005602] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.032166] CPU topo: Max. dies per package: 1 worker1 # [ 0.002868] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.005347] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.005603] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.032170] CPU topo: Max. threads per core: 1 worker1 # [ 0.003086] No NUMA configuration found client # [ 0.005366] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.032170] CPU topo: Num. cores per package: 1 worker2 # [ 0.005604] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.003087] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.032171] CPU topo: Num. threads per package: 1 client # [ 0.005628] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.005625] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.003089] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.032171] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.031407] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.005466] Zone ranges: worker2 # [ 0.005903] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.031858] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.032189] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.005467] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.032401] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.031869] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.032864] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.005469] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.032220] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.005470] Normal empty client # [ 0.031894] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.032876] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.005471] Device empty lb # [ 0.032222] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.031897] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.005471] Movable zone start for each node worker2 # [ 0.032905] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.005472] Early memory node ranges lb # [ 0.032223] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.031898] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.032908] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.032224] Booting paravirtualized kernel on KVM worker1 # [ 0.005472] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.031899] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.032909] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.005473] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.032227] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.031900] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.032910] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.005474] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.031901] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.036668] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.005493] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.032911] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.038813] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.031903] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.005752] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.032912] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.038857] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.031904] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.031404] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.031908] TSC deadline timer available worker2 # [ 0.032914] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.031861] ACPI: PM-Timer IO Port: 0x608 client # [ 0.031912] CPU topo: Max. logical packages: 1 worker2 # [ 0.032915] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.031872] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.031913] CPU topo: Max. logical dies: 1 worker2 # [ 0.032919] TSC deadline timer available client # [ 0.031913] CPU topo: Max. dies per package: 1 worker2 # [ 0.032923] CPU topo: Max. logical packages: 1 worker1 # [ 0.031897] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.031917] CPU topo: Max. threads per core: 1 worker2 # [ 0.032924] CPU topo: Max. logical dies: 1 worker1 # [ 0.031899] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.031918] CPU topo: Num. cores per package: 1 worker2 # [ 0.032924] CPU topo: Max. dies per package: 1 lb # [ 0.038858] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j1nn9bbhrn5xz154akfhw453f8i07i4d-nixos-system-lb-test/init regInfo=/nix/store/hq8v7nws787a9kwd3h009z1n9dqal4fl-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.031901] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.032928] CPU topo: Max. threads per core: 1 client # [ 0.031918] CPU topo: Num. threads per package: 1 worker2 # [ 0.032928] CPU topo: Num. cores per package: 1 client # [ 0.031918] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.031902] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.032929] CPU topo: Num. threads per package: 1 client # [ 0.031936] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.038952] Unknown kernel command line parameters "regInfo=/nix/store/hq8v7nws787a9kwd3h009z1n9dqal4fl-closure-info/registration", will be passed to user space. worker1 # [ 0.031903] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.032929] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.038965] random: crng init done worker1 # [ 0.031904] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.031965] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.032947] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.038966] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.031906] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.031967] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.032980] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.031907] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.041224] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.031968] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.031910] TSC deadline timer available client # [ 0.031969] Booting paravirtualized kernel on KVM worker2 # [ 0.032982] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.042263] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.031914] CPU topo: Max. logical packages: 1 lb # [ 0.042293] Fallback order for Node 0: 0 worker1 # [ 0.031915] CPU topo: Max. logical dies: 1 worker2 # [ 0.032983] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.031916] CPU topo: Max. dies per package: 1 client # [ 0.031972] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.042295] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.032985] Booting paravirtualized kernel on KVM lb # [ 0.042296] Policy zone: DMA32 worker1 # [ 0.031919] CPU topo: Max. threads per core: 1 client # [ 0.036411] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.031919] CPU topo: Num. cores per package: 1 lb # [ 0.044718] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.032988] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.038711] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.031920] CPU topo: Num. threads per package: 1 lb # [ 0.047692] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.037435] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.038754] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.031920] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.051127] allocated 3145728 bytes of page_ext worker2 # [ 0.039614] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.061136] ftrace: allocating 48731 entries in 192 pages worker1 # [ 0.031937] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.039660] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.061138] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.031967] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.061962] Dynamic Preempt: lazy lb # [ 0.062087] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.031969] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.062087] rcu: RCU event tracing is enabled. worker1 # [ 0.031970] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.038755] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test/init regInfo=/nix/store/8qcbhkhv67h7qfb5lww8vbzpf1w4p6d9-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.062088] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.031971] Booting paravirtualized kernel on KVM lb # [ 0.062089] Trampoline variant of Tasks RCU enabled. lb # [ 0.062090] Rude variant of Tasks RCU enabled. worker2 # [ 0.039661] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/97sck759bskxrmqr38axr5kzb0p084pz-nixos-system-worker2-test/init regInfo=/nix/store/dfij3l6x15yx3kznbya019zn219wy845-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.031974] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.038846] Unknown kernel command line parameters "regInfo=/nix/store/8qcbhkhv67h7qfb5lww8vbzpf1w4p6d9-closure-info/registration", will be passed to user space. lb # [ 0.062090] Tracing variant of Tasks RCU enabled. client # [ 0.038859] random: crng init done worker1 # [ 0.036446] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.062091] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.038860] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.038543] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.039757] Unknown kernel command line parameters "regInfo=/nix/store/dfij3l6x15yx3kznbya019zn219wy845-closure-info/registration", will be passed to user space. lb # [ 0.062092] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.039770] random: crng init done client # [ 0.040935] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.038584] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.039771] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.062106] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.041970] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.042000] Fallback order for Node 0: 0 worker2 # [ 0.041882] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.062108] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.042002] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.043121] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.042003] Policy zone: DMA32 lb # [ 0.062109] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.043151] Fallback order for Node 0: 0 client # [ 0.044414] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.066462] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.038586] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pj67bngsjx4svw66my9vshw84i37agz7-nixos-system-worker1-test/init regInfo=/nix/store/j1ik3n9mca5rj6xyz1di0lygynxpmyha-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.043154] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.047392] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.043155] Policy zone: DMA32 lb # [ 0.066771] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.051295] allocated 3145728 bytes of page_ext worker2 # [ 0.045652] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.061129] ftrace: allocating 48731 entries in 192 pages worker1 # [ 0.038684] Unknown kernel command line parameters "regInfo=/nix/store/j1ik3n9mca5rj6xyz1di0lygynxpmyha-closure-info/registration", will be passed to user space. lb # [ 0.066778] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.038697] random: crng init done worker2 # [ 0.048805] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.061130] ftrace: allocated 192 pages with 2 groups client # [ 0.061957] Dynamic Preempt: lazy worker2 # [ 0.052107] allocated 3145728 bytes of page_ext worker1 # [ 0.038697] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.066879] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.062117] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.061670] ftrace: allocating 48731 entries in 192 pages lb # [ 0.070406] Console: colour VGA+ 80x25 client # [ 0.062118] rcu: RCU event tracing is enabled. worker1 # [ 0.040769] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.061672] ftrace: allocated 192 pages with 2 groups lb # [ 0.070409] printk: legacy console [tty0] enabled worker2 # [ 0.062509] Dynamic Preempt: lazy lb # [ 0.099794] printk: legacy console [ttyS0] enabled client # [ 0.062118] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.041805] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.062692] rcu: Preemptible hierarchical RCU implementation. client # [ 0.062120] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.041840] Fallback order for Node 0: 0 lb # [ 0.196186] ACPI: Core revision 20250807 worker2 # [ 0.062693] rcu: RCU event tracing is enabled. client # [ 0.062121] Rude variant of Tasks RCU enabled. worker1 # [ 0.041842] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.062121] Tracing variant of Tasks RCU enabled. worker2 # [ 0.062694] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.041843] Policy zone: DMA32 lb # [ 0.197068] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.062695] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.045028] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.062122] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.062696] Rude variant of Tasks RCU enabled. lb # [ 0.198542] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.048108] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.062122] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.062696] Tracing variant of Tasks RCU enabled. lb # [ 0.199472] x2apic enabled worker1 # [ 0.051724] allocated 3145728 bytes of page_ext client # [ 0.062138] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.062697] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.061404] ftrace: allocating 48731 entries in 192 pages lb # [ 0.200206] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.061406] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.062698] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.062140] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.062244] Dynamic Preempt: lazy worker1 # [ 0.062376] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.062722] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.062140] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.062376] rcu: RCU event tracing is enabled. lb # [ 0.202020] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.066501] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.062723] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.062377] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.066789] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.062378] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.062724] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.202981] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.062378] Rude variant of Tasks RCU enabled. client # [ 0.066796] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.067278] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.062379] Tracing variant of Tasks RCU enabled. lb # [ 0.204604] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.062379] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.067548] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.066895] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.070414] Console: colour VGA+ 80x25 worker1 # [ 0.062380] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.205688] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.067556] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.070417] printk: legacy console [tty0] enabled worker1 # [ 0.062436] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.099840] printk: legacy console [ttyS0] enabled lb # [ 0.206720] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.067665] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.195739] ACPI: Core revision 20250807 worker2 # [ 0.071206] Console: colour VGA+ 80x25 worker1 # [ 0.062438] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.207602] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.071209] printk: legacy console [tty0] enabled worker2 # [ 0.100628] printk: legacy console [ttyS0] enabled worker1 # [ 0.062439] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.196601] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.208606] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.066800] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.198060] ACPI: Core revision 20250807 client # [ 0.198081] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.067082] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.199010] x2apic enabled lb # [ 0.209602] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.198959] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.067089] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.199740] APIC: Switched APIC routing to: physical x2apic lb # [ 0.210602] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.200470] APIC: Switch to symmetric I/O mode setup lb # [ 0.211602] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.067188] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.201463] x2apic enabled worker1 # [ 0.070735] Console: colour VGA+ 80x25 client # [ 0.201534] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.212602] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.070738] printk: legacy console [tty0] enabled worker2 # [ 0.202250] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.100038] printk: legacy console [ttyS0] enabled client # [ 0.202473] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.195608] ACPI: Core revision 20250807 worker2 # [ 0.204091] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.204059] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.196523] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.206145] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.213601] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.205093] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.198071] APIC: Switch to symmetric I/O mode setup lb # [ 0.215610] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.199013] x2apic enabled client # [ 0.207219] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.206782] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.199746] APIC: Switched APIC routing to: physical x2apic client # [ 0.208052] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.216313] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.207868] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.217602] active return thunk: srso_alias_return_thunk worker2 # [ 0.208923] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.209056] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.201538] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.218622] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.210474] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.210052] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.219601] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.202609] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.211052] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.220601] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.211554] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.212052] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.204293] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.221589] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.212780] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.213052] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.205380] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.222601] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.213780] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.206425] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.223601] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.215511] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.207995] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.224601] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.216486] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.225602] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.214052] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.208294] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.216059] Spectre V2 : Enabling IBPB for BPF lb # [ 0.226601] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.210290] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.227601] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.217568] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.211290] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.228602] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.219053] active return thunk: srso_alias_return_thunk worker2 # [ 0.217534] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.212990] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.229601] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.218787] Spectre V2 : Enabling IBPB for BPF client # [ 0.219888] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.213976] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.221052] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.219780] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.230602] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.220780] active return thunk: srso_alias_return_thunk client # [ 0.221989] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.222782] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.222463] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.223791] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.223779] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.214290] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.224776] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.216298] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.224758] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.225814] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.225779] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.217291] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.227052] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.226780] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.218291] active return thunk: srso_alias_return_thunk client # [ 0.227965] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.227779] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.219946] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.228754] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.228779] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.221203] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.229758] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.229779] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.222031] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.230754] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.230779] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.223025] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.231052] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.231779] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.224057] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.232779] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.225052] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.233779] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.226115] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.234779] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.227290] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.228290] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.229290] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.230290] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.231290] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.232290] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.265000] Freeing SMP alternatives memory: 44K lb # [ 0.265604] pid_max: default: 32768 minimum: 301 lb # [ 0.266618] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.267678] landlock: Up and running. lb # [ 0.268284] Yama: becoming mindful. lb # [ 0.268814] LSM support for eBPF active lb # [ 0.269708] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.270639] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.273298] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.264106] Freeing SMP alternatives memory: 44K lb # [ 0.274124] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.264863] pid_max: default: 32768 minimum: 301 lb # [ 0.274606] ... version: 2 lb # [ 0.275308] ... bit width: 48 client # [ 0.265680] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.275604] ... generic counters: 6 client # [ 0.266162] landlock: Up and running. lb # [ 0.276278] ... generic bitmap: 000000000000003f client # [ 0.267052] Yama: becoming mindful. lb # [ 0.276655] ... fixed-purpose counters: 0 client # [ 0.268179] LSM support for eBPF active worker2 # [ 0.268613] Freeing SMP alternatives memory: 44K lb # [ 0.277367] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.269360] pid_max: default: 32768 minimum: 301 client # [ 0.268909] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.277604] ... value mask: 0000ffffffffffff worker2 # [ 0.269873] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.270098] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.278507] ... max period: 00007fffffffffff worker2 # [ 0.270885] landlock: Up and running. worker2 # [ 0.271780] Yama: becoming mindful. lb # [ 0.279275] ... global_ctrl mask: 000000000000003f worker2 # [ 0.272881] LSM support for eBPF active lb # [ 0.279731] signal: max sigframe size: 3376 client # [ 0.272345] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.280474] rcu: Hierarchical SRCU implementation. worker2 # [ 0.273690] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.266222] Freeing SMP alternatives memory: 44K lb # [ 0.281191] rcu: Max phase no-delay instances is 400. worker1 # [ 0.266868] pid_max: default: 32768 minimum: 301 client # [ 0.273651] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.274829] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.274102] ... version: 2 worker1 # [ 0.267372] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.274781] ... bit width: 48 worker1 # [ 0.268391] landlock: Up and running. client # [ 0.275054] ... generic counters: 6 worker1 # [ 0.269291] Yama: becoming mindful. worker2 # [ 0.277231] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.275746] ... generic bitmap: 000000000000003f worker1 # [ 0.270478] LSM support for eBPF active client # [ 0.276054] ... fixed-purpose counters: 0 worker2 # [ 0.278329] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.276730] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.271244] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.286113] smp: Bringing up secondary CPUs ... worker2 # [ 0.278788] ... version: 2 lb # [ 0.286618] smp: Brought up 1 node, 1 CPU client # [ 0.277054] ... value mask: 0000ffffffffffff worker2 # [ 0.279495] ... bit width: 48 worker1 # [ 0.272333] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.277906] ... max period: 00007fffffffffff lb # [ 0.287293] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.279782] ... generic counters: 6 client # [ 0.278698] ... global_ctrl mask: 000000000000003f worker2 # [ 0.280484] ... generic bitmap: 000000000000003f client # [ 0.279147] signal: max sigframe size: 3376 worker2 # [ 0.280782] ... fixed-purpose counters: 0 worker1 # [ 0.274790] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.287754] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) client # [ 0.279901] rcu: Hierarchical SRCU implementation. worker2 # [ 0.281467] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.280596] rcu: Max phase no-delay instances is 400. lb # [ 0.288838] devtmpfs: initialized worker2 # [ 0.281782] ... value mask: 0000ffffffffffff worker1 # [ 0.275875] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.289700] x86/mm: Memory block size: 128MB worker1 # [ 0.276299] ... version: 2 worker2 # [ 0.282649] ... max period: 00007fffffffffff worker1 # [ 0.277004] ... bit width: 48 worker2 # [ 0.283441] ... global_ctrl mask: 000000000000003f worker1 # [ 0.277292] ... generic counters: 6 worker2 # [ 0.283879] signal: max sigframe size: 3376 lb # [ 0.291468] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.278013] ... generic bitmap: 000000000000003f worker2 # [ 0.284683] rcu: Hierarchical SRCU implementation. worker1 # [ 0.278292] ... fixed-purpose counters: 0 worker2 # [ 0.285386] rcu: Max phase no-delay instances is 400. lb # [ 0.292525] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.279008] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.285527] smp: Bringing up secondary CPUs ... lb # [ 0.293723] pinctrl core: initialized pinctrl subsystem client # [ 0.286068] smp: Brought up 1 node, 1 CPU worker1 # [ 0.279292] ... value mask: 0000ffffffffffff lb # [ 0.294867] PM: RTC time: 11:21:23, date: 2026-09-22 client # [ 0.286709] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.280185] ... max period: 00007fffffffffff worker1 # [ 0.280930] ... global_ctrl mask: 000000000000003f worker1 # [ 0.281386] signal: max sigframe size: 3376 client # [ 0.287246] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved) worker1 # [ 0.282178] rcu: Hierarchical SRCU implementation. client # [ 0.288259] devtmpfs: initialized worker2 # [ 0.290246] smp: Bringing up secondary CPUs ... lb # [ 0.298271] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.282907] rcu: Max phase no-delay instances is 400. worker2 # [ 0.290796] smp: Brought up 1 node, 1 CPU client # [ 0.288958] x86/mm: Memory block size: 128MB worker2 # [ 0.291466] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.299103] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.290609] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.299632] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.291992] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) client # [ 0.291079] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.293024] devtmpfs: initialized lb # [ 0.300880] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.292138] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.287838] smp: Bringing up secondary CPUs ... worker2 # [ 0.293832] x86/mm: Memory block size: 128MB lb # [ 0.301613] audit: initializing netlink subsys (disabled) client # [ 0.293245] PM: RTC time: 11:21:23, date: 2026-09-22 worker1 # [ 0.288306] smp: Brought up 1 node, 1 CPU lb # [ 0.302606] audit: type=2000 audit(1790076084.249:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.288983] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.295580] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.303764] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.303767] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.296701] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.289467] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved) worker2 # [ 0.297858] pinctrl core: initialized pinctrl subsystem client # [ 0.296944] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.304605] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.290516] devtmpfs: initialized lb # [ 0.305539] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.298929] PM: RTC time: 11:21:23, date: 2026-09-22 worker1 # [ 0.291279] x86/mm: Memory block size: 128MB client # [ 0.298237] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.306304] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.306616] cpuidle: using governor menu client # [ 0.299078] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.292838] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.308837] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.300338] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.293317] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.302473] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.301063] audit: initializing netlink subsys (disabled) worker1 # [ 0.294374] pinctrl core: initialized pinctrl subsystem lb # [ 0.309830] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.302134] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.303285] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.295454] PM: RTC time: 11:21:23, date: 2026-09-22 lb # [ 0.310607] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.302136] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.303805] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.311617] PCI: Using configuration type 1 for base access client # [ 0.303055] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.303960] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.305053] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.312692] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.305791] audit: initializing netlink subsys (disabled) client # [ 0.304750] audit: type=2000 audit(1790076084.261:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.299301] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.306915] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.306057] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.306071] cpuidle: using governor menu worker2 # [ 0.306918] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.300789] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.307783] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.308242] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.301313] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.308760] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.302568] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.309290] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.309532] audit: type=2000 audit(1790076084.264:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.303302] audit: initializing netlink subsys (disabled) client # [ 0.310057] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.319622] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.310785] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.311066] PCI: Using configuration type 1 for base access worker1 # [ 0.304429] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.310799] cpuidle: using governor menu lb # [ 0.320605] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.304432] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.312109] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.313010] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.305294] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.306254] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.314026] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.307043] audit: type=2000 audit(1790076084.271:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.314785] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.308296] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.315793] PCI: Using configuration type 1 for base access lb # [ 0.325606] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.308310] cpuidle: using governor menu lb # [ 0.326605] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.317325] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.316883] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.310499] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.318055] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.311526] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.312296] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.313305] PCI: Using configuration type 1 for base access worker2 # [ 0.321867] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.323056] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.314413] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.322783] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.324054] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.323773] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.337983] ACPI: Added _OSI(Module Device) worker1 # [ 0.319377] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.338606] ACPI: Added _OSI(Processor Device) worker1 # [ 0.320294] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.339400] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.328782] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.334478] ACPI: Added _OSI(Module Device) worker1 # [ 0.325294] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.335056] ACPI: Added _OSI(Processor Device) worker2 # [ 0.334656] ACPI: Added _OSI(Module Device) worker1 # [ 0.326292] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.335764] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.335291] ACPI: Added _OSI(Processor Device) worker2 # [ 0.335783] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.348155] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.352014] ACPI: Interpreter enabled lb # [ 0.352619] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.353374] ACPI: Using IOAPIC for interrupt routing client # [ 0.344564] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.336574] ACPI: Added _OSI(Module Device) lb # [ 0.353664] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.337270] ACPI: Added _OSI(Processor Device) lb # [ 0.354605] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.337869] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.348476] ACPI: Interpreter enabled lb # [ 0.357741] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.349071] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.349276] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.349749] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.350677] ACPI: Interpreter enabled client # [ 0.350129] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.351243] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.351055] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.351782] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.352698] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.354124] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.346638] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.365196] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.365611] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.357783] PCI: Using E820 reservations for host bridge windows lb # [ 0.366681] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.350705] ACPI: Interpreter enabled worker2 # [ 0.358869] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.351308] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.367727] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.351982] ACPI: Using IOAPIC for interrupt routing lb # [ 0.368957] PCI host bridge to bus 0000:00 worker1 # [ 0.352326] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.369609] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.353293] PCI: Using E820 reservations for host bridge windows lb # [ 0.370605] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.362779] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.371604] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.363061] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.372604] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.356381] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.364337] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.373604] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.365177] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.374604] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.366404] PCI host bridge to bus 0000:00 worker2 # [ 0.367544] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.375604] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.367060] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.368055] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.376606] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.369783] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.369055] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.378074] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.370860] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.370055] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.371903] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.371054] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.373135] PCI host bridge to bus 0000:00 worker1 # [ 0.364967] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.372054] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.373787] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.373055] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.365300] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.374782] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.373953] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.375782] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.367257] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.375458] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.376782] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.368282] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.380690] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.377782] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.369504] PCI host bridge to bus 0000:00 lb # [ 0.381617] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.370187] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.378787] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.382550] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.379811] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.371144] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.372156] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.380775] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.383562] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.373158] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.382243] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.385385] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.374250] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.378113] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.375253] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.379067] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.376300] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.380000] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.388635] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.377375] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.389500] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.381269] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.390367] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.378732] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.390611] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.382753] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.384866] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.385794] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.392554] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.385064] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.386787] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.385887] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.386774] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.388007] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.395635] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.387061] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.396492] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.389512] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.397376] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.388566] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.381353] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.382305] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.398977] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.383315] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.392813] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.390071] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.393655] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.390891] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.384712] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.394541] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.391754] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.394788] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.385990] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.392597] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.401612] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.403212] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.396357] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.403626] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.389323] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.390165] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.398816] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.405194] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.395071] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.391012] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.399707] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.396061] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.391299] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.400531] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.396962] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.407483] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] lb # [ 0.408270] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.398392] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.401364] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.392994] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.408626] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.400063] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] client # [ 0.400895] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.396251] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.410141] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.396941] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.401762] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.404000] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.405391] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.397315] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.413312] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker2 # [ 0.405804] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.402594] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.413611] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.398853] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.414551] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.407359] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.404062] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] client # [ 0.404890] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.416036] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.405781] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.408814] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker2 # [ 0.409678] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.401589] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.406667] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.402956] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.410570] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.403314] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.418635] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.419612] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.412141] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.408989] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.404863] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.420555] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.409664] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.414814] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] lb # [ 0.422016] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.410076] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.407127] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker2 # [ 0.415675] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.407944] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.411599] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.416579] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.424383] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker1 # [ 0.408315] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.424611] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.413061] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker2 # [ 0.418215] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.425522] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.413893] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.426424] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.410409] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.414773] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.415061] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.420814] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.428431] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.412324] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker2 # [ 0.421789] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.416566] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.413157] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.422710] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.430617] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.414068] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.418077] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.431567] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.424254] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.415711] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.419077] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.433002] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.425815] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] client # [ 0.420615] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.426676] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.422062] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker2 # [ 0.427579] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.435647] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker1 # [ 0.418679] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.422881] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.419924] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.428636] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.436536] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.423772] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.420315] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.437339] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.430321] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.424610] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.421900] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.438152] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.431788] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.426596] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker2 # [ 0.432775] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.423944] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] lb # [ 0.440279] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] client # [ 0.427062] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.424300] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.440611] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.434327] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.427986] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.425207] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.441581] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.429404] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.426107] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.435805] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] client # [ 0.430589] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] lb # [ 0.443013] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.427848] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.436646] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.431257] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.444450] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.437804] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.432627] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker1 # [ 0.429306] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.445439] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.439502] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.430249] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.447311] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker1 # [ 0.431679] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.441790] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker2 # [ 0.442674] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.443588] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.434040] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker2 # [ 0.445250] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.434300] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.435316] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.447182] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker1 # [ 0.436845] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.448016] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.433250] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.449416] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker1 # [ 0.438300] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker1 # [ 0.439135] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.447822] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.440021] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.450397] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] client # [ 0.436643] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker1 # [ 0.440881] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.450837] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.437333] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.442779] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] lb # [ 0.452287] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.443489] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.452893] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.439066] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.445038] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] lb # [ 0.453886] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.440337] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.454893] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.441344] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.449982] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.456633] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] client # [ 0.442319] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.457481] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.452441] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] client # [ 0.444092] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker2 # [ 0.453055] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.458632] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.444909] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.454726] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.461432] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.446132] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.455769] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.448082] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.457081] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.465198] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.445500] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.458028] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.465711] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.448047] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] lb # [ 0.466706] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.452007] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.459740] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] lb # [ 0.467700] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.452856] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.460391] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.448532] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.453835] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.468701] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.461093] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.454150] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.469702] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.450299] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.455149] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.470704] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.462442] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.451481] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.456152] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.471700] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.472639] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.457152] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.452593] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.473554] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.458149] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.474338] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.453547] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.459092] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.465735] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.474616] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.460026] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.466597] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.475553] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.455347] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] client # [ 0.460984] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.467589] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.476329] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.456188] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.461825] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.468580] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.476617] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.462799] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.469584] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.477620] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.463070] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.457320] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.470605] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.464001] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.471596] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.479615] iommu: Default domain type: Translated worker1 # [ 0.459094] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.464802] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.480396] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.472589] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.481606] ACPI: bus type USB registered worker2 # [ 0.473579] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.466126] iommu: Default domain type: Translated lb # [ 0.482337] usbcore: registered new interface driver usbfs worker2 # [ 0.474523] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.466898] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.482623] usbcore: registered new interface driver hub worker2 # [ 0.474795] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.468030] ACPI: bus type USB registered worker1 # [ 0.462904] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.483463] usbcore: registered new device driver usb worker2 # [ 0.475725] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.468574] usbcore: registered new interface driver usbfs worker1 # [ 0.463425] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.476490] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.469069] usbcore: registered new interface driver hub lb # [ 0.485051] NetLabel: Initializing worker1 # [ 0.464405] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.469925] usbcore: registered new device driver usb worker2 # [ 0.476794] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.485605] NetLabel: domain hash size = 128 worker1 # [ 0.465417] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.477713] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.486322] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.471560] NetLabel: Initializing worker1 # [ 0.466391] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.478535] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.486658] NetLabel: unlabeled traffic allowed by default client # [ 0.472055] NetLabel: domain hash size = 128 worker1 # [ 0.467390] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.487617] PCI: Using ACPI for IRQ routing client # [ 0.472759] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.468393] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.479908] iommu: Default domain type: Translated client # [ 0.473112] NetLabel: unlabeled traffic allowed by default client # [ 0.473993] PCI: Using ACPI for IRQ routing worker1 # [ 0.469390] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.480677] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.470327] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.481761] ACPI: bus type USB registered worker2 # [ 0.482321] usbcore: registered new interface driver usbfs worker1 # [ 0.471281] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.482813] usbcore: registered new interface driver hub worker1 # [ 0.472026] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.483667] usbcore: registered new device driver usb worker1 # [ 0.472307] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.473257] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.485447] NetLabel: Initializing worker1 # [ 0.474042] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.485783] NetLabel: domain hash size = 128 worker1 # [ 0.474304] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.486496] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.475245] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.486819] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.487794] PCI: Using ACPI for IRQ routing worker1 # [ 0.477099] iommu: Default domain type: Translated worker1 # [ 0.477907] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.478545] ACPI: bus type USB registered worker1 # [ 0.479279] usbcore: registered new interface driver usbfs worker1 # [ 0.479938] usbcore: registered new interface driver hub worker1 # [ 0.480319] usbcore: registered new device driver usb worker1 # [ 0.482163] NetLabel: Initializing worker1 # [ 0.482723] NetLabel: domain hash size = 128 worker1 # [ 0.483293] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.484330] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.485305] PCI: Using ACPI for IRQ routing lb # [ 0.531570] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.517297] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.531600] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.518051] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.531600] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.531609] vgaarb: loaded client # [ 0.518051] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.518059] vgaarb: loaded lb # [ 0.532309] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.518774] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.532604] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.519056] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.535688] clocksource: Switched to clocksource kvm-clock client # [ 0.523137] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.532327] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.532778] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.539122] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.532778] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.532790] vgaarb: loaded lb # [ 0.539789] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.526776] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.533492] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.541100] pnp: PnP ACPI init client # [ 0.527484] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.533784] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.541850] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.528808] pnp: PnP ACPI init client # [ 0.529614] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.542791] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.544297] pnp: PnP ACPI: found 6 devices client # [ 0.530620] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.532159] pnp: PnP ACPI: found 6 devices worker2 # [ 0.536875] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.529667] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.530289] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.540462] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.541152] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.530289] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.530297] vgaarb: loaded worker2 # [ 0.542526] pnp: PnP ACPI init worker1 # [ 0.531028] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.543314] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.551861] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.531295] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.553290] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.544282] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.539777] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.554222] NET: Registered PF_INET protocol family worker2 # [ 0.545759] pnp: PnP ACPI: found 6 devices client # [ 0.541198] clocksource: Switched to clocksource acpi_pm client # [ 0.542145] NET: Registered PF_INET protocol family lb # [ 0.555357] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.543337] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.535381] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.537055] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.539519] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.553353] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.540851] pnp: PnP ACPI init worker2 # [ 0.554777] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.541700] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.555780] NET: Registered PF_INET protocol family worker1 # [ 0.542693] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.557010] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.544192] pnp: PnP ACPI: found 6 devices lb # [ 0.571323] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.572853] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.559682] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.574157] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.551770] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.561196] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.553195] clocksource: Switched to clocksource acpi_pm lb # [ 0.575446] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.562491] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.554147] NET: Registered PF_INET protocol family lb # [ 0.576651] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.563821] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.555304] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.577812] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.565052] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.579124] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.566169] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.580236] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.567453] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.581397] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.582345] NET: Registered PF_XDP protocol family client # [ 0.568553] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.573937] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.569785] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.583202] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.570715] NET: Registered PF_XDP protocol family lb # [ 0.584173] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.575471] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.571542] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.585148] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.576735] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.572534] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.586204] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.573496] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.578049] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.587262] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.574558] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.579285] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.588317] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.575641] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.580390] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.589984] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.576778] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.581697] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.578455] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.582793] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.592388] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.584017] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.585031] NET: Registered PF_XDP protocol family lb # [ 0.594377] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.580947] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.571590] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.585921] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.586897] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.573040] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.596274] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.583060] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.587890] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.574309] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.597917] PCI: CLS 0 bytes, default 64 worker2 # [ 0.588936] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.575630] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.585074] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.589980] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.576814] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.598760] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.586839] PCI: CLS 0 bytes, default 64 worker2 # [ 0.591022] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.600498] Trying to unpack rootfs image as initramfs... worker1 # [ 0.577943] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.592803] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.579246] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.587688] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.589375] Trying to unpack rootfs image as initramfs... worker1 # [ 0.580376] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.595036] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.581595] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.582511] NET: Registered PF_XDP protocol family worker1 # [ 0.583320] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.597422] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.584284] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.585248] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.599469] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.586312] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.601259] PCI: CLS 0 bytes, default 64 worker1 # [ 0.587365] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.588413] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.602168] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.590116] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.603944] Trying to unpack rootfs image as initramfs... worker1 # [ 0.592533] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.594414] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.596331] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.597941] PCI: CLS 0 bytes, default 64 worker1 # [ 0.598791] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.600441] Trying to unpack rootfs image as initramfs... lb # [ 0.643238] Initialise system trusted keyrings client # [ 0.633305] Initialise system trusted keyrings lb # [ 0.646888] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.636324] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.648166] Initialise system trusted keyrings worker2 # [ 0.651291] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.669071] Key type asymmetric registered worker1 # [ 0.646651] Initialise system trusted keyrings lb # [ 0.669784] Asymmetric key parser 'x509' registered worker1 # [ 0.647582] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.670640] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.658384] Key type asymmetric registered client # [ 0.659110] Asymmetric key parser 'x509' registered lb # [ 0.673974] io scheduler mq-deadline registered client # [ 0.659997] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.674721] io scheduler kyber registered client # [ 0.665424] io scheduler mq-deadline registered lb # [ 0.678877] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.666178] io scheduler kyber registered lb # [ 0.680150] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.672468] Key type asymmetric registered client # [ 0.669827] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.675271] Asymmetric key parser 'x509' registered client # [ 0.671128] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.676138] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.685634] Linux agpgart interface v0.103 lb # [ 0.686410] ACPI: bus type drm_connector registered worker2 # [ 0.679399] io scheduler mq-deadline registered client # [ 0.675049] Linux agpgart interface v0.103 worker2 # [ 0.680186] io scheduler kyber registered client # [ 0.675803] ACPI: bus type drm_connector registered lb # [ 0.689321] usbcore: registered new interface driver usbserial_generic lb # [ 0.690393] usbserial: USB Serial support registered for generic worker1 # [ 0.669261] Key type asymmetric registered worker2 # [ 0.682793] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.669952] Asymmetric key parser 'x509' registered client # [ 0.678770] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.684097] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.679839] usbserial: USB Serial support registered for generic worker1 # [ 0.670793] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.693856] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.693856] Please enable it if your BIOS has the CPPC option. client # [ 0.682288] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.696152] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.682288] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.689623] Linux agpgart interface v0.103 client # [ 0.684517] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.676361] io scheduler mq-deadline registered worker2 # [ 0.690401] ACPI: bus type drm_connector registered worker1 # [ 0.677095] io scheduler kyber registered lb # [ 0.699965] drop_monitor: Initializing network drop monitor service lb # [ 0.701231] NET: Registered PF_INET6 protocol family client # [ 0.688413] drop_monitor: Initializing network drop monitor service worker1 # [ 0.679809] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.693671] usbcore: registered new interface driver usbserial_generic client # [ 0.689582] NET: Registered PF_INET6 protocol family worker2 # [ 0.694721] usbserial: USB Serial support registered for generic worker1 # [ 0.681033] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.704356] Segment Routing with IPv6 client # [ 0.692759] Segment Routing with IPv6 lb # [ 0.706871] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.685035] Linux agpgart interface v0.103 worker2 # [ 0.698260] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.707961] IPI shorthand broadcast: enabled worker1 # [ 0.685778] ACPI: bus type drm_connector registered worker2 # [ 0.698260] Please enable it if your BIOS has the CPPC option. client # [ 0.695309] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.700413] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.696353] IPI shorthand broadcast: enabled worker2 # [ 0.701758] drop_monitor: Initializing network drop monitor service worker2 # [ 0.702905] NET: Registered PF_INET6 protocol family worker1 # [ 0.690708] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.691764] usbserial: USB Serial support registered for generic worker2 # [ 0.707718] Segment Routing with IPv6 lb # [ 0.716118] sched_clock: Marking stable (582013490, 133823491)->(787491132, -71654151) worker2 # [ 0.708446] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.694234] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.694234] Please enable it if your BIOS has the CPPC option. client # [ 0.704896] sched_clock: Marking stable (571014915, 133255474)->(777136254, -72865865) worker1 # [ 0.696361] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.711540] IPI shorthand broadcast: enabled lb # [ 0.721094] registered taskstats version 1 lb # [ 0.722112] Loading compiled-in X.509 certificates worker1 # [ 0.700446] drop_monitor: Initializing network drop monitor service client # [ 0.710438] registered taskstats version 1 worker1 # [ 0.701691] NET: Registered PF_INET6 protocol family client # [ 0.711398] Loading compiled-in X.509 certificates worker1 # [ 0.704713] Segment Routing with IPv6 worker2 # [ 0.719818] sched_clock: Marking stable (584015336, 135222654)->(787649232, -68411242) worker1 # [ 0.707249] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.708292] IPI shorthand broadcast: enabled worker2 # [ 0.722342] registered taskstats version 1 worker2 # [ 0.723284] Loading compiled-in X.509 certificates worker1 # [ 0.715533] sched_clock: Marking stable (582014666, 133200594)->(789283834, -74068574) lb # [ 0.740856] Demotion targets for Node 0: null lb # [ 0.741773] Key type .fscrypt registered lb # [ 0.742490] Key type fscrypt-provisioning registered lb # [ 0.743454] ima: No TPM chip found, activating TPM-bypass! client # [ 0.730286] Demotion targets for Node 0: null worker1 # [ 0.721406] registered taskstats version 1 client # [ 0.731133] Key type .fscrypt registered worker1 # [ 0.722342] Loading compiled-in X.509 certificates client # [ 0.731823] Key type fscrypt-provisioning registered lb # [ 0.747858] ima: Allocated hash algorithm: sha1 client # [ 0.734386] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.748634] ima: No architecture policies found client # [ 0.735319] ima: Allocated hash algorithm: sha1 lb # [ 0.749580] PM: Magic number: 10:660:378 client # [ 0.736100] ima: No architecture policies found worker2 # [ 0.742261] Demotion targets for Node 0: null worker2 # [ 0.743093] Key type .fscrypt registered worker2 # [ 0.743759] Key type fscrypt-provisioning registered lb # [ 0.753243] RAS: Correctable Errors collector initialized. worker2 # [ 0.744674] ima: No TPM chip found, activating TPM-bypass! client # [ 0.740457] PM: Magic number: 10:660:378 client # [ 0.742000] RAS: Correctable Errors collector initialized. worker2 # [ 0.749259] ima: Allocated hash algorithm: sha1 worker2 # [ 0.750009] ima: No architecture policies found worker2 # [ 0.750951] PM: Magic number: 10:660:378 worker1 # [ 0.738710] Demotion targets for Node 0: null lb # [ 0.761926] clk: Disabling unused clocks lb # [ 0.762625] PM: genpd: Disabling unused power domains client # [ 0.749905] clk: Disabling unused clocks worker2 # [ 0.754547] RAS: Correctable Errors collector initialized. worker1 # [ 0.742268] Key type .fscrypt registered worker1 # [ 0.742921] Key type fscrypt-provisioning registered worker1 # [ 0.743863] ima: No TPM chip found, activating TPM-bypass! client # [ 0.754288] PM: genpd: Disabling unused power domains worker1 # [ 0.746234] ima: Allocated hash algorithm: sha1 worker1 # [ 0.747049] ima: No architecture policies found worker1 # [ 0.749230] PM: Magic number: 10:660:378 worker2 # [ 0.763097] clk: Disabling unused clocks worker1 # [ 0.750791] RAS: Correctable Errors collector initialized. worker2 # [ 0.765249] PM: genpd: Disabling unused power domains worker1 # [ 0.760875] clk: Disabling unused clocks worker1 # [ 0.763234] PM: genpd: Disabling unused power domains lb # [ 0.926223] Freeing initrd memory: 29092K client # [ 0.913033] Freeing initrd memory: 29096K lb # [ 0.929331] Freeing unused decrypted memory: 2028K client # [ 0.916103] Freeing unused decrypted memory: 2028K lb # [ 0.931927] Freeing unused kernel image (initmem) memory: 3644K client # [ 0.918672] Freeing unused kernel image (initmem) memory: 3644K lb # [ 0.932973] Write protecting the kernel read-only data: 32768k client # [ 0.919749] Write protecting the kernel read-only data: 32768k lb # [ 0.934810] Freeing unused kernel image (text/rodata gap) memory: 1208K client # [ 0.921605] Freeing unused kernel image (text/rodata gap) memory: 1208K lb # [ 0.936336] Freeing unused kernel image (rodata/data gap) memory: 752K client # [ 0.923125] Freeing unused kernel image (rodata/data gap) memory: 752K worker2 # [ 0.932096] Freeing initrd memory: 29092K worker2 # [ 0.935274] Freeing unused decrypted memory: 2028K worker2 # [ 0.937813] Freeing unused kernel image (initmem) memory: 3644K worker2 # [ 0.938877] Write protecting the kernel read-only data: 32768k worker2 # [ 0.940690] Freeing unused kernel image (text/rodata gap) memory: 1208K worker1 # [ 0.928587] Freeing initrd memory: 29092K worker2 # [ 0.942160] Freeing unused kernel image (rodata/data gap) memory: 752K worker1 # [ 0.931676] Freeing unused decrypted memory: 2028K worker1 # [ 0.934242] Freeing unused kernel image (initmem) memory: 3644K worker1 # [ 0.935356] Write protecting the kernel read-only data: 32768k worker1 # [ 0.937238] Freeing unused kernel image (text/rodata gap) memory: 1208K worker1 # [ 0.938750] Freeing unused kernel image (rodata/data gap) memory: 752K lb # [ 0.987325] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.974101] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.988424] Run /init as init process client # [ 0.975143] Run /init as init process client # [ 0.984996] systemd[1]: Inserted module 'autofs4' lb # [ 0.998777] systemd[1]: Inserted module 'autofs4' worker2 # [ 0.993585] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.994627] Run /init as init process worker1 # [ 0.989992] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.991082] Run /init as init process worker2 # [ 1.004775] systemd[1]: Inserted module 'autofs4' client # [ 1.001163] fuse: init (API version 7.45) lb # [ 1.014980] fuse: init (API version 7.45) client # [ 1.006995] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.020684] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.009385] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.023076] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.001000] systemd[1]: Inserted module 'autofs4' client # [ 1.012178] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.026171] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.014396] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.028375] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.020919] fuse: init (API version 7.45) worker2 # [ 1.026733] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.029133] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.017187] fuse: init (API version 7.45) worker2 # [ 1.031994] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.034171] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.022872] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.025273] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.028265] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.030446] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.042469] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.056030] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.060035] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.057786] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.391712] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.396787] systemd[1]: Detected virtualization kvm. lb # [ 1.397599] systemd[1]: Detected architecture x86-64. lb # [ 1.398482] systemd[1]: Running in initrd. lb # [ 1.399717] systemd[1]: Initializing machine ID from random generator. lb # [ 1.401027] systemd[1]: Hostname set to . client # [ 1.379169] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.392951] systemd[1]: Detected virtualization kvm. client # [ 1.395077] systemd[1]: Detected architecture x86-64. client # [ 1.397198] systemd[1]: Running in initrd. client # [ 1.399892] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.396568] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.402864] systemd[1]: Hostname set to . worker2 # [ 1.408537] systemd[1]: Detected virtualization kvm. worker1 # [ 1.393455] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.410637] systemd[1]: Detected architecture x86-64. worker1 # [ 1.398466] systemd[1]: Detected virtualization kvm. worker1 # [ 1.399324] systemd[1]: Detected architecture x86-64. worker2 # [ 1.412724] systemd[1]: Running in initrd. worker1 # [ 1.400189] systemd[1]: Running in initrd. worker1 # [ 1.401465] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.402704] systemd[1]: Hostname set to . worker2 # [ 1.415218] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.418069] systemd[1]: Hostname set to . lb # [ 1.595347] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.595818] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.636027] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.629457] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.624537] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.640227] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.641383] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.642764] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.643808] systemd[1]: Reached target Path Units. lb # [ 1.644702] systemd[1]: Reached target Slice Units. lb # [ 1.645535] systemd[1]: Reached target Swaps. lb # [ 1.646327] systemd[1]: Reached target Timer Units. lb # [ 1.647316] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.648487] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.649603] systemd[1]: Listening on Journal Sockets. lb # [ 1.650582] systemd[1]: Listening on udev Control Socket. lb # [ 1.651580] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.652493] systemd[1]: Reached target Socket Units. lb # [ 1.654361] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.658908] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.636492] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.640619] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.641839] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.643269] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.666102] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.644384] systemd[1]: Reached target Path Units. worker1 # [ 1.645294] systemd[1]: Reached target Slice Units. worker1 # [ 1.646183] systemd[1]: Reached target Swaps. worker1 # [ 1.647006] systemd[1]: Reached target Timer Units. worker1 # [ 1.648090] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.649349] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.650524] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.651573] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.652625] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.653593] systemd[1]: Reached target Socket Units. worker2 # [ 1.668468] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.655478] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.672514] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.681532] systemd[1]: Starting Journal Service... worker1 # [ 1.659090] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.673694] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.675130] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.676287] systemd[1]: Reached target Path Units. worker2 # [ 1.677135] systemd[1]: Reached target Slice Units. worker2 # [ 1.678026] systemd[1]: Reached target Swaps. worker1 # [ 1.664291] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.678837] systemd[1]: Reached target Timer Units. worker2 # [ 1.679889] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.681149] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.682391] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.683438] systemd[1]: Listening on udev Control Socket. client # [ 1.679308] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.684497] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.685481] systemd[1]: Reached target Socket Units. lb # [ 1.694931] systemd[1]: Starting Load Kernel Modules... client # [ 1.682737] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.687305] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.683875] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.685211] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.686491] systemd[1]: Reached target Path Units. worker2 # [ 1.691088] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.678280] systemd[1]: Starting Journal Service... client # [ 1.687402] systemd[1]: Reached target Slice Units. client # [ 1.688304] systemd[1]: Reached target Swaps. client # [ 1.689101] systemd[1]: Reached target Timer Units. client # [ 1.690106] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.691377] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.692588] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.697793] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.693625] systemd[1]: Listening on udev Control Socket. client # [ 1.694663] systemd[1]: Listening on udev Kernel Socket. client # [ 1.695662] systemd[1]: Reached target Socket Units. client # [ 1.697727] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.691372] systemd[1]: Starting Load Kernel Modules... lb # [ 1.701889] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.702339] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.718327] netfs: FS-Cache loaded worker2 # [ 1.711421] systemd[1]: Starting Journal Service... client # [ 1.709016] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.723279] 9pnet: Installing 9P2000 support worker1 # [ 1.699310] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.733920] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.725310] systemd[1]: Starting Load Kernel Modules... client # [ 1.724972] systemd[1]: Starting Journal Service... worker1 # [ 1.718085] netfs: FS-Cache loaded worker1 # [ 1.722982] 9pnet: Installing 9P2000 support lb # [ 1.748981] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.730266] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.739423] systemd[1]: Starting Load Kernel Modules... lb # [ 1.755515] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.733537] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.748108] netfs: FS-Cache loaded worker2 # [ 1.752761] 9pnet: Installing 9P2000 support lb # [ 1.763292] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.768597] systemd-journald[67]: Collecting audit messages is disabled. client # [ 1.744355] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.761486] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.770202] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.750628] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.762274] netfs: FS-Cache loaded lb # [ 1.776221] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.754918] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.767127] 9pnet: Installing 9P2000 support lb # [ 1.783324] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.775364] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.763298] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.775542] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.788393] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.781806] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.770579] systemd-journald[67]: Collecting audit messages is disabled. lb # [ 1.793731] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.772271] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.788900] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.797866] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.777457] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.781754] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.796656] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.792365] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.798415] systemd-journald[67]: Collecting audit messages is disabled. worker1 # [ 1.786663] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.801580] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.797187] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.794253] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.807681] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.796025] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.805815] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.811034] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.812709] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.819317] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.815303] systemd-journald[67]: Collecting audit messages is disabled. lb # [ 1.829373] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.820791] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.819675] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.834960] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.823850] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.828536] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.843070] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.825747] systemd[1]: Finished Load Kernel Modules. client # [ 1.837525] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.839048] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.854917] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.833494] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.850769] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.858198] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.848287] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.868345] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.857443] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.870832] systemd[1]: Finished Load Kernel Modules. lb # [ 1.886429] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.878481] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.890500] systemd[1]: Started Journal Service. lb # [ 1.754676] systemd-modules-load[68]: Inserted module 'dm_mod' lb # [ 1.758472] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.879527] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.759566] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.871363] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.764882] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.890809] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.771683] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.897361] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.773356] systemd[1]: Reached target Local File Systems. lb # [ 1.776066] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.888759] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.892615] systemd[1]: Started Journal Service. client # [ 1.901472] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.781486] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.758771] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 1.762216] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.764349] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.776536] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.912934] systemd[1]: Started Journal Service. worker2 # worker1 # [ 1.766383] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.778608] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.768419] systemd[1]: Reached target Local File Systems. worker2 # [ 1.781321] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.770434] systemd[1]: Starting Create System Files and Directories... client # [ 1.914920] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.784785] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.778073] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.792124] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.793149] systemd[1]: Reached target Local File Systems. client # [ 1.926387] systemd[1]: Started Journal Service. worker2 # [ 1.796091] systemd[1]: Starting Create System Files and Directories... lb # [ 1.807958] systemd[1]: Finished Create System Files and Directories. client # [ 1.796222] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.801072] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.800109] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.801193] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.810682] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.814076] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.815069] systemd[1]: Reached target Local File Systems. worker1 # [ 1.808166] systemd[1]: Finished Create System Files and Directories. client # [ 1.818148] systemd[1]: Starting Create System Files and Directories... lb # [ 1.833276] systemd-udevd[84]: Using default interface naming scheme 'v261'. client # [ 1.822805] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.826285] systemd[1]: Finished Create System Files and Directories. lb # [ 1.857316] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.848716] systemd-udevd[83]: Using default interface naming scheme 'v261'. worker1 # [ 1.837313] systemd-udevd[76]: Using default interface naming scheme 'v261'. client # [ 1.849183] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.861074] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.872774] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.874350] systemd-udevd[83]: Using default interface naming scheme 'v261'. lb # [ 1.903195] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.905124] systemd[1]: Reached target System Initialization. lb # [ 1.905909] systemd[1]: Reached target Basic System. client # [ 1.897863] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.918076] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.918900] systemd[1]: Reached target System Initialization. worker1 # [ 1.907896] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.919699] systemd[1]: Reached target Basic System. worker1 # [ 1.910593] systemd[1]: Reached target System Initialization. worker1 # [ 1.911451] systemd[1]: Reached target Basic System. client # [ 1.942164] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.944240] systemd[1]: Reached target System Initialization. client # [ 1.945180] systemd[1]: Reached target Basic System. lb # [ 2.195022] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.215636] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.229766] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.222775] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.226268] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 2.241143] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.252807] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.248004] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.271779] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.263823] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.267111] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.257151] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.273252] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.282639] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.268825] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.283416] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.271054] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.285219] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.263229] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.287081] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.293898] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.285307] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.271641] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.286061] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.272566] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.295543] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.274329] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.287970] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.296678] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.300861] usb usb1: Product: EHCI Host Controller lb # [ 2.301550] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker1 # [ 2.280280] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.304142] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.295428] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.305122] hub 1-0:1.0: USB hub found worker1 # [ 2.283328] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.292447] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.306459] hub 1-0:1.0: 6 ports detected worker1 # [ 2.284508] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.299299] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.300447] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.287387] usb usb1: Product: EHCI Host Controller worker1 # [ 2.288091] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker2 # [ 2.302465] usb usb1: Product: EHCI Host Controller client # [ 2.297963] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.303133] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker1 # [ 2.290154] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.305244] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.291839] hub 1-0:1.0: USB hub found lb # [ 2.315774] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.293674] hub 1-0:1.0: 6 ports detected worker2 # [ 2.307339] hub 1-0:1.0: USB hub found lb # [ 2.316542] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.308255] hub 1-0:1.0: 6 ports detected client # [ 2.305481] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.296634] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.306208] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.297386] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.308017] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.313886] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.314997] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.316293] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.330973] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.331747] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.318343] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.310072] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.319456] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.323113] usb usb1: Product: EHCI Host Controller worker2 # [ 2.327573] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.328657] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.324007] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker1 # [ 2.315329] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.325444] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.327361] hub 1-0:1.0: USB hub found client # [ 2.329281] hub 1-0:1.0: 6 ports detected lb # [ 2.343263] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.344407] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.213135] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.335954] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.326670] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.340752] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.336694] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.327795] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.227086] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.340818] SCSI subsystem initialized client # [ 2.350925] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.355185] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.356611] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.344427] usb usb2: Product: UHCI Host Controller worker1 # [ 2.345132] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.232824] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.234807] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.216171] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.366033] SCSI subsystem initialized client # [ 2.361440] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 lb # [ 2.378447] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.358410] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.382502] SCSI subsystem initialized worker1 # [ 2.228184] systemd[1]: Starting Virtual Console Setup... client # [ 2.371323] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.385862] usb usb2: Product: UHCI Host Controller lb # [ 2.386528] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.372824] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.245185] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.366883] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.384342] usb usb2: Product: UHCI Host Controller worker1 # [ 2.371884] hub 2-0:1.0: USB hub found worker2 # [ 2.389202] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.377283] hub 2-0:1.0: 2 ports detected lb # [ 2.265727] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.267254] systemd[1]: Finished Virtual Console Setup. client # [ 2.387492] usb usb2: Product: UHCI Host Controller worker1 # [ 2.246849] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.260204] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.250182] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.407157] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.394060] SCSI subsystem initialized client # [ 2.400294] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.401051] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.414891] hub 2-0:1.0: USB hub found worker2 # [ 2.271639] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.417849] hub 2-0:1.0: 2 ports detected worker2 # [ 2.410328] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.411104] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.410806] hub 2-0:1.0: USB hub found worker1 # [ 2.401744] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.269635] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.271195] systemd[1]: Finished Virtual Console Setup. client # [ 2.414941] hub 2-0:1.0: 2 ports detected lb # [ 2.429654] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.430410] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.297643] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.287587] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.299777] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.289697] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.301061] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.288561] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.293092] systemd[1]: Finished Virtual Console Setup. client # [ 2.292860] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.440250] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.431834] hub 2-0:1.0: USB hub found worker1 # [ 2.418617] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.441347] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker2 # [ 2.434281] hub 2-0:1.0: 2 ports detected client # [ 2.430606] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.425427] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.448970] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.427370] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 lb # [ 2.451850] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.456030] usb usb3: Product: UHCI Host Controller worker1 # [ 2.433306] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.456750] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.434458] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.457751] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.309976] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.303163] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.311954] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.450283] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.459604] hub 3-0:1.0: USB hub found worker1 # [ 2.304080] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.451024] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.306104] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.461973] hub 3-0:1.0: 2 ports detected worker2 # [ 2.457277] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.458061] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker1 # [ 2.445246] usb usb3: Product: UHCI Host Controller worker1 # [ 2.445987] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.334916] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.446883] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.470680] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.471434] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.464420] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.465585] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.453493] hub 3-0:1.0: USB hub found worker2 # [ 2.332342] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.342637] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.455462] hub 3-0:1.0: 2 ports detected worker2 # [ 2.334066] systemd[1]: Reached target Initrd Root Device. lb # [ 2.481074] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.337064] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.336576] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.484146] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 client # [ 2.338249] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.462433] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.477239] usb usb3: Product: UHCI Host Controller worker1 # [ 2.463174] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.473142] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.477915] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.486914] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.473934] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.481240] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.489882] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.492303] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.484401] hub 3-0:1.0: USB hub found lb # [ 2.493688] usb usb4: Product: UHCI Host Controller worker1 # [ 2.338472] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.494426] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.473451] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.495841] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.496727] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.483296] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.484091] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 lb # [ 2.498030] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.490315] hub 3-0:1.0: 2 ports detected lb # [ 2.499265] hub 4-0:1.0: USB hub found worker1 # [ 2.344672] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.502187] hub 4-0:1.0: 2 ports detected worker1 # [ 2.480407] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker2 # [ 2.496498] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.482626] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.492363] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.506688] scsi host0: ahci worker1 # [ 2.483813] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.493546] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.507566] scsi host1: ahci worker2 # [ 2.499876] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.509745] scsi host2: ahci worker1 # [ 2.487279] usb usb4: Product: UHCI Host Controller worker1 # [ 2.488043] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.503280] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.489495] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.512906] scsi host3: ahci worker2 # [ 2.504061] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker1 # [ 2.490699] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.513629] scsi host4: ahci client # [ 2.500075] usb usb3: Product: UHCI Host Controller client # [ 2.501357] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.492344] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.502115] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.493596] hub 4-0:1.0: USB hub found lb # [ 2.516945] scsi host5: ahci worker1 # [ 2.494806] hub 4-0:1.0: 2 ports detected client # [ 2.370489] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.495590] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.371573] systemd[1]: Reached target Initrd Root Device. lb # [ 2.517548] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker2 # [ 2.511056] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.376154] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.378976] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.515797] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.512651] hub 3-0:1.0: USB hub found client # [ 2.514414] hub 3-0:1.0: 2 ports detected worker2 # [ 2.383817] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.507285] scsi host0: ahci lb # [ 2.529135] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker1 # [ 2.508604] scsi host1: ahci worker2 # [ 2.522264] usb usb4: Product: UHCI Host Controller worker2 # [ 2.522911] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.511875] scsi host2: ahci client # [ 2.521485] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.525986] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.527189] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.522221] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.536859] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker2 # [ 2.528774] hub 4-0:1.0: USB hub found worker1 # [ 2.516365] scsi host3: ahci worker2 # [ 2.530047] hub 4-0:1.0: 2 ports detected worker2 # [ 2.530945] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.542272] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker1 # [ 2.520713] scsi host4: ahci worker2 # [ 2.536064] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.531393] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.523690] scsi host5: ahci lb # [ 2.545862] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.532923] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 lb # [ 2.548176] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 client # [ 2.535749] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.527330] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 lb # [ 2.549917] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker1 # [ 2.529241] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.409629] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.548264] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.535523] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 client # [ 2.545436] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.550957] scsi host0: ahci worker2 # [ 2.551834] scsi host1: ahci worker1 # [ 2.539294] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker2 # [ 2.553805] scsi host2: ahci client # [ 2.416243] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.542229] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker2 # [ 2.557479] scsi host3: ahci client # [ 2.552879] usb usb4: Product: UHCI Host Controller client # [ 2.554395] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.545486] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 client # [ 2.555163] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.560738] scsi host4: ahci worker1 # [ 2.547378] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 client # [ 2.557974] hub 4-0:1.0: USB hub found worker2 # [ 2.566448] scsi host5: ahci client # [ 2.561225] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.562563] hub 4-0:1.0: 2 ports detected worker2 # [ 2.567044] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 client # [ 2.568298] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.573412] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 client # [ 2.570431] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.578726] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 client # [ 2.578291] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.582625] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker2 # [ 2.583815] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker2 # [ 2.584956] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 client # [ 2.587469] scsi host0: ahci client # [ 2.591307] scsi host1: ahci client # [ 2.593431] scsi host2: ahci client # [ 2.597042] scsi host3: ahci client # [ 2.599756] scsi host4: ahci client # [ 2.605947] scsi host5: ahci client # [ 2.607786] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 client # [ 2.612002] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 client # [ 2.613597] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 client # [ 2.614797] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 client # [ 2.615967] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 client # [ 2.617132] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 lb # [ 2.675099] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.677996] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.681144] usb 1-1: Product: QEMU USB Tablet lb # [ 2.682958] usb 1-1: Manufacturer: QEMU worker1 # [ 2.659341] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.684586] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.662352] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.678284] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.679458] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.665471] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.680811] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.681532] usb 1-1: Manufacturer: QEMU worker1 # [ 2.667355] usb 1-1: Manufacturer: QEMU worker2 # [ 2.682103] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.669055] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.695820] hid: raw HID events driver (C) Jiri Kosina client # [ 2.697571] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.698732] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.700122] usb 1-1: Product: QEMU USB Tablet client # [ 2.700829] usb 1-1: Manufacturer: QEMU lb # [ 2.713477] hid: raw HID events driver (C) Jiri Kosina client # [ 2.701490] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.698541] hid: raw HID events driver (C) Jiri Kosina client # [ 2.715486] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.608904] systemd[1]: Mounting /sysroot... worker1 # [ 2.614323] systemd[1]: Mounting /sysroot... worker2 # [ 2.637226] systemd[1]: Mounting /sysroot... client # [ 2.652358] systemd[1]: Mounting /sysroot... lb # [ 2.864060] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.866241] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.868763] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.871153] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.873360] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.875544] ata3.00: applying bridge limits lb # [ 2.877461] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.856411] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.879756] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.858756] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.882185] ata3.00: configured for UDMA/100 worker1 # [ 2.861070] ata3.00: applying bridge limits worker1 # [ 2.863041] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.884533] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.865409] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.867515] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.869845] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.872142] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.874459] ata3.00: configured for UDMA/100 worker1 # [ 2.876770] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.898347] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.899524] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.900416] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.901262] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.902239] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.903155] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.904029] ata3.00: applying bridge limits worker2 # [ 2.904771] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.905677] ata3.00: configured for UDMA/100 worker2 # [ 2.906760] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.927494] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.929781] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.932414] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.934775] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.937047] ata3.00: applying bridge limits lb # [ 2.951496] usbcore: registered new interface driver usbhid client # [ 2.938957] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.941309] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.943604] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.959236] usbhid: USB HID core driver client # [ 2.945973] ata3.00: configured for UDMA/100 client # [ 2.948552] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.957393] usbcore: registered new interface driver usbhid worker1 # [ 2.943798] usbcore: registered new interface driver usbhid worker2 # [ 2.958159] usbhid: USB HID core driver lb # [ 2.970503] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.949213] usbhid: USB HID core driver lb # [ 2.974084] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.979931] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.961378] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.967471] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.985618] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.996203] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.987441] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 3.008248] EXT4-fs (vda): mounted filesystem f0540d8d-dc46-40b7-b3f7-f6f93ed7ab34 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.986682] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 3.001333] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.880156] systemd[1]: Mounted /sysroot. lb # [ 2.881227] systemd[1]: Reached target Initrd Root File System. lb # [ 2.883143] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.009572] EXT4-fs (vda): mounted filesystem c28dc7c7-33bd-4c82-abcb-54de9793e181 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.997376] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.879164] systemd[1]: Mounted /sysroot. worker1 # [ 3.000168] EXT4-fs (vda): mounted filesystem 2c76696f-d741-40ba-8b57-9f4ab0085c74 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.881640] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.870788] systemd[1]: Mounted /sysroot. worker2 # [ 3.017867] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.873130] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.885648] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 2.895899] systemd-sysroot-fstab-check[142]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.877075] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.899070] systemd[1]: Reload requested from client PID 142 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.900493] systemd[1]: Reloading... client # [ 3.021119] usbcore: registered new interface driver usbhid worker2 # [ 2.892381] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 2.894487] systemd[1]: Mounting /sysroot/run... client # [ 3.025730] usbhid: USB HID core driver worker1 # [ 2.889883] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.902599] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 2.895072] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.896501] systemd[1]: Reloading... worker2 # [ 2.912149] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.044688] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.916489] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.046466] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 3.062386] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 3.070914] EXT4-fs (vda): mounted filesystem 0b5df678-f7c4-4cdd-9397-56990a5593ac r/w with ordered data mode. Quota mode: none. client # [ 3.074421] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.943733] systemd[1]: Mounted /sysroot. client # [ 2.945287] systemd[1]: Reached target Initrd Root File System. client # [ 2.947637] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.952277] systemd-sysroot-fstab-check[147]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.963540] systemd-sysroot-fstab-check[141]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.106411] 9p: Installing v9fs 9p2000 file system support lb # [ 2.981908] systemd[1]: Reloading finished in 82 ms. client # [ 2.969072] systemd[1]: Reload requested from client PID 141 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.970519] systemd[1]: Reloading... worker2 # [ 2.973798] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 2.989107] systemd-sysroot-fstab-check[142]: Requesting initrd-fs.target/start/replace... worker2 # [ 2.980901] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 2.992252] systemd-sysroot-fstab-check[142]: Requesting swap.target/start/replace... worker2 # [ 2.983191] systemd[1]: Mounted /sysroot/run. worker2 # [ 2.984085] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 2.986965] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 2.997814] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 2.999839] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.978561] systemd[1]: Reloading finished in 83 ms. lb # [ 3.001271] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.002283] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 2.993262] systemd[1]: Reload requested from client PID 147 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.994933] systemd[1]: Reloading... worker1 # [ 2.987299] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.992175] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 2.994819] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.996193] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.997231] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 2.999928] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.056341] systemd[1]: Reloading finished in 87 ms. worker2 # [ 3.060534] systemd[1]: Reloading finished in 64 ms. client # [ 3.064382] systemd-sysroot-fstab-check[141]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.070295] systemd-sysroot-fstab-check[147]: Requesting initrd-fs.target/start/replace... client # [ 3.069182] systemd-sysroot-fstab-check[141]: Requesting swap.target/start/replace... worker2 # [ 3.073130] systemd-sysroot-fstab-check[147]: Requesting swap.target/start/replace... client # [ 3.072772] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.076085] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.074235] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.075398] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.078575] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.077789] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 3.081119] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.082183] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.093233] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.094848] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.611194] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.616327] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.625323] systemd[1]: Mounting /sysroot/run... lb # [ 3.634145] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.616180] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.623169] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.635797] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.646786] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.631300] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.641306] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.657383] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.653934] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.658709] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.660589] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.664135] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.661165] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.656161] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.670155] systemd[1]: Mounting /sysroot/run... lb # [ 3.819549] 9p: Installing v9fs 9p2000 file system support lb # [ 3.687615] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.679354] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.683292] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.695961] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.686062] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 3.697590] systemd[1]: Mounted /sysroot/run. lb # [ 3.699369] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.700340] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.693561] systemd[1]: Finished Find NixOS closure. lb # [ 3.704240] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.694680] systemd[1]: Reached target Initrd Default Target. client # [ 3.692155] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.696421] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.691074] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.714291] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.715735] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.717789] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.830304] 9p: Installing v9fs 9p2000 file system support worker2 # [ 3.709304] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.710635] systemd[1]: Stopped target Basic System. worker2 # [ 3.711621] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.700680] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.712680] systemd[1]: Stopped target Path Units. worker2 # [ 3.714103] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.715171] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.716317] systemd[1]: Stopped target Slice Units. worker2 # [ 3.717093] systemd[1]: Stopped target Socket Units. worker1 # [ 3.706213] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.717912] systemd[1]: Stopped target System Initialization. worker2 # [ 3.719094] systemd[1]: Stopped target Swaps. worker1 # [ 3.707666] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.719898] systemd[1]: Stopped target Timer Units. worker1 # [ 3.708654] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.720763] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.721867] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.723101] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.713136] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.724930] systemd[1]: Stopped Find NixOS closure. lb # [ 3.735651] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.725637] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.736889] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.727442] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.728357] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.739068] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.730311] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.741449] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.731355] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.732577] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.733641] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.723129] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.734970] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.724592] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.737126] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.738321] systemd[1]: Stopped Create System Files and Directories. client # [ 3.736062] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.870107] 9p: Installing v9fs 9p2000 file system support worker2 # [ 3.740116] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.740843] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.741928] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.743564] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.741164] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.744413] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.745931] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.746894] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.757206] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.746471] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.748739] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.749733] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.765311] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.756071] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.766397] systemd[1]: Reached target Initrd Default Target. client # [ 3.753512] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.768095] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.760059] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.765354] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.764356] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.768080] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.765918] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.769095] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.770234] systemd[1]: Closed udev Control Socket. client # [ 3.767947] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.781154] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.772072] systemd[1]: Starting Cleanup udev Database... lb # [ 3.783051] systemd[1]: Stopped target Basic System. worker2 # [ 3.772802] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.783750] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.774134] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.784566] systemd[1]: Stopped target Path Units. worker2 # [ 3.774972] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.785272] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.786255] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.776871] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.787413] systemd[1]: Stopped target Slice Units. worker2 # [ 3.777830] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.788408] systemd[1]: Stopped target Socket Units. worker2 # [ 3.778750] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.789371] systemd[1]: Stopped target System Initialization. worker2 # [ 3.779653] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.790365] systemd[1]: Stopped target Swaps. lb # [ 3.791378] systemd[1]: Stopped target Timer Units. lb # [ 3.792273] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.782121] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.793445] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.794967] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.795981] systemd[1]: Stopped Find NixOS closure. lb # [ 3.796705] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.798465] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.799427] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.801254] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.788427] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.789679] systemd[1]: Reached target Initrd File Systems. lb # [ 3.802950] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.804049] systemd[1]: Stopped Load Kernel Modules. client # [ 3.791307] systemd[1]: Starting Find NixOS closure... lb # [ 3.804738] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.805955] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.793824] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.797161] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.807516] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.808857] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.799066] systemd[1]: Finished Cleanup udev Database. lb # [ 3.809718] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.799763] systemd[1]: Reached target Switch Root. lb # [ 3.810503] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.801475] systemd[1]: Starting NixOS Activation... lb # [ 3.813953] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.814979] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.818191] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.819269] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.820455] systemd[1]: Stopped Virtual Console Setup. client # [ 3.811616] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.829265] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.831814] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.819665] systemd[1]: Finished Find NixOS closure. lb # [ 3.832797] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.820922] systemd[1]: Reached target Initrd Default Target. lb # [ 3.834156] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.822841] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.835834] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.836869] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.840070] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.841469] systemd[1]: Closed udev Control Socket. lb # [ 3.843063] systemd[1]: Starting Cleanup udev Database... lb # [ 3.843824] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.844948] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.846211] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.847758] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.848740] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.836660] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.849645] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.837835] systemd[1]: Stopped target Basic System. client # [ 3.838728] systemd[1]: Stopped target Initrd Root Device. client # [ 3.839657] systemd[1]: Stopped target Path Units. client # [ 3.841108] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.842145] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.843319] systemd[1]: Stopped target Slice Units. client # [ 3.843990] systemd[1]: Stopped target Socket Units. client # [ 3.844741] systemd[1]: Stopped target System Initialization. client # [ 3.845841] systemd[1]: Stopped target Swaps. client # [ 3.846705] systemd[1]: Stopped target Timer Units. client # [ 3.847718] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.848788] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.850127] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.851210] systemd[1]: Stopped Find NixOS closure. lb # [ 3.864320] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.852110] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.865840] systemd[1]: Finished Cleanup udev Database. lb # [ 3.867374] systemd[1]: Reached target Switch Root. client # [ 3.854330] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.868924] systemd[1]: Starting NixOS Activation... client # [ 3.856131] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.857128] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.858163] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.859994] systemd[1]: Stopped Load Kernel Modules. client # [ 3.860706] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.861758] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.862767] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.864529] systemd[1]: Stopped Create System Files and Directories. client # [ 3.867382] systemd[1]: Stopped target Local File Systems. client # [ 3.868178] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.869101] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.870047] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.874245] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.875376] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.876856] systemd[1]: Stopped Virtual Console Setup. client # [ 3.887494] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.889155] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.890652] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.892055] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.893354] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.895100] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.896594] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.898067] systemd[1]: Closed udev Control Socket. client # [ 3.899587] systemd[1]: Starting Cleanup udev Database... client # [ 3.900473] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.902121] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.902919] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.904048] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.905107] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.906105] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.921960] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.924062] systemd[1]: Finished Cleanup udev Database. client # [ 3.924762] systemd[1]: Reached target Switch Root. client # [ 3.926443] systemd[1]: Starting NixOS Activation... worker2 # [ 3.954488] initrd-nixos-activation-start[196]: booting system configuration /nix/store/97sck759bskxrmqr38axr5kzb0p084pz-nixos-system-worker2-test lb # [ 4.009706] initrd-nixos-activation-start[195]: booting system configuration /nix/store/j1nn9bbhrn5xz154akfhw453f8i07i4d-nixos-system-lb-test worker2 # [ 4.016399] initrd-nixos-activation-start[196]: running activation script... lb # [ 4.058776] initrd-nixos-activation-start[195]: running activation script... client # [ 4.064291] initrd-nixos-activation-start[194]: booting system configuration /nix/store/d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test client # [ 4.119293] initrd-nixos-activation-start[194]: running activation script... lb # [ 4.427833] initrd-nixos-activation-start[218]: setting up /etc... worker2 # [ 4.418963] initrd-nixos-activation-start[219]: setting up /etc... client # [ 4.453906] initrd-nixos-activation-start[217]: setting up /etc... client # [ 4.618388] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.620078] systemd[1]: Finished NixOS Activation. client # [ 4.621761] systemd[1]: Starting Switch Root... worker1 # [ 4.615723] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.634110] systemd[1]: Switching root. lb # [ 4.667627] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.669321] systemd[1]: Finished NixOS Activation. lb # [ 4.671384] systemd[1]: Starting Switch Root... worker2 # [ 4.662346] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.664145] systemd[1]: Finished NixOS Activation. worker2 # [ 4.665763] systemd[1]: Starting Switch Root... worker1 # [ 4.660114] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.682979] systemd[1]: Switching root. worker1 # [ 4.663191] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.666123] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.678969] systemd[1]: Switching root. worker1 # [ 4.670250] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.697604] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.699848] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.707544] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.708684] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.710424] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.723085] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.724334] systemd[1]: Stopped target Basic System. worker1 # [ 4.726123] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.726936] systemd[1]: Stopped target Path Units. worker1 # [ 4.727677] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.728893] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.729992] systemd[1]: Stopped target Slice Units. worker1 # [ 4.730726] systemd[1]: Stopped target Socket Units. worker1 # [ 4.731621] systemd[1]: Stopped target System Initialization. worker1 # [ 4.732838] systemd[1]: Stopped target Swaps. worker1 # [ 4.733766] systemd[1]: Stopped target Timer Units. worker1 # [ 4.734813] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.735883] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.737133] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.738233] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.739356] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 4.741309] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.743129] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.744268] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.746059] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.747093] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.747763] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.748805] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.750881] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.751923] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.754139] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.754919] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.755797] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.896740] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.757669] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.760627] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.761701] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.762715] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.767597] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.772242] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.774856] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.776117] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.781118] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.782134] systemd[1]: Closed udev Control Socket. worker1 # [ 4.783836] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.784654] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.785790] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.787229] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.788433] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.789508] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.791160] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.792045] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.946350] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.794135] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.948527] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.808879] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.810182] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.811439] systemd[1]: Reached target Switch Root. worker1 # [ 4.813055] systemd[1]: Starting NixOS Activation... client # [ 5.035814] NET: Registered PF_VSOCK protocol family lb # [ 5.097043] NET: Registered PF_VSOCK protocol family worker2 # [ 5.096408] NET: Registered PF_VSOCK protocol family worker1 # [ 4.950209] initrd-nixos-activation-start[193]: booting system configuration /nix/store/pj67bngsjx4svw66my9vshw84i37agz7-nixos-system-worker1-test worker1 # [ 5.003931] initrd-nixos-activation-start[193]: running activation script... client # [ 5.415801] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.420872] systemd[1]: Detected virtualization kvm. client # [ 5.422680] systemd[1]: Detected architecture x86-64. client # [ 5.424558] systemd[1]: Detected first boot. client # [ 5.430854] systemd[1]: Initializing machine ID from random generator. lb # [ 5.468889] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.473134] systemd[1]: Detected virtualization kvm. lb # [ 5.473796] systemd[1]: Detected architecture x86-64. lb # [ 5.474557] systemd[1]: Detected first boot. lb # [ 5.478759] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.477147] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.486727] systemd[1]: Detected virtualization kvm. worker2 # [ 5.488540] systemd[1]: Detected architecture x86-64. worker2 # [ 5.490416] systemd[1]: Detected first boot. worker2 # [ 5.496650] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.361407] initrd-nixos-activation-start[216]: setting up /etc... lb # [ 5.592001] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.681049] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.702700] systemd[1]: Applying preset policy. worker1 # [ 5.601529] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.747871] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.603093] systemd[1]: Finished NixOS Activation. worker1 # [ 5.604858] systemd[1]: Starting Switch Root... worker1 # [ 5.618945] systemd[1]: Switching root. client # [ 5.809510] systemd[1]: Applying preset policy. worker2 # [ 5.871994] systemd[1]: Applying preset policy. worker1 # [ 5.881951] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). lb # [ 6.029586] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.042521] NET: Registered PF_VSOCK protocol family client # [ 6.236953] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.302148] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.401864] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.403151] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.405730] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.407728] systemd[1]: Created slice Slice /system/getty. lb # [ 6.409124] systemd[1]: Created slice User and Session Slice. lb # [ 6.410049] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.411223] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.412341] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.413066] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.413771] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.414595] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.415347] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.416140] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.417003] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.417895] systemd[1]: Reached target Path Units. lb # [ 6.418567] systemd[1]: Reached target Remote File Systems. lb # [ 6.419341] systemd[1]: Reached target Slice Units. lb # [ 6.420056] systemd[1]: Reached target Swaps. lb # [ 6.434350] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 6.437634] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.440014] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.442415] systemd[1]: Listening on Factory Reset Management. lb # [ 6.443344] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.446578] systemd[1]: Starting Journal Log Access Socket... lb # [ 6.448156] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.450770] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.451910] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.453570] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.454863] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.427687] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.437405] systemd[1]: Detected virtualization kvm. lb # [ 6.461779] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.439256] systemd[1]: Detected architecture x86-64. lb # [ 6.462823] systemd[1]: Listening on udev Control Socket. lb # [ 6.463681] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.441225] systemd[1]: Detected first boot. lb # [ 6.467178] systemd[1]: Mounting Huge Pages File System... lb # [ 6.470103] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.448393] systemd[1]: Initializing machine ID from random generator. lb # [ 6.476570] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.482873] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.487580] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.491008] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 6.504283] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.506535] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.515580] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.527362] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.537308] systemd[1]: Mounting FUSE Control File System... lb # [ 6.544063] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.556373] systemd[1]: Starting Journal Service... lb # [ 6.565191] systemd[1]: Starting Load Kernel Modules... lb # [ 6.574289] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.591928] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.599195] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.610261] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.619893] systemd-journald[288]: Collecting audit messages is enabled. lb # [ 6.634601] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.641412] systemd[1]: Mounted Huge Pages File System. lb # [ 6.645194] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.650500] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.651369] EXT4-fs (vda): re-mounted f0540d8d-dc46-40b7-b3f7-f6f93ed7ab34. lb # [ 6.657609] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.658559] loop: module loaded lb # [ 6.663364] systemd[1]: Started Journal Service. lb # [ 6.531683] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.534085] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.535352] systemd-modules-load[289]: Inserted module 'loop' lb # [ 6.537687] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.540908] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 6.543371] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.545330] systemd[1]: Mounted FUSE Control File System. lb # [ 6.548837] systemd[1]: Finished Load Kernel Modules. lb # [ 6.550101] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.678413] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.679727] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.682348] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.684357] systemd[1]: Created slice Slice /system/getty. client # [ 6.685647] systemd[1]: Created slice User and Session Slice. client # [ 6.686586] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.567074] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.687780] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.688913] systemd[1]: Expecting device /dev/hvc0... client # [ 6.689645] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.690400] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.691176] systemd[1]: Stopped target initrd-fs.target. client # [ 6.691921] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.692717] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.693565] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.694455] systemd[1]: Reached target Path Units. client # [ 6.695118] systemd[1]: Reached target Remote File Systems. lb # [ 6.575064] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.695885] systemd[1]: Reached target Slice Units. lb # [ 6.578247] systemd[1]: Starting Firewall... worker2 # [ 6.703393] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 6.704842] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 6.707739] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.709755] systemd[1]: Created slice Slice /system/getty. worker2 # [ 6.711115] systemd[1]: Created slice User and Session Slice. worker2 # [ 6.712019] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.696605] systemd[1]: Reached target Swaps. worker2 # [ 6.713314] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.714410] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 6.715105] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.590324] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.701269] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.715850] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.711472] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.716668] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.591447] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.717436] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 6.718246] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.719038] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 6.719926] systemd[1]: Reached target Path Units. client # [ 6.715133] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.720624] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.721434] systemd[1]: Reached target Slice Units. client # [ 6.717826] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.720493] systemd[1]: Listening on Factory Reset Management. client # [ 6.721412] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.600952] systemd-oomd[290]: No swap; memory pressure usage will be degraded client # [ 6.725009] systemd[1]: Starting Journal Log Access Socket... client # [ 6.726557] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.722133] systemd[1]: Reached target Swaps. lb # [ 6.608671] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.729551] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.731007] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 6.737236] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.732475] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.733784] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 6.741132] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.744091] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 6.746984] systemd[1]: Listening on Factory Reset Management. client # [ 6.742336] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 6.747933] systemd[1]: Listening on Hostname Service Socket. client # [ 6.743395] systemd[1]: Listening on udev Control Socket. client # [ 6.744270] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.624082] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.751809] systemd[1]: Starting Journal Log Access Socket... client # [ 6.748067] systemd[1]: Mounting Huge Pages File System... worker2 # [ 6.753400] systemd[1]: Listening on Journal Audit Socket. client # [ 6.751144] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.756392] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.757596] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 6.759291] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.755890] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 6.760589] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.639076] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.640205] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.762221] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 6.770018] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 6.771027] systemd[1]: Listening on udev Control Socket. worker2 # [ 6.771926] systemd[1]: Listening on udev Varlink Socket. client # [ 6.767583] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.769927] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 6.776334] systemd[1]: Mounting Huge Pages File System... lb # [ 6.652528] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.779489] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.778828] systemd[1]: Starting Load Kernel Module configfs... client # [ 6.780739] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.786117] systemd[1]: Mounting Kernel Debug File System... client # [ 6.782701] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.784619] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.793510] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.802415] systemd-journald[288]: Received client request to flush runtime journal. client # [ 6.793295] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.798004] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.794110] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.800911] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 6.812061] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.814086] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.815621] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.817461] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.823848] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.826133] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.821895] systemd[1]: Applying preset policy. client # [ 6.852139] systemd[1]: Starting Journal Service... worker2 # [ 6.862315] systemd[1]: Starting Journal Service... client # [ 6.864396] systemd[1]: Starting Load Kernel Modules... worker2 # [ 6.870816] systemd[1]: Starting Load Kernel Modules... worker2 # [ 6.882584] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.883052] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 6.892179] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.894274] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.893741] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.902496] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.898590] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.907169] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.909572] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.911614] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.914172] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 6.916418] systemd[1]: Mounted Kernel Trace File System. client # [ 6.913054] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.918845] systemd[1]: Mounted FUSE Control File System. worker2 # [ 6.922772] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 6.927952] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.934892] systemd[1]: Listening on Journal Log Access Socket. client # [ 6.940041] systemd[1]: Mounted Huge Pages File System. client # [ 6.942730] systemd-journald[287]: Collecting audit messages is enabled. lb # [ 6.822685] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.945667] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.826481] systemd[1]: Reached target First Boot Complete. lb # [ 6.827413] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.829328] systemd[1]: Finished Apply Kernel Variables. client # [ 6.950750] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.831663] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.834131] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.955697] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.836162] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.959957] loop: module loaded client # [ 6.961272] EXT4-fs (vda): re-mounted 0b5df678-f7c4-4cdd-9397-56990a5593ac. worker2 # [ 6.966361] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.968097] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.966508] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 6.973141] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.974365] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.977917] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.847176] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.849405] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.984514] systemd[1]: Started Journal Service. client # [ 6.852477] systemd-modules-load[288]: Inserted module 'loop' worker2 # [ 6.992789] EXT4-fs (vda): re-mounted c28dc7c7-33bd-4c82-abcb-54de9793e181. lb # [ 6.870188] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.858119] systemd[1]: Mounted FUSE Control File System. client # [ 6.859673] systemd[1]: Finished Load Kernel Modules. lb # [ 6.874085] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.862114] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.001873] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.877254] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.009498] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.010672] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 7.011814] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.017294] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 7.018059] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.881068] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.888059] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.030676] systemd-journald[289]: Collecting audit messages is enabled. client # [ 6.892928] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.893860] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.897147] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 7.040965] loop: module loaded client # [ 6.908235] systemd-oomd[290]: No swap; memory pressure usage will be degraded worker2 # [ 7.048994] systemd[1]: Finished Load Kernel Modules. client # [ 6.912044] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 7.051921] systemd[1]: Starting Firewall... worker2 # [ 7.058552] systemd[1]: Starting Apply Kernel Variables... client # [ 6.928799] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.929892] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.931138] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 6.957693] systemd-udevd[328]: Using default interface naming scheme 'v261'. worker2 # [ 7.087753] systemd[1]: Started Journal Service. worker2 # [ 6.954953] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.959081] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.962282] systemd-modules-load[290]: Inserted module 'loop' worker2 # [ 6.969555] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 6.972752] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.106319] systemd-journald[287]: Received client request to flush runtime journal. worker2 # [ 6.976193] systemd[1]: Reached target First Boot Complete. lb # [ 6.994379] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.994231] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.997759] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 7.022823] systemd-oomd[291]: No swap; memory pressure usage will be degraded worker2 # [ 7.038758] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.177110] systemd-journald[289]: Received client request to flush runtime journal. lb # [ 7.056795] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.084928] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.087995] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.088925] systemd[1]: Reached target First Boot Complete. client # [ 7.089768] systemd[1]: Finished Apply Kernel Variables. client # [ 7.091175] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.094135] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 7.098080] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.233572] systemd[1]: Populated /etc with preset unit settings. client # [ 7.155773] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.156972] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.161148] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 7.193371] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.186146] systemd[1]: Finished Apply Kernel Variables. client # [ 7.184958] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 7.190162] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 7.191232] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 7.192609] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.194761] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.228236] systemd-udevd[317]: Using default interface naming scheme 'v261'. worker2 # [ 7.234301] systemd-udevd[322]: Using default interface naming scheme 'v261'. lb # [ 7.268285] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.273658] systemd[1]: Mounting /run/wrappers... lb # [ 7.313581] systemd[1]: Mounted /run/wrappers. lb # [ 7.316312] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.318144] systemd[1]: Reached target Local File Systems. lb # [ 7.322501] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.326479] systemd[1]: Starting register-nix-paths.service... lb # [ 7.333316] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.334187] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.324066] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.343383] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.333865] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.359427] systemd[1]: Starting Create System Files and Directories... worker2 # [ 7.367927] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.398240] (udev-worker)[371]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.400678] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.402770] (udev-worker)[367]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.405642] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.448316] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 7.457275] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.455990] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.462893] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.607844] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 7.609140] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 7.611768] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 7.613798] systemd[1]: Created slice Slice /system/getty. worker1 # [ 7.615126] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.616035] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.617672] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 7.618851] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.619592] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 7.620363] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 7.621188] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.621928] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 7.622733] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.501538] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.623584] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 7.624483] systemd[1]: Reached target Path Units. worker1 # [ 7.625189] systemd[1]: Reached target Remote File Systems. lb # [ 7.516446] systemd[1]: Finished Create System Files and Directories. client # [ 7.508904] (udev-worker)[324]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.512396] (udev-worker)[329]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.625945] systemd[1]: Reached target Slice Units. worker1 # [ 7.638206] systemd[1]: Reached target Swaps. client # [ 7.513844] (udev-worker)[324]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.527795] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.641346] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 7.644476] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.646838] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.649430] systemd[1]: Listening on Factory Reset Management. worker1 # [ 7.650366] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.539112] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 7.653776] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.655462] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.658335] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.659432] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.660903] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.662237] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.669281] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 7.670314] systemd[1]: Listening on udev Control Socket. worker1 # [ 7.671226] systemd[1]: Listening on udev Varlink Socket. client # [ 7.549700] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.674650] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.677550] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.682647] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.688482] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.572206] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.694642] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.696118] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 7.584451] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 7.707217] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 7.708082] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 7.585991] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.709638] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.586716] systemd[1]: Reached target Local File Systems. worker1 # [ 7.711838] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.589774] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 7.593385] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.720993] systemd[1]: Mounting FUSE Control File System... client # [ 7.599238] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.722707] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.600040] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.617231] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.611438] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.733933] systemd[1]: Starting Journal Service... worker2 # [ 7.613075] systemd[1]: Reached target Local File Systems. client # [ 7.610425] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.617096] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.620906] systemd[1]: Starting register-nix-paths.service... client # [ 7.619405] systemd[1]: Starting Create System Files and Directories... worker2 # [ 7.624355] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.626314] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.629609] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 7.633241] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.637088] systemd[1]: Starting Create System Files and Directories... client # [ 7.635356] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.639131] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 7.637145] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.638343] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.640578] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.765984] systemd[1]: Starting Load Kernel Modules... client # [ 7.642960] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.645442] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.659299] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 7.667910] systemd[1]: Starting Update is Completed... worker1 # [ 7.786803] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 7.798015] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.800430] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.808317] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.814293] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.816356] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.818283] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.820920] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.822720] systemd[1]: Mounted Kernel Trace File System. client # [ 7.699083] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.825049] systemd[1]: Mounted FUSE Control File System. client # [ 7.703484] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.708030] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 7.718616] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.712165] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.723440] systemd[1]: Finished Update is Completed. lb # [ 7.725040] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.726420] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.838321] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.727597] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.729529] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.842909] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.733327] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.735279] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.862947] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 7.865009] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 7.747859] (udev-worker)[357]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.870771] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.753289] (udev-worker)[356]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.756083] (udev-worker)[357]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.758334] systemd[1]: Finished Create System Files and Directories. client # [ 7.767180] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.904151] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.898772] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.909151] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.777519] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.783586] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.906506] EXT4-fs (vda): re-mounted 2c76696f-d741-40ba-8b57-9f4ab0085c74. worker2 # [ 7.790888] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.913959] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.793853] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 7.915573] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.918271] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.927116] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.928687] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.941356] loop: module loaded worker1 # [ 7.942508] systemd-journald[286]: Collecting audit messages is enabled. worker1 # [ 7.946323] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.950026] systemd[1]: Starting Firewall... worker1 # [ 7.958560] systemd[1]: Starting Apply Kernel Variables... client # [ 7.843874] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.989475] systemd[1]: Started Journal Service. worker2 # [ 7.871594] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.859320] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 7.863328] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 7.868530] systemd-modules-load[287]: Inserted module 'loop' worker1 # [ 7.872710] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 7.889621] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.896095] systemd[1]: Starting Update is Completed... worker1 # [ 7.892770] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 7.893739] systemd[1]: Reached target First Boot Complete. lb # [ 7.921392] systemd[1]: Finished Firewall. worker1 # [ 7.911077] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 7.915208] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 7.927837] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.933679] systemd[1]: Starting Update is Completed... worker1 # [ 7.933747] systemd-oomd[288]: No swap; memory pressure usage will be degraded client # [ 7.944085] systemd[1]: Finished Update is Completed. lb # [ 7.956316] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 7.958514] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 8.101694] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.950838] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.952781] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.109558] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 8.087584] systemd-journald[286]: Received client request to flush runtime journal. worker2 # [ 7.989593] systemd[1]: Finished Update is Completed. worker2 # [ 8.005461] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 8.007491] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.009861] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.012164] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.014598] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.016918] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.019378] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.977380] ACPI: button: Power Button [PWRF] client # [ 7.992041] mousedev: PS/2 mouse device common for all mice client # [ 8.096975] rtc_cmos 00:04: RTC can wake from S4 client # [ 8.113462] parport_pc 00:02: reported by Plug and Play ACPI client # [ 8.113551] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 8.119891] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker1 # [ 8.083920] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.088655] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.121928] rtc_cmos 00:04: registered as rtc0 worker1 # [ 8.092126] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 8.121992] rtc_cmos 00:04: setting system clock to 2026-09-22T11:21:31 UTC (1790076091) worker1 # [ 8.093182] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.127279] ACPI: button: Power Button [PWRF] lb # [ 8.147847] mousedev: PS/2 mouse device common for all mice client # [ 8.122071] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 8.122637] systemd-journald[287]: Time jumped backwards, rotating. client # [ 8.156710] Console: switching to colour dummy device 80x25 lb # [ 8.196534] rtc_cmos 00:04: RTC can wake from S4 lb # [ 8.216544] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker1 # [ 8.146926] systemd-udevd[319]: Using default interface naming scheme 'v261'. lb # [ 8.217779] rtc_cmos 00:04: registered as rtc0 lb # [ 8.218828] rtc_cmos 00:04: setting system clock to 2026-09-22T11:21:31 UTC (1790076091) lb # [ 8.218911] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 8.203925] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.220042] systemd-journald[288]: Time jumped backwards, rotating. client # [ 8.309650] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.222107] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.309653] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.195248] systemd[1]: Finished register-nix-paths.service. lb # [ 8.196876] systemd[1]: Reached target System Initialization. lb # [ 8.198550] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.199575] systemd[1]: Started niks3 garbage collection timer. client # [ 8.320947] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.201220] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.202508] systemd[1]: Reached target Timer Units. lb # [ 8.203384] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.209078] systemd[1]: Listening on niks3 server socket. client # [ 8.331405] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.211365] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.212084] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.213155] systemd[1]: Reached target Socket Units. lb # [ 8.213847] systemd[1]: Reached target Basic System. lb # [ 8.217466] systemd[1]: Started backdoor.service. client # [ 8.207915] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.222062] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.210182] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.352378] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 8.353013] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.232747] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.239458] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.239540] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.243943] systemd[1]: Starting Post-Boot Actions... lb # [ 8.252035] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.382048] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 8.237753] systemd[1]: Finished Coldplug All udev Devices. lb # [ 8.270551] systemd[1]: Starting resolvconf update... lb # [ 8.259879] Console: switching to colour dummy device 80x25 lb # [ 8.398146] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.290661] systemd[1]: Started rustfs.service. worker1 # [ 8.268801] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.286453] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.289121] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.297517] systemd[1]: Finished Firewall. lb # [ 8.314300] systemd[1]: Starting rustfs-bucket.service... client # [ 8.394649] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # connecting to host... lb # [ 8.398255] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.394881] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.352593] systemd[1]: Finished Post-Boot Actions. client # [ 8.351349] systemd[1]: Starting Virtual Console Setup... lb # [ 8.367300] nsncd[525]: Sep 22 11:21:31.778 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.441189] Console: switching to colour frame buffer device 160x50 lb # [ 8.374832] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.498520] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.517173] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.517586] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.390820] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.393654] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.406231] systemd[1]: Starting D-Bus System Message Bus... client # [ 8.534695] ppdev: user-space parallel port driver worker1 # [ 8.402916] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 8.440261] systemd[1]: Starting User Login Management... lb # [ 8.577153] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.445636] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.440122] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 8.450419] ACPI: button: Power Button [PWRF] lb # [ 8.585567] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 8.588686] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.592680] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 8.459300] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.534794] rtc_cmos 00:04: RTC can wake from S4 worker2 # [ 8.542131] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker2 # [ 8.564551] rtc_cmos 00:04: registered as rtc0 worker2 # [ 8.564646] rtc_cmos 00:04: setting system clock to 2026-09-22T11:21:32 UTC (1790076092) client # [ 8.609871] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.564721] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 8.565448] systemd-journald[289]: Time jumped backwards, rotating. worker2 # [ 8.570982] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.478768] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.480956] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 8.627328] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 8.571112] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 8.575534] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.511666] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.514686] systemd[1]: Stopped Virtual Console Setup. client # [ 8.521353] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.576444] Console: switching to colour dummy device 80x25 worker2 # [ 8.661619] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 8.661621] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.516777] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 8.524183] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.671385] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 8.672030] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 8.525794] systemd[1]: Reached target Local File Systems. worker2 # [ 8.675086] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.529089] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 8.533195] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.684136] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.537408] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 8.538970] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.541589] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.547099] systemd[1]: Starting Create System Files and Directories... worker2 # [ 8.720498] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.721577] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.609184] dbus-broker-launch[554]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.615423] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.616588] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 8.618307] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.620242] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.622603] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 8.625203] systemd[1]: nscd.service: Deactivated successfully. lb # [ 8.627563] dbus-broker-launch[554]: NSS returned no entry for 'systemd-timesync' lb # [ 8.628631] dbus-broker-launch[554]: Invalid user-name in /nix/store/4f05js9lzfgnghkwcx7gl7iad82krcww-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.632118] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.611716] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.616780] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.765673] kvm_amd: TSC scaling supported client # [ 8.766087] kvm_amd: Nested Virtualization enabled client # [ 8.766984] kvm_amd: Nested Paging enabled client # [ 8.767805] kvm_amd: LBR virtualization supported client # [ 8.768778] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.769526] kvm_amd: Virtual GIF supported client # [ 8.769974] kvm_amd: Virtual NMI enabled worker1 # [ 8.629960] (udev-worker)[363]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 8.645755] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.634967] (udev-worker)[363]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 8.640520] (udev-worker)[365]: Network interface NamePolicy= disabled on kernel command line. client # [ 8.821527] EDAC MC: Ver: 3.0.0 worker2 # [ 8.804013] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.696417] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.698192] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.688348] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.694763] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 8.707805] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.701624] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 8.854684] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.770943] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 8.961849] Console: switching to colour frame buffer device 160x50 lb # [ 8.963020] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.664408] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.831912] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.833044] dbus-broker-launch[554]: Ready lb # [ 8.839650] systemd[1]: Starting Virtual Console Setup... lb # [ 8.842423] nsncd[610]: Sep 22 11:21:32.172 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.971843] ppdev: user-space parallel port driver client # [ 8.835501] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.828321] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 8.852348] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.853362] systemd[1]: Finished resolvconf update. worker1 # [ 8.831918] systemd[1]: Starting Update is Completed... lb # [ 8.854119] systemd[1]: Reached target Preparation for Network. lb # [ 8.854929] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.859275] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.861753] systemd[1]: Starting DHCP Client... lb # [ 8.863500] systemd[1]: Starting Address configuration of eth1... lb # [ 8.866097] systemd[1]: Starting Extra networking commands.... lb # [ 8.870052] systemd-logind[560]: New seat seat0. lb # [ 8.870838] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.871844] systemd-logind[560]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.872953] systemd-logind[560]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.874190] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.874850] systemd[1]: Started User Login Management. worker2 # [ 9.013777] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.897880] systemd[1]: Starting linger-users.service... worker1 # [ 8.884945] systemd[1]: Finished Update is Completed. lb # [ 8.908388] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.038211] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.909386] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 8.911137] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.913213] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.915082] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.917885] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.920123] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.932463] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.934744] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.923044] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.937382] systemd[1]: Starting Virtual Console Setup... client # [ 8.940182] systemd-vconsole-setup[420]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.943738] systemd[1]: Finished Virtual Console Setup. client # [ 8.945748] systemd[1]: Reached target System Initialization. client # [ 8.946738] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.948092] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.948961] systemd[1]: Reached target Timer Units. client # [ 8.950150] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.951135] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.952179] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.954121] systemd[1]: Reached target Socket Units. client # [ 8.954796] systemd[1]: Reached target Basic System. client # [ 8.956693] systemd[1]: Started backdoor.service. client # [ 8.960091] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.963144] systemd[1]: Starting nftables firewall... client # [ 8.970315] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.975817] systemd[1]: Starting Post-Boot Actions... lb # [ 8.992299] network-addresses-eth1-start[637]: adding address 192.168.1.2/24... done client # [ 8.981383] systemd[1]: Started Reset console on configuration changes. lb # [ 9.005640] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.010062] systemd[1]: Finished linger-users.service. client # [ 9.000990] systemd[1]: Starting resolvconf update... lb # [ 9.019995] network-addresses-eth1-start[637]: adding address 2001:db8:1::2/64... done lb # [ 9.176677] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 9.035273] systemd[1]: Starting D-Bus System Message Bus... lb # [ 9.050909] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.186484] kvm_amd: TSC scaling supported worker2 # [ 9.186905] kvm_amd: Nested Virtualization enabled worker2 # [ 9.187678] kvm_amd: Nested Paging enabled worker2 # [ 9.188148] kvm_amd: LBR virtualization supported worker2 # [ 9.188792] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 9.189477] kvm_amd: Virtual GIF supported worker2 # [ 9.189882] kvm_amd: Virtual NMI enabled client # connecting to host... client # [ 9.058901] systemd[1]: Finished Post-Boot Actions. lb # [ 9.216410] ppdev: user-space parallel port driver worker2 # [ 9.072744] systemd[1]: Finished register-nix-paths.service. client # [ 9.070506] nsncd[428]: Sep 22 11:21:32.580 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.074887] systemd[1]: Started Name Service Cache Daemon (nsncd). client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 9.090334] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.091274] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.246210] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 9.235515] EDAC MC: Ver: 3.0.0 client # [ 9.109300] systemd[1]: Starting User Login Management... worker1 # [ 9.243270] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client: connected to guest root shell client: (connecting took 9.79 seconds) client: (finished: waiting for the VM to finish booting, in 9.79 seconds) client # [ 9.133281] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 9.166816] systemd[1]: Finished Extra networking commands.. lb # [ 9.172430] systemd[1]: Reached target Network. lb # [ 9.183531] systemd[1]: Starting PostgreSQL Server... worker1 # [ 9.174298] systemd[1]: Finished Firewall. lb # [ 9.200597] systemd-logind[560]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 9.201817] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.314531] ACPI: button: Power Button [PWRF] worker1 # [ 9.183781] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.184878] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.217814] dbus-broker-launch[438]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 9.346133] mousedev: PS/2 mouse device common for all mice lb # [ 9.235273] dhcpcd[668]: dhcpcd-10.3.2 starting lb # [ 9.250117] dhcpcd[718]: dev: loaded udev client # [ 9.243597] dbus-broker-launch[438]: NSS returned no entry for 'systemd-timesync' client # [ 9.244871] dbus-broker-launch[438]: Invalid user-name in /nix/store/8rd26vjfizqw5mjnswk36af94npr87nm-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 9.375641] rtc_cmos 00:04: RTC can wake from S4 client # [ 9.253103] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 9.253992] systemd[1]: Stopping Host and Network Name Lookups... client # [ 9.257613] systemd[1]: Stopped target User and Group Name Lookups. client # [ 9.259176] systemd[1]: Stopping User and Group Name Lookups... client # [ 9.260492] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 9.264075] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 9.388974] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 9.280379] systemd[1]: Finished Permit User Sessions. client # [ 9.268149] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 9.423124] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.423543] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.293937] systemd[1]: Started Getty on tty1. client # [ 9.281099] systemd-logind[458]: New seat seat0. lb # [ 9.294663] systemd[1]: Reached target Login Prompts. client # [ 9.287244] systemd[1]: Started D-Bus System Message Bus. client # [ 9.288862] systemd-logind[458]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 9.290508] systemd-logind[458]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 9.294129] systemd-logind[458]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 9.302435] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 9.303618] systemd[1]: Started User Login Management. worker2 # [ 9.320392] systemd-vconsole-setup[524]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.331893] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.323837] systemd[1]: Finished Virtual Console Setup. lb # [ 9.334760] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.325081] systemd[1]: Reached target System Initialization. worker2 # [ 9.326493] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 9.327903] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 9.329231] systemd[1]: Reached target Timer Units. worker2 # [ 9.330237] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 9.331931] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 9.335441] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 9.337131] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 9.338241] systemd[1]: Reached target Socket Units. worker2 # [ 9.338972] systemd[1]: Reached target Basic System. client # [ 9.336929] systemd[1]: Starting linger-users.service... worker2 # [ 9.341740] systemd[1]: Started backdoor.service. lb # [ 9.352963] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.345077] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 9.349221] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.353306] systemd[1]: Starting Post-Boot Actions... client # [ 9.354434] dbus-broker-launch[438]: Ready worker2 # [ 9.357154] systemd[1]: Started Reset console on configuration changes. worker2 # [ 9.364289] systemd[1]: Starting resolvconf update... worker2 # [ 9.371877] systemd[1]: Starting D-Bus System Message Bus... lb # [ 9.396333] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 9.392909] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.394141] nsncd[513]: Sep 22 11:21:32.902 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.398366] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.399498] systemd[1]: Reached target User and Group Name Lookups. client # [ 9.406872] systemd[1]: linger-users.service: Deactivated successfully. client # [ 9.408243] systemd[1]: Finished linger-users.service. client # [ 9.420083] systemd[1]: Finished resolvconf update. worker1 # [ 9.400516] rtc_cmos 00:04: registered as rtc0 client # [ 9.425429] systemd[1]: Starting DHCP Client... worker1 # [ 9.400590] rtc_cmos 00:04: setting system clock to 2026-09-22T11:21:32 UTC (1790076092) worker1 # [ 9.400663] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 9.435840] systemd[1]: Finished Post-Boot Actions. worker1 # [ 9.401633] systemd-journald[286]: Time jumped backwards, rotating. worker1 # [ 9.420137] parport_pc 00:02: reported by Plug and Play ACPI worker2 # connecting to host... worker1 # [ 9.429880] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 9.466750] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.435354] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker1 # [ 9.465988] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 9.471127] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 9.472536] nsncd[532]: Sep 22 11:21:33.536 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.476287] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.480176] systemd[1]: Starting User Login Management... worker1 # [ 9.543204] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 9.483470] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 9.543311] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 9.547977] Console: switching to colour dummy device 80x25 worker1 # [ 9.592528] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 9.661766] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.592760] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 9.528232] dbus-broker-launch[536]: Looking up NSS user entry for 'systemd-timesync'... client # [ 9.540673] dhcpcd[553]: dhcpcd-10.3.2 starting worker2 # [ 9.544117] dbus-broker-launch[536]: NSS returned no entry for 'systemd-timesync' worker2 # [ 9.545184] dbus-broker-launch[536]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 9.670663] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 9.671105] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 9.548894] dhcpcd[560]: dev: loaded udev lb # [ 9.697148] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 9.702113] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.550812] systemd[1]: Starting Virtual Console Setup... lb # [ 9.706444] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.707335] cfg80211: failed to load regulatory.db worker2 # [ 9.571155] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 9.702400] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 9.573660] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 9.576306] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 9.578891] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 9.581879] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.583371] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 9.585349] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.587614] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 9.711390] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 9.712086] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 9.734733] kvm_amd: TSC scaling supported lb # [ 9.735493] kvm_amd: Nested Virtualization enabled lb # [ 9.736538] kvm_amd: Nested Paging enabled worker2 # [ 9.592426] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.738055] kvm_amd: LBR virtualization supported lb # [ 9.738543] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 9.740000] kvm_amd: Virtual GIF supported lb # [ 9.740418] kvm_amd: Virtual NMI enabled client # [ 9.595804] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 9.604545] systemd-logind[557]: New seat seat0. worker2 # [ 9.612865] systemd-logind[557]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 9.614702] systemd-logind[557]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 9.617451] systemd-logind[557]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 9.619605] systemd[1]: Started User Login Management. worker2 # [ 9.624238] systemd[1]: Starting linger-users.service... lb # [ 9.642602] postgresql-pre-start[730]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.643943] postgresql-pre-start[730]: This user must also own the server process. worker2 # [ 9.642967] dbus-broker-launch[536]: Ready worker1 # [ 9.631945] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.633193] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.655392] postgresql-pre-start[730]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.656578] postgresql-pre-start[730]: The default database encoding has accordingly been set to "UTF8". worker1 # [ 9.636194] systemd[1]: Starting Virtual Console Setup... lb # [ 9.657658] postgresql-pre-start[730]: The default text search configuration will be set to "english". lb # [ 9.659586] postgresql-pre-start[730]: Data page checksums are enabled. lb # [ 9.664442] postgresql-pre-start[730]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.665763] postgresql-pre-start[730]: creating subdirectories ... ok lb # [ 9.666900] postgresql-pre-start[730]: selecting dynamic shared memory implementation ... posix client # [ 9.789946] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.813715] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 9.670196] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.681641] dhcpcd[718]: eth0: waiting for carrier worker2 # [ 9.672728] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.683569] dhcpcd[718]: eth0: carrier acquired worker2 # [ 9.673782] nsncd[603]: Sep 22 11:21:33.740 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.676483] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.686479] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.697278] dhcpcd[718]: DUID 00:01:00:01:32:45:21:3d:52:54:00:12:34:56 worker2 # [ 9.687921] systemd[1]: Finished linger-users.service. lb # [ 9.698836] dhcpcd[718]: eth0: IAID 00:12:34:56 lb # [ 9.700351] dhcpcd[718]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 9.821648] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.822416] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 9.695309] systemd[1]: Finished resolvconf update. client # [ 9.825794] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.826657] cfg80211: failed to load regulatory.db worker2 # [ 9.695995] systemd[1]: Reached target Preparation for Network. lb # [ 9.843718] EDAC MC: Ver: 3.0.0 worker2 # [ 9.700079] systemd[1]: Starting DHCP Client... worker2 # [ 9.701794] systemd[1]: Starting Address configuration of eth1... worker2 # [ 9.706269] systemd[1]: Starting Extra networking commands.... client # [ 9.709344] systemd[1]: Finished nftables firewall. client # [ 9.711130] systemd[1]: Reached target Preparation for Network. client # [ 9.714601] systemd[1]: Starting Address configuration of eth1... client # [ 9.719222] systemd[1]: Starting Extra networking commands.... client # [ 9.892629] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.760714] dhcpcd[560]: eth0: waiting for carrier client # [ 9.761966] dhcpcd[560]: eth0: carrier acquired worker1 # [ 9.825495] ppdev: user-space parallel port driver worker1 # [ 9.869010] Console: switching to colour frame buffer device 160x50 client # [ 9.774292] dhcpcd[560]: DUID 00:01:00:01:32:45:21:3d:52:54:00:12:34:56 client # [ 9.775430] dhcpcd[560]: eth0: IAID 00:12:34:56 client # [ 9.776605] dhcpcd[560]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.794448] postgresql-pre-start[730]: selecting default "max_connections" ... 100 worker1 # [ 9.871320] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 9.929742] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.800513] network-addresses-eth1-start[632]: adding address 192.168.1.4/24... done worker1 # [ 9.881400] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 9.927103] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 9.799994] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.801144] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.802855] systemd[1]: Starting Virtual Console Setup... client # [ 9.811480] network-addresses-eth1-start[579]: adding address 192.168.1.1/24... done worker2 # [ 9.817292] network-addresses-eth1-start[632]: adding address 2001:db8:1::4/64... done lb # [ 9.832758] systemd-vconsole-setup[728]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 9.823622] network-addresses-eth1-start[579]: adding address 2001:db8:1::1/64... done lb # [ 9.838504] systemd[1]: Finished Virtual Console Setup. worker2 # [ 9.839305] systemd[1]: Finished Address configuration of eth1. client # [ 9.839967] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.864981] dhcpcd[640]: dhcpcd-10.3.2 starting client # [ 9.863267] systemd[1]: Finished Extra networking commands.. client # [ 9.864834] systemd[1]: Reached target Network. lb # [ 9.877928] postgresql-pre-start[730]: selecting default "shared_buffers" ... 128MB client # [ 9.868099] systemd[1]: Starting Permit User Sessions... worker2 # [ 9.872977] dhcpcd[695]: dev: loaded udev worker2 # [ 9.877646] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.879381] systemd[1]: Reached target Network. worker2 # [ 9.882725] systemd[1]: Starting Permit User Sessions... worker2 # [ 10.033479] 8021q: 802.1Q VLAN Support v1.8 client # [ 9.895493] systemd[1]: Finished Permit User Sessions. worker2 # [ 10.033904] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.890295] systemd[1]: Finished register-nix-paths.service. client # [ 9.899399] systemd[1]: Started Getty on tty1. client # [ 9.900582] systemd[1]: Reached target Login Prompts. worker2 # [ 9.911937] systemd[1]: Finished Permit User Sessions. worker1 # [ 10.036803] kvm_amd: TSC scaling supported worker1 # [ 10.037329] kvm_amd: Nested Virtualization enabled worker1 # [ 10.037808] kvm_amd: Nested Paging enabled worker2 # [ 9.916263] systemd[1]: Started Getty on tty1. worker1 # [ 10.038445] kvm_amd: LBR virtualization supported worker1 # [ 10.038923] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 10.039608] kvm_amd: Virtual GIF supported worker1 # [ 10.040056] kvm_amd: Virtual NMI enabled worker2 # [ 9.918141] systemd[1]: Reached target Login Prompts. worker2 # [ 9.933441] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 10.079634] EDAC MC: Ver: 3.0.0 worker2 # [ 10.122901] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 10.151325] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 10.151962] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 10.155050] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 10.155880] cfg80211: failed to load regulatory.db worker2 # [ 10.205715] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 10.071708] dhcpcd[695]: eth0: waiting for carrier worker2 # [ 10.072661] dhcpcd[695]: eth0: carrier acquired worker2 # [ 10.081668] dhcpcd[695]: DUID 00:01:00:01:32:45:21:3e:52:54:00:12:34:56 worker2 # [ 10.082805] dhcpcd[695]: eth0: IAID 00:12:34:56 worker2 # [ 10.083523] dhcpcd[695]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 10.159318] systemd-vconsole-setup[521]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 10.163068] systemd[1]: Finished Virtual Console Setup. worker1 # [ 10.163839] systemd[1]: Reached target System Initialization. worker1 # [ 10.165477] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 10.167242] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 10.168199] systemd[1]: Reached target Timer Units. worker1 # [ 10.168897] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.170206] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.173447] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.174584] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 10.175789] systemd[1]: Reached target Socket Units. worker1 # [ 10.176575] systemd[1]: Reached target Basic System. worker1 # [ 10.180465] systemd[1]: Started backdoor.service. worker1 # [ 10.183239] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 10.186106] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.191517] systemd[1]: Starting Post-Boot Actions... worker1 # [ 10.195074] systemd[1]: Started Reset console on configuration changes. worker1 # [ 10.200651] systemd[1]: Starting resolvconf update... worker1 # [ 10.209503] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.272333] systemd[1]: Finished Post-Boot Actions. worker1 # connecting to host... worker1 # [ 10.306584] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.308493] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.311111] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.313270] nsncd[529]: Sep 22 11:21:33.535 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.317167] systemd[1]: Starting User Login Management... worker1 # [ 10.319439] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 10.334811] dhcpcd[560]: eth0: soliciting a DHCP lease client # [ 10.491875] NET: Registered PF_PACKET protocol family client # [ 10.365856] dhcpcd[560]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 10.371143] dhcpcd[560]: eth0: probing address 10.0.2.15/24 worker1 # [ 10.365197] dbus-broker-launch[533]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 10.380139] dbus-broker-launch[533]: NSS returned no entry for 'systemd-timesync' worker1 # [ 10.381422] dbus-broker-launch[533]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 10.398856] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 10.401048] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 10.401860] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 10.404087] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 10.406200] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 10.408178] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 10.409697] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client: (finished: waiting for unit network-addresses-eth1.service, in 11.09 seconds) worker1 # [ 10.417784] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker1 # [ 10.425610] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 10.444613] systemd-logind[554]: New seat seat0. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 10.454786] systemd-logind[554]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 10.456263] systemd-logind[554]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 10.457889] systemd-logind[554]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 10.463935] systemd[1]: Started User Login Management. worker1 # [ 10.466674] systemd[1]: Starting linger-users.service... worker1 # [ 10.481775] dbus-broker-launch[533]: Ready worker1 # [ 10.499979] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.500934] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.501933] systemd[1]: Reached target User and Group Name Lookups. lb: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker1 # [ 10.503691] nsncd[599]: Sep 22 11:21:33.734 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.521074] systemd[1]: Finished resolvconf update. worker1 # [ 10.522989] systemd[1]: Reached target Preparation for Network. worker1 # [ 10.529076] systemd[1]: Starting DHCP Client... lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 10.532089] systemd[1]: Starting Address configuration of eth1... worker1 # [ 10.535505] systemd[1]: Starting Extra networking commands.... worker1 # [ 10.537820] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 10.540181] systemd[1]: Finished linger-users.service. worker1 # [ 10.651377] network-addresses-eth1-start[628]: adding address 192.168.1.3/24... done worker1 # [ 10.666597] network-addresses-eth1-start[628]: adding address 2001:db8:1::3/64... done worker1 # [ 10.687628] systemd[1]: Finished Address configuration of eth1. worker1 # [ 10.727593] systemd[1]: Finished Extra networking commands.. worker1 # [ 10.729511] systemd[1]: Reached target Network. worker1 # [ 10.733153] systemd[1]: Starting Permit User Sessions... worker1 # [ 10.734825] dhcpcd[644]: dhcpcd-10.3.2 starting worker1 # [ 10.745312] dhcpcd[699]: dev: loaded udev worker1 # [ 10.763783] systemd[1]: Finished Permit User Sessions. worker1 # [ 10.767733] systemd[1]: Started Getty on tty1. worker1 # [ 10.769361] systemd[1]: Reached target Login Prompts. worker1 # [ 10.907354] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 10.907776] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 10.804328] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 10.991623] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 11.018085] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 11.018833] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 11.021949] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 11.022763] cfg80211: failed to load regulatory.db worker1 # [ 11.075871] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 10.943803] dhcpcd[699]: eth0: waiting for carrier worker1 # [ 10.944703] dhcpcd[699]: eth0: carrier acquired worker1 # [ 10.954537] dhcpcd[699]: DUID 00:01:00:01:32:45:21:3e:52:54:00:12:34:56 worker1 # [ 10.955570] dhcpcd[699]: eth0: IAID 00:12:34:56 worker1 # [ 10.956377] dhcpcd[699]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 11.252390] dhcpcd[699]: eth0: soliciting a DHCP lease lb # [ 11.294500] dhcpcd[718]: eth0: soliciting a DHCP lease worker1 # [ 11.412869] NET: Registered PF_PACKET protocol family lb # [ 11.443664] NET: Registered PF_PACKET protocol family worker1 # [ 11.287083] dhcpcd[699]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.292406] dhcpcd[699]: eth0: probing address 10.0.2.15/24 lb # [ 11.315691] dhcpcd[718]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 11.316661] dhcpcd[718]: eth0: probing address 10.0.2.15/24 worker2 # [ 11.562967] dhcpcd[695]: eth0: soliciting a DHCP lease worker2 # [ 11.724146] NET: Registered PF_PACKET protocol family worker2 # [ 11.595161] dhcpcd[695]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 11.600186] dhcpcd[695]: eth0: probing address 10.0.2.15/24 lb # [ 11.628723] postgresql-pre-start[730]: selecting default time zone ... UTC lb # [ 11.632056] postgresql-pre-start[730]: creating configuration files ... ok worker1: (finished: waiting for unit network-addresses-eth1.service, in 1.17 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 11.742716] dhcpcd[560]: eth0: soliciting an IPv6 router client # [ 11.744049] dhcpcd[560]: eth0: Router Advertisement from fe80::2 client # [ 11.744849] dhcpcd[560]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 11.745734] dhcpcd[560]: eth0: adding route to fec0::/64 client # [ 11.746552] dhcpcd[560]: eth0: adding default route via fe80::2 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 11.839957] postgresql-pre-start[730]: running bootstrap script ... ok worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service worker1 # [ 12.167853] dhcpcd[699]: eth0: soliciting an IPv6 router worker1 # [ 12.169359] dhcpcd[699]: eth0: Router Advertisement from fe80::2 worker1 # [ 12.170897] dhcpcd[699]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 12.173255] dhcpcd[699]: eth0: adding route to fec0::/64 worker1 # [ 12.175228] dhcpcd[699]: eth0: adding default route via fe80::2 lb # [ 12.380161] postgresql-pre-start[730]: performing post-bootstrap initialization ... ok lb # [ 12.494629] postgresql-pre-start[730]: syncing data to disk ... ok lb # [ 12.496383] postgresql-pre-start[730]: initdb: warning: enabling "trust" authentication for local connections lb # [ 12.497639] postgresql-pre-start[730]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 12.499524] postgresql-pre-start[730]: Success. You can now start the database server using: lb # [ 12.500512] postgresql-pre-start[730]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker2 # [ 12.492161] dhcpcd[695]: eth0: soliciting an IPv6 router worker2 # [ 12.494473] dhcpcd[695]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.497108] dhcpcd[695]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.499364] dhcpcd[695]: eth0: adding route to fec0::/64 worker2 # [ 12.501327] dhcpcd[695]: eth0: adding default route via fe80::2 lb # [ 12.576714] dhcpcd[718]: eth0: soliciting an IPv6 router lb # [ 12.577959] dhcpcd[718]: eth0: Router Advertisement from fe80::2 lb # [ 12.578817] dhcpcd[718]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.579876] dhcpcd[718]: eth0: adding route to fec0::/64 lb # [ 12.580738] dhcpcd[718]: eth0: adding default route via fe80::2 lb # [ 12.610913] postgres[782]: [782] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 12.614603] postgres[782]: [782] LOG: listening on IPv6 address "::1", port 5432 lb # [ 12.615686] postgres[782]: [782] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 12.617989] postgres[782]: [782] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 12.629256] postgres[791]: [791] LOG: database system was shut down at 2026-09-22 11:21:35 GMT lb # [ 12.634929] postgres[782]: [782] LOG: database system is ready to accept connections lb # [ 12.642097] systemd[1]: Started PostgreSQL Server. lb # [ 12.646442] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 12.828139] postgresql-setup-start[802]: CREATE DATABASE lb # [ 12.870490] postgresql-setup-start[807]: CREATE ROLE lb # [ 12.891044] postgresql-setup-start[809]: ALTER DATABASE lb # [ 12.896494] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 12.898290] systemd[1]: Reached target PostgreSQL. lb # [ 15.359323] dhcpcd[718]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 15.362118] dhcpcd[718]: eth0: adding route to 10.0.2.0/24 lb # [ 15.364388] dhcpcd[718]: eth0: adding default route via 10.0.2.2 lb # [ 15.490407] systemd[1]: Started DHCP Client. lb # [ 15.491925] systemd[1]: Reached target Network is Online. lb # [ 15.496329] systemd[1]: Started Envoy reverse proxy. lb # [ 15.500584] systemd[1]: Started mock-oidc.service. lb # [ 15.632446] mock-oidc-server[900]: Mock OIDC Server running lb # [ 15.633502] mock-oidc-server[900]: OIDC Address: 192.168.1.2:8080 lb # [ 15.634798] mock-oidc-server[900]: Issue Address: 0.0.0.0:8081 lb # [ 15.635729] mock-oidc-server[900]: Issuer: http://192.168.1.2:8080/oidc lb # [ 15.636726] mock-oidc-server[900]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 15.637907] mock-oidc-server[900]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 15.639319] mock-oidc-server[900]: Issue tokens: http://0.0.0.0:8081/issue?sub=... client # [ 15.926832] dhcpcd[560]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 15.929893] dhcpcd[560]: eth0: adding route to 10.0.2.0/24 client # [ 15.932126] dhcpcd[560]: eth0: adding default route via 10.0.2.2 client # [ 16.050654] systemd[1]: Started DHCP Client. client # [ 16.052707] systemd[1]: Reached target Multi-User System. client # [ 16.053708] systemd[1]: Startup finished in 845ms (kernel) + 4.006s (initrd) + 11.201s (userspace) = 16.053s. worker1 # [ 16.251074] dhcpcd[699]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 16.254172] dhcpcd[699]: eth0: adding route to 10.0.2.0/24 worker1 # [ 16.256506] dhcpcd[699]: eth0: adding default route via 10.0.2.2 lb # [ 16.300324] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 16.302043] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 16.303367] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 16.305850] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 16.308573] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 16.311334] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 16.314335] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 16.316373] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 16.317989] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 16.319500] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 16.321065] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.323357] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 16.325611] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 16.327414] envoy[899]: [2026-09-22 11:21:39.714][899][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 16.329122] envoy[899]: [2026-09-22 11:21:39.715][899][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 16.346278] envoy[899]: [2026-09-22 11:21:39.715][899][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 16.347902] envoy[899]: [2026-09-22 11:21:39.720][899][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 16.349527] envoy[899]: [2026-09-22 11:21:39.720][899][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 16.351260] envoy[899]: [2026-09-22 11:21:39.720][899][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 16.357198] envoy[899]: [2026-09-22 11:21:39.720][899][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 16.358804] envoy[899]: [2026-09-22 11:21:39.720][899][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 16.361333] envoy[899]: [2026-09-22 11:21:39.720][899][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 16.363028] envoy[899]: [2026-09-22 11:21:39.720][899][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 16.365044] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.366864] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 16.368614] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 16.372650] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 16.374548] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 16.376401] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 16.378883] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 16.380678] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 16.382611] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 16.386545] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 16.388457] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 16.390795] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 16.392421] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 16.395096] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 16.397223] envoy[899]: [2026-09-22 11:21:39.723][899][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 16.398906] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 16.401794] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction worker1 # [ 16.384759] systemd[1]: Started DHCP Client. lb # [ 16.405791] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config worker1 # [ 16.386800] systemd[1]: Reached target Multi-User System. worker1 # [ 16.387628] systemd[1]: Startup finished in 861ms (kernel) + 4.987s (initrd) + 10.537s (userspace) = 16.386s. lb # [ 16.409058] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 16.411411] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 16.413514] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 16.416898] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 16.418637] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 16.420363] envoy[899]: [2026-09-22 11:21:39.726][899][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 16.426518] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 16.428747] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 16.435603] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 16.437892] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 16.442263] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 16.445087] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 16.447561] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 16.452262] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.454299] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 16.456077] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 16.457778] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 16.460490] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 16.463369] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 16.466061] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 16.467874] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 16.473695] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 16.475342] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 16.479229] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 16.481092] envoy[899]: [2026-09-22 11:21:39.729][899][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 16.483890] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 16.489951] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 16.492327] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 16.493975] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 16.498081] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 16.499728] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 16.501900] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 16.503666] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 16.505246] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 16.507089] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.509518] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 16.514869] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 16.516658] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 16.519898] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 16.545326] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 16.547739] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 16.550317] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 16.561529] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 16.563188] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 16.565404] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 16.567882] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 16.570674] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 16.573746] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 16.576200] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 16.578070] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 16.580458] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 16.584107] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 16.587735] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 16.593218] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 16.595768] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 16.598320] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 16.600488] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 16.602494] envoy[899]: [2026-09-22 11:21:39.731][899][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 16.604816] envoy[899]: [2026-09-22 11:21:39.753][899][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 16.607498] envoy[899]: [2026-09-22 11:21:39.753][899][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 16.611782] envoy[899]: [2026-09-22 11:21:39.753][899][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 16.614623] envoy[899]: [2026-09-22 11:21:39.753][899][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 16.620102] envoy[899]: [2026-09-22 11:21:39.753][899][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 16.621831] envoy[899]: [2026-09-22 11:21:39.753][899][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 16.623967] envoy[899]: [2026-09-22 11:21:39.753][899][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 16.625510] envoy[899]: [2026-09-22 11:21:39.916][899][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 16.626909] envoy[899]: [2026-09-22 11:21:39.988][899][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 16.639770] envoy[899]: [2026-09-22 11:21:39.988][899][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 16.641272] envoy[899]: [2026-09-22 11:21:39.988][899][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 16.648610] envoy[899]: [2026-09-22 11:21:39.988][899][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 16.688728] envoy[899]: [2026-09-22 11:21:40.103][899][info][main] [source/server/server.cc:968] runtime: {} lb # [ 16.695787] envoy[899]: [2026-09-22 11:21:40.110][899][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 16.697901] envoy[899]: [2026-09-22 11:21:40.112][899][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 16.700768] envoy[899]: [2026-09-22 11:21:40.115][899][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 16.704156] envoy[899]: [2026-09-22 11:21:40.119][899][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 16.705751] envoy[899]: [2026-09-22 11:21:40.120][899][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 16.707401] envoy[899]: [2026-09-22 11:21:40.120][899][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 16.767532] envoy[899]: [2026-09-22 11:21:40.182][899][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 16.748775] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 16.789925] envoy[899]: [2026-09-22 11:21:40.204][899][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 16.792193] envoy[899]: [2026-09-22 11:21:40.207][899][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 16.794993] envoy[899]: [2026-09-22 11:21:40.207][899][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 16.925263] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 16.927930] dhcpcd[695]: eth0: adding route to 10.0.2.0/24 worker2 # [ 16.930209] dhcpcd[695]: eth0: adding default route via 10.0.2.2 worker1 # [ 16.973708] nix-grpc-daemon[786]: ts=2026-09-22T11:21:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 16.983226] nix-grpc-daemon[786]: ts=2026-09-22T11:21:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 16.988288] nix-grpc-daemon[786]: ts=2026-09-22T11:21:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 17.026623] nix-grpc-daemon[786]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 17.028100] nix-grpc-daemon[786]: E0000 00:00:1790076100.257731 786 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.041610] systemd[1]: Started DHCP Client. worker2 # [ 17.043051] systemd[1]: Reached target Multi-User System. worker2 # [ 17.045309] systemd[1]: Reached target Network is Online. worker2 # [ 17.047682] systemd[1]: Starting scheduler-token.service... worker1 # [ 17.044520] nix-grpc-daemon[786]: E0000 00:00:1790076100.277010 786 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 17.048287] nix-grpc-daemon[786]: ts=2026-09-22T11:21:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 17.051139] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 17.078859] nix-grpc-daemon[786]: E0000 00:00:1790076100.311351 828 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 17.100270] nix-grpc-daemon[786]: E0000 00:00:1790076100.332560 828 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 17.104067] nix-grpc-daemon[786]: E0000 00:00:1790076100.336335 828 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.138119] envoy[899]: [2026-09-22 11:21:40.552][899][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker2 # [ 17.132069] systemd[1]: scheduler-token.service: Deactivated successfully. worker1 # [ 17.119897] nix-grpc-daemon[786]: E0000 00:00:1790076100.352359 828 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.133724] systemd[1]: Finished scheduler-token.service. lb # [ 17.142396] envoy[899]: [2026-09-22 11:21:40.557][899][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 17.135487] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 85ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb # [ 17.147140] envoy[899]: [2026-09-22 11:21:40.557][899][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 17.140198] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 17.131747] nix-grpc-daemon[786]: ts=2026-09-22T11:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 17.157420] envoy[899]: [2026-09-22 11:21:40.572][899][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 17.327712] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 17.337608] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 17.343377] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 17.332718] nix-grpc-daemon[786]: ts=2026-09-22T11:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 17.377933] nix-grpc-daemon[789]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 17.379311] nix-grpc-daemon[789]: E0000 00:00:1790076101.447235 789 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.394451] nix-grpc-daemon[789]: E0000 00:00:1790076101.464910 789 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.398138] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 17.400819] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 17.402850] systemd[1]: Startup finished in 862ms (kernel) + 4.043s (initrd) + 12.495s (userspace) = 17.402s. worker2 # [ 17.447092] nix-grpc-daemon[789]: E0000 00:00:1790076101.517084 830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.461932] nix-grpc-daemon[789]: E0000 00:00:1790076101.532370 830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.465148] nix-grpc-daemon[789]: E0000 00:00:1790076101.535611 830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.478374] nix-grpc-daemon[789]: E0000 00:00:1790076101.548818 830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.504858] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.516444] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.718933] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.722938] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.733282] nix-grpc-daemon[786]: ts=2026-09-22T11:21:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 17.924058] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.927818] nix-grpc-daemon[789]: ts=2026-09-22T11:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.129465] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.133172] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.334993] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.338677] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.540267] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.544080] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.537897] nix-grpc-daemon[786]: ts=2026-09-22T11:21:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.542498] nix-grpc-daemon[786]: ts=2026-09-22T11:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.745133] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.748826] nix-grpc-daemon[789]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.743472] nix-grpc-daemon[786]: ts=2026-09-22T11:21:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.747300] nix-grpc-daemon[786]: ts=2026-09-22T11:21:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.949952] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.954133] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.948236] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.952322] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.155243] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.159071] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.156788] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.160603] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.361168] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.364848] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.361493] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.365333] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.566132] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.569853] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.567620] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.570706] nix-grpc-daemon[786]: ts=2026-09-22T11:21:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.771315] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.775155] nix-grpc-daemon[789]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.768762] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.772532] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.976247] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.980593] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.973432] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.977258] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.182056] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.186939] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.177968] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.181719] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.389276] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.382585] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.393673] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.386442] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.595249] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.599100] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.588428] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.591437] nix-grpc-daemon[786]: ts=2026-09-22T11:21:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.799675] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.801538] nix-grpc-daemon[789]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.788841] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.792646] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.002895] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.994401] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.006826] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.997682] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.195338] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.208570] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.199291] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.211706] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.411120] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.400674] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.414289] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.403750] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.612350] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.602892] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.616411] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.605904] nix-grpc-daemon[786]: ts=2026-09-22T11:21:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.803460] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.817557] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.807356] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.821126] nix-grpc-daemon[789]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.008114] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.010842] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.022725] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.025780] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.211878] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.224219] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.215960] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.227840] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.427281] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.416645] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.430457] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.420815] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.628621] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.632461] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.622731] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.627439] nix-grpc-daemon[786]: ts=2026-09-22T11:21:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.833585] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.837598] nix-grpc-daemon[789]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.827947] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.831858] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.038347] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.042122] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.032866] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.036952] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.243163] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.247121] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.237996] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.241923] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.449855] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.442862] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.454702] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.446733] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.655166] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.648794] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.659499] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.651919] nix-grpc-daemon[786]: ts=2026-09-22T11:21:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.849178] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.860755] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.851115] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.864686] nix-grpc-daemon[789]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.051986] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.065675] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.056698] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.069525] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.256992] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.258659] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.270719] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.274467] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.459568] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.475133] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.463469] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.476936] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.665824] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.677797] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.669081] nix-grpc-daemon[786]: ts=2026-09-22T11:21:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.682090] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.866643] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.870494] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.883432] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.887077] nix-grpc-daemon[789]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.071336] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.075111] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.088324] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.092063] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.275887] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.280126] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.293074] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.297366] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.481213] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.495934] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.485186] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.499276] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.683755] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.696544] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.687689] nix-grpc-daemon[786]: ts=2026-09-22T11:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.700259] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.888688] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.901374] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.892657] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.905286] nix-grpc-daemon[789]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.105857] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.093426] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.107574] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.097516] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.309218] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.298440] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.313178] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.302473] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.513789] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.515508] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.503178] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.507126] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.717066] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.709408] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.720762] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.712418] nix-grpc-daemon[786]: ts=2026-09-22T11:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.921283] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.922955] nix-grpc-daemon[789]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.909555] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.913151] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.124329] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.113858] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.128178] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.117693] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.328985] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.318645] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.332846] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.322503] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.535237] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.523396] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.538371] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.527347] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.736253] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.739995] nix-grpc-daemon[789]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.729651] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.732721] nix-grpc-daemon[786]: ts=2026-09-22T11:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.941234] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.930400] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.945107] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.934327] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.134735] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.146224] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.149987] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.138602] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.350800] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.339741] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.354723] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.343617] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.544504] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.556456] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.548307] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.560375] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.749871] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.761543] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.753721] nix-grpc-daemon[786]: ts=2026-09-22T11:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.765490] nix-grpc-daemon[789]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.954599] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.966600] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.958710] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.970535] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.159727] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.172366] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.163723] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.175534] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.373781] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.364961] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.377560] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.368187] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.566168] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.579490] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.569981] nix-grpc-daemon[786]: ts=2026-09-22T11:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.583098] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.771704] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.784375] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.775571] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.788173] nix-grpc-daemon[789]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.939819] rustfs-bucket-start[1038]: mb s3://farm lb # [ 29.944741] systemd[1]: Finished rustfs-bucket.service. lb # [ 29.951443] systemd[1]: Starting niks3 server... worker1 # [ 29.976527] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.989603] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.980492] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.993404] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.174330] postgres[1054]: [1054] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 30.175546] postgres[1054]: [1054] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker2 # [ 30.191606] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.181097] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.195548] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.184848] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.221357] niks3-server[1047]: 2026/09/22 11:21:53 OK 20241026095416_initial_model.sql (27.84ms) lb # [ 30.225937] niks3-server[1047]: 2026/09/22 11:21:53 OK 20251210153512_drop_unused_gin_index.sql (3.3ms) lb # [ 30.232188] niks3-server[1047]: 2026/09/22 11:21:53 OK 20251218171726_add_pins.sql (5.02ms) lb # [ 30.239559] niks3-server[1047]: 2026/09/22 11:21:53 OK 20260628120000_add_object_size_and_stats.sql (6.13ms) lb # [ 30.244463] niks3-server[1047]: 2026/09/22 11:21:53 OK 20260905000000_add_claims.sql (4.76ms) lb # [ 30.248972] niks3-server[1047]: 2026/09/22 11:21:53 OK 20260920000000_drop_claims.sql (4.43ms) lb # [ 30.250502] niks3-server[1047]: 2026/09/22 11:21:53 goose: successfully migrated database to version: 20260920000000 lb # [ 30.258117] niks3-server[1047]: 2026/09/22 11:21:53 OK 1_commit_pending_closure.sql (6.13ms) lb # [ 30.261238] niks3-server[1047]: 2026/09/22 11:21:53 OK 2_object_stats_trigger.sql (3.12ms) lb # [ 30.262482] niks3-server[1047]: 2026/09/22 11:21:53 goose: up to current file version: 2 lb # [ 30.270680] niks3-server[1047]: 2026/09/22 11:21:53 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key lb # [ 30.341329] niks3-server[1047]: 2026/09/22 11:21:53 INFO Read proxy enabled — serving cache objects from S3 lb # [ 30.342988] niks3-server[1047]: 2026/09/22 11:21:53 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 30.346204] niks3-server[1047]: 2026/09/22 11:21:53 INFO systemd watchdog enabled interval=15s lb # [ 30.348067] systemd[1]: Started niks3 server. lb # [ 30.350605] systemd[1]: Reached target Multi-User System. lb # [ 30.351674] niks3-server[1047]: 2026/09/22 11:21:53 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 30.353495] systemd[1]: Startup finished in 858ms (kernel) + 4.051s (initrd) + 25.442s (userspace) = 30.352s. worker2 # [ 30.396707] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.386264] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.400572] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.389409] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.587468] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.601686] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.603103] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.591389] nix-grpc-daemon[786]: ts=2026-09-22T11:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.803257] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.793652] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.807391] nix-grpc-daemon[789]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.796786] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.994036] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.995861] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.008635] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.012632] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.196410] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.198089] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.213439] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.215320] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 19.52 seconds) lb: waiting for TCP port 5751 on localhost worker1 # [ 31.398548] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.400326] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.415924] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.417680] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.05 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 31.528364] envoy[899]: conn peer=[::1]:41492 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds) worker2 # [ 31.606402] systemd[1]: Starting scheduler-token.service... worker1 # [ 31.601403] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.604564] nix-grpc-daemon[786]: ts=2026-09-22T11:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.618753] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.620385] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.677533] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 31.679322] systemd[1]: Finished scheduler-token.service. worker2 # [ 31.682238] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 73ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.08 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 31.806699] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.809740] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.822266] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.825410] nix-grpc-daemon[789]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.007211] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.010985] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.024149] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.027860] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.211793] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.215602] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.229528] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.233322] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.416516] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.420412] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.432650] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.435740] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.621239] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.635350] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.625145] nix-grpc-daemon[786]: ts=2026-09-22T11:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.638515] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 32.836570] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.826751] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.840444] nix-grpc-daemon[789]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.830531] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2 # [ 33.041721] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.031565] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.046353] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.035461] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.236214] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.247972] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.240109] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.252538] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.453462] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.440807] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.455206] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.444856] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.656640] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.658353] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.645769] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.650473] nix-grpc-daemon[786]: ts=2026-09-22T11:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.859435] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.861243] nix-grpc-daemon[789]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.851786] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.855288] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2 # [ 34.062652] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.066434] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.056205] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.060323] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.267796] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.271757] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.261185] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.264824] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.472666] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.465309] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.476452] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.466998] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.667539] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.678732] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.669390] nix-grpc-daemon[786]: ts=2026-09-22T11:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.682437] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.871519] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.884526] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.874784] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.887613] nix-grpc-daemon[789]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 35.075148] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.086076] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.076791] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.090169] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.277694] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.291977] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.281616] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.295393] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.481982] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.493269] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.483664] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.497240] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.684260] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.686122] nix-grpc-daemon[786]: ts=2026-09-22T11:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.698156] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.699925] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.886950] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.888712] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.901450] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.905228] nix-grpc-daemon[789]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 36.089231] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.103802] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.093234] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.107596] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.293943] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.306110] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.297968] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.310061] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.498707] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.511125] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.514897] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.503841] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.703484] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.717668] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.707505] nix-grpc-daemon[786]: ts=2026-09-22T11:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.720807] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.918705] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.909798] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.922618] nix-grpc-daemon[789]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.912905] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 37.110266] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.123856] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.114104] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.127809] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.314787] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.329214] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.318604] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.332921] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.519461] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.531348] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.523342] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.535297] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.724346] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.737548] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.728206] nix-grpc-daemon[786]: ts=2026-09-22T11:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.741188] nix-grpc-daemon[789]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.930452] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.942894] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.933916] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.946745] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 38.131769] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.145486] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.135840] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.149423] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 38.336232] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.347640] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.338281] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.351604] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.538833] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.540576] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.552944] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.556917] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.741164] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.742928] nix-grpc-daemon[786]: ts=2026-09-22T11:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.756655] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.759745] nix-grpc-daemon[789]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.943988] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.945965] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.957529] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.960713] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.146375] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.148258] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.162122] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.166319] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 39.348869] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.350634] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.368227] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.371541] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.551142] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.552954] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.569709] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.573641] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.753343] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.755087] nix-grpc-daemon[786]: ts=2026-09-22T11:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.776261] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.779465] nix-grpc-daemon[789]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.956076] nix-grpc-daemon[786]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.957767] nix-grpc-daemon[786]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.977352] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.981350] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.158504] nix-grpc-daemon[786]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.162386] nix-grpc-daemon[786]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.182691] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.186520] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 40.354329] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_take_over lb # [ 40.364622] niks3-server[1047]: 2026/09/22 11:22:03 INFO lead: acquired remote=192.168.1.4:41544 worker1 # [ 40.363155] nix-grpc-daemon[786]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.366871] nix-grpc-daemon[786]: ts=2026-09-22T11:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.387584] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.391355] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.567714] nix-grpc-daemon[786]: ts=2026-09-22T11:22:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.590780] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36240 worker2 # [ 40.593481] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.595210] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 40.607171] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 40.609672] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36240 worker2 # [ 40.611487] nix-grpc-daemon[789]: ts=2026-09-22T11:22:04Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.34 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 42.468479] nix-grpc-daemon[789]: ts=2026-09-22T11:22:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 42.483259] systemd[1]: Started Nix Daemon. worker2 # [ 42.678311] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 42.703141] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5) worker2 # [ 42.742685] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 2/5) worker2 # [ 42.873725] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 3/5) worker2 # [ 42.909815] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 239 ms (attempt 4/5) worker2 # [ 43.159451] nix-grpc-daemon[789]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 43.164279] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 43.203770] nix-grpc-daemon[789]: ts=2026-09-22T11:22:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 43.222767] nix-grpc-daemon[789]: ts=2026-09-22T11:22:07Z level=debug event=path_info_miss path=d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test error="error: path '/nix/store/d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 43.228778] nix-grpc-daemon[786]: ts=2026-09-22T11:22:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 43.238661] systemd[1]: Started Nix Daemon. worker1 # [ 43.432750] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 43.458077] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5) worker1 # [ 43.555279] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 2/5) worker1 # [ 43.560307] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 3/5) worker1 # [ 43.592752] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 571 ms (attempt 4/5) worker1 # [ 44.174213] nix-grpc-daemon[786]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 44.178957] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 44.198331] nix-grpc-daemon[786]: ts=2026-09-22T11:22:07Z level=debug event=path_info_miss path=d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test error="error: path '/nix/store/d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds) client: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds) worker1 # [ 44.585440] nix-grpc-daemon[786]: ts=2026-09-22T11:22:07Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 44.588933] nix-grpc-daemon[786]: ts=2026-09-22T11:22:07Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36134 worker2 # [ 44.616710] nix-grpc-daemon[789]: ts=2026-09-22T11:22:08Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36244 worker2 # [ 44.620482] nix-grpc-daemon[789]: ts=2026-09-22T11:22:08Z level=debug event=path_info_miss path=d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test error="error: path '/nix/store/d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 44.612076] nix-grpc-daemon[786]: ts=2026-09-22T11:22:07Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36134 worker1 # [ 44.621225] nix-grpc-daemon[786]: ts=2026-09-22T11:22:07Z level=debug event=path_info_miss path=d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test error="error: path '/nix/store/d0yzpmy03dgjykw182nqn9rx9qp34ayl-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker2 # [ 44.910392] nix-grpc-daemon[789]: ts=2026-09-22T11:22:08Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 45.134639] nix-grpc-daemon[786]: ts=2026-09-22T11:22:08Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.06 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker2 # [ 45.413981] nix-grpc-daemon[789]: ts=2026-09-22T11:22:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36244 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 45.417888] nix-grpc-daemon[786]: ts=2026-09-22T11:22:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 45.464284] nix-grpc-daemon[789]: ts=2026-09-22T11:22:09Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 45.469442] nix-grpc-daemon[789]: ts=2026-09-22T11:22:09Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 45.510804] nix-grpc-daemon[786]: ts=2026-09-22T11:22:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 45.531545] nix-grpc-daemon[786]: ts=2026-09-22T11:22:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 client # copying 1 paths to 'lb:50051'... worker1 # [ 45.544775] nix-grpc-daemon[786]: ts=2026-09-22T11:22:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 45.571378] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 45.598541] nix-grpc-daemon[786]: ts=2026-09-22T11:22:08Z level=info event=niks3_push_started pid=867 worker1 # [ 45.864636] nix-grpc-daemon[867]: time=2026-09-22T11:22:09.093Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 46.048603] nix-daemon[855]: accepted connection from pid 879, user nix-grpc-daemon (trusted) worker1 # [ 46.063677] nix-daemon[855]: reaped child process 882, status = succeeded worker1 # [ 46.197946] nix-daemon[855]: accepted connection from pid 884, user nix-grpc-daemon (trusted) worker1 # [ 46.209562] nix-daemon[855]: reaped child process 887, status = succeeded lb # [ 46.242485] niks3-server[1047]: 2026/09/22 11:22:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.245045] nix-grpc-daemon[867]: time=2026-09-22T11:22:09.477Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 46.247157] nix-grpc-daemon[867]: time=2026-09-22T11:22:09.479Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 46.310518] niks3-server[1047]: 2026/09/22 11:22:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 46.314588] niks3-server[1047]: 2026/09/22 11:22:09 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 46.332141] niks3-server[1047]: 2026/09/22 11:22:09 INFO Signed narinfos id=1 count=1 worker1 # [ 46.312224] nix-grpc-daemon[867]: time=2026-09-22T11:22:09.544Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.343068] niks3-server[1047]: 2026/09/22 11:22:09 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 46.345799] niks3-server[1047]: 2026/09/22 11:22:09 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 46.353810] niks3-server[1047]: 2026/09/22 11:22:09 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 46.359642] niks3-server[1047]: 2026/09/22 11:22:09 INFO Completed upload id=1 worker1 # [ 46.338046] nix-grpc-daemon[867]: time=2026-09-22T11:22:09.570Z level=INFO msg="Upload complete. (459ms)" worker1 # [ 46.340190] nix-grpc-daemon[786]: ts=2026-09-22T11:22:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 46.346674] nix-grpc-daemon[786]: ts=2026-09-22T11:22:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 46.351569] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 46.352845] nix-daemon[855]: reaped child process 865, status = succeeded worker1 # [ 46.358113] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 46.777913] envoy[899]: conn peer=[2001:db8:1::1]:59188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=422 ms=1801 lb # [ 46.781648] envoy[899]: conn peer=[2001:db8:1::1]:36180 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=363 ms=57 lb # [ 46.784960] envoy[899]: conn peer=[2001:db8:1::1]:36184 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=11 lb # [ 46.788324] envoy[899]: conn peer=[2001:db8:1::1]:36190 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 worker1 # [ 47.083786] nix-grpc-daemon[786]: E0000 00:00:1790076130.314545 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 47.114135] nix-grpc-daemon[786]: E0000 00:00:1790076130.345906 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 47.121325] nix-grpc-daemon[786]: E0000 00:00:1790076130.352342 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 47.144321] nix-grpc-daemon[786]: E0000 00:00:1790076130.376765 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 48.185409] nix-daemon[855]: reaped child process 891, status = succeeded worker1 # [ 48.324510] nix-daemon[855]: accepted connection from pid 907, user nix-grpc-daemon (trusted) worker1 # [ 48.335887] nix-daemon[855]: reaped child process 910, status = succeeded lb # [ 48.370201] niks3-server[1047]: 2026/09/22 11:22:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.358122] nix-grpc-daemon[867]: time=2026-09-22T11:22:11.590Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.359738] nix-grpc-daemon[867]: time=2026-09-22T11:22:11.592Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 48.416561] niks3-server[1047]: 2026/09/22 11:22:11 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 48.425291] niks3-server[1047]: 2026/09/22 11:22:11 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 48.433252] niks3-server[1047]: 2026/09/22 11:22:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 48.440138] niks3-server[1047]: 2026/09/22 11:22:11 INFO Signed narinfos id=2 count=1 worker1 # [ 48.421377] nix-grpc-daemon[867]: time=2026-09-22T11:22:11.653Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.442851] niks3-server[1047]: 2026/09/22 11:22:11 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 48.453991] niks3-server[1047]: 2026/09/22 11:22:11 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 48.460860] niks3-server[1047]: 2026/09/22 11:22:11 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 48.464111] niks3-server[1047]: 2026/09/22 11:22:11 INFO Completed upload id=2 worker1 # [ 48.442770] nix-grpc-daemon[867]: time=2026-09-22T11:22:11.675Z level=INFO msg="Upload complete. (273ms)" worker1 # [ 48.450285] nix-grpc-daemon[786]: ts=2026-09-22T11:22:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 48.462542] nix-daemon[855]: reaped child process 889, status = succeeded worker2 # [ 48.479658] nix-grpc-daemon[789]: ts=2026-09-22T11:22:12Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 48.484719] nix-grpc-daemon[789]: ts=2026-09-22T11:22:12Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 48.511800] nix-grpc-daemon[786]: ts=2026-09-22T11:22:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 48.528785] nix-grpc-daemon[786]: ts=2026-09-22T11:22:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 48.541472] nix-grpc-daemon[867]: time=2026-09-22T11:22:11.773Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 48.549780] nix-grpc-daemon[786]: ts=2026-09-22T11:22:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 48.567599] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 48.743841] nix-daemon[855]: accepted connection from pid 914, user nix-grpc-daemon (trusted) worker1 # [ 48.756645] nix-daemon[855]: reaped child process 917, status = succeeded worker1 # [ 48.898985] nix-daemon[855]: accepted connection from pid 920, user nix-grpc-daemon (trusted) worker1 # [ 48.910493] nix-daemon[855]: reaped child process 923, status = succeeded lb # [ 48.947524] niks3-server[1047]: 2026/09/22 11:22:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.935994] nix-grpc-daemon[867]: time=2026-09-22T11:22:12.168Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 48.938174] nix-grpc-daemon[867]: time=2026-09-22T11:22:12.170Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 48.976869] niks3-server[1047]: 2026/09/22 11:22:12 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 48.987608] niks3-server[1047]: 2026/09/22 11:22:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 48.992107] niks3-server[1047]: 2026/09/22 11:22:12 INFO Signed narinfos id=3 count=1 worker1 # [ 48.973497] nix-grpc-daemon[867]: time=2026-09-22T11:22:12.205Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.005791] niks3-server[1047]: 2026/09/22 11:22:12 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 49.012595] niks3-server[1047]: 2026/09/22 11:22:12 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 49.017745] niks3-server[1047]: 2026/09/22 11:22:12 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo lb # [ 49.023448] niks3-server[1047]: 2026/09/22 11:22:12 INFO Completed upload id=3 worker1 # [ 49.002218] nix-grpc-daemon[867]: time=2026-09-22T11:22:12.234Z level=INFO msg="Upload complete. (419ms)" worker1 # [ 49.007588] nix-grpc-daemon[786]: ts=2026-09-22T11:22:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 49.014314] nix-grpc-daemon[786]: ts=2026-09-22T11:22:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 49.025105] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 49.032218] nix-daemon[855]: reaped child process 912, status = succeeded worker1 # [ 49.037258] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 50.451151] nix-daemon[855]: reaped child process 927, status = succeeded worker1 # [ 50.581598] nix-daemon[855]: accepted connection from pid 943, user nix-grpc-daemon (trusted) worker1 # [ 50.593588] nix-daemon[855]: reaped child process 946, status = succeeded lb # [ 50.632757] niks3-server[1047]: 2026/09/22 11:22:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.617567] nix-grpc-daemon[867]: time=2026-09-22T11:22:13.849Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 50.619043] nix-grpc-daemon[867]: time=2026-09-22T11:22:13.851Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 50.661741] niks3-server[1047]: 2026/09/22 11:22:14 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 50.675901] niks3-server[1047]: 2026/09/22 11:22:14 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 50.685119] niks3-server[1047]: 2026/09/22 11:22:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 50.691277] niks3-server[1047]: 2026/09/22 11:22:14 INFO Signed narinfos id=4 count=1 worker1 # [ 50.672260] nix-grpc-daemon[867]: time=2026-09-22T11:22:13.904Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.701125] niks3-server[1047]: 2026/09/22 11:22:14 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 50.706472] niks3-server[1047]: 2026/09/22 11:22:14 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 50.713727] niks3-server[1047]: 2026/09/22 11:22:14 INFO Completed upload id=4 worker1 # [ 50.692301] nix-grpc-daemon[867]: time=2026-09-22T11:22:13.924Z level=INFO msg="Upload complete. (247ms)" lb # [ 50.715314] niks3-server[1047]: 2026/09/22 11:22:14 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 50.697921] nix-grpc-daemon[786]: ts=2026-09-22T11:22:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 50.717840] nix-grpc-daemon[789]: ts=2026-09-22T11:22:14Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker1 # [ 50.712421] nix-daemon[855]: reaped child process 925, status = succeeded worker2 # [ 50.721909] nix-grpc-daemon[789]: ts=2026-09-22T11:22:14Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 50.750279] nix-grpc-daemon[786]: ts=2026-09-22T11:22:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 50.762445] nix-grpc-daemon[786]: ts=2026-09-22T11:22:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 50.775523] nix-grpc-daemon[867]: time=2026-09-22T11:22:14.007Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 50.784180] nix-grpc-daemon[786]: ts=2026-09-22T11:22:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 50.803159] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 50.942896] nix-daemon[855]: accepted connection from pid 950, user nix-grpc-daemon (trusted) worker1 # [ 50.954785] nix-daemon[855]: reaped child process 953, status = succeeded worker1 # [ 51.079615] nix-daemon[855]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker1 # [ 51.091711] nix-daemon[855]: reaped child process 958, status = succeeded lb # [ 51.128341] niks3-server[1047]: 2026/09/22 11:22:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.115065] nix-grpc-daemon[867]: time=2026-09-22T11:22:14.347Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 51.116553] nix-grpc-daemon[867]: time=2026-09-22T11:22:14.349Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 51.156516] niks3-server[1047]: 2026/09/22 11:22:14 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 51.168631] niks3-server[1047]: 2026/09/22 11:22:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 51.175718] niks3-server[1047]: 2026/09/22 11:22:14 INFO Signed narinfos id=5 count=1 worker1 # [ 51.157413] nix-grpc-daemon[867]: time=2026-09-22T11:22:14.389Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.179281] niks3-server[1047]: 2026/09/22 11:22:14 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 51.193804] niks3-server[1047]: 2026/09/22 11:22:14 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 51.201609] niks3-server[1047]: 2026/09/22 11:22:14 INFO Completed upload id=5 worker1 # [ 51.179821] nix-grpc-daemon[867]: time=2026-09-22T11:22:14.412Z level=INFO msg="Upload complete. (364ms)" lb # [ 51.204645] niks3-server[1047]: 2026/09/22 11:22:14 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 51.183674] nix-grpc-daemon[786]: ts=2026-09-22T11:22:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 51.189529] nix-grpc-daemon[786]: ts=2026-09-22T11:22:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 51.197890] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 51.202741] nix-daemon[855]: reaped child process 948, status = succeeded worker1 # [ 51.207772] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 52.835284] nix-daemon[855]: reaped child process 962, status = succeeded worker1 # [ 52.970754] nix-daemon[855]: accepted connection from pid 978, user nix-grpc-daemon (trusted) worker1 # [ 52.982856] nix-daemon[855]: reaped child process 981, status = succeeded lb # [ 53.015578] niks3-server[1047]: 2026/09/22 11:22:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.008257] nix-grpc-daemon[867]: time=2026-09-22T11:22:16.240Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 53.009834] nix-grpc-daemon[867]: time=2026-09-22T11:22:16.242Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 53.058771] niks3-server[1047]: 2026/09/22 11:22:16 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 53.066352] niks3-server[1047]: 2026/09/22 11:22:16 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 53.076584] niks3-server[1047]: 2026/09/22 11:22:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 53.060065] nix-grpc-daemon[867]: time=2026-09-22T11:22:16.292Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.081584] niks3-server[1047]: 2026/09/22 11:22:16 INFO Signed narinfos id=6 count=1 lb # [ 53.087392] niks3-server[1047]: 2026/09/22 11:22:16 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 53.095528] niks3-server[1047]: 2026/09/22 11:22:16 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 53.102234] niks3-server[1047]: 2026/09/22 11:22:16 INFO Completed upload id=6 worker1 # [ 53.080833] nix-grpc-daemon[867]: time=2026-09-22T11:22:16.313Z level=INFO msg="Upload complete. (264ms)" lb # [ 53.105099] niks3-server[1047]: 2026/09/22 11:22:16 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 53.087732] nix-grpc-daemon[786]: ts=2026-09-22T11:22:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 53.101108] nix-daemon[855]: reaped child process 960, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 7.98 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.21 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.53 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker1 # [ 54.384446] nix-grpc-daemon[786]: ts=2026-09-22T11:22:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36134 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # [ 54.415797] nix-grpc-daemon[789]: ts=2026-09-22T11:22:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 54.443506] nix-grpc-daemon[789]: ts=2026-09-22T11:22:18Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.30 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.20 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 55.224840] nix-grpc-daemon[789]: ts=2026-09-22T11:22:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36244 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 55.221955] nix-grpc-daemon[786]: ts=2026-09-22T11:22:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 55.231145] nix-grpc-daemon[867]: time=2026-09-22T11:22:18.463Z level=INFO msg="All 2 paths already cached" worker2 # [ 55.256507] nix-grpc-daemon[789]: ts=2026-09-22T11:22:19Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 55.260894] nix-grpc-daemon[789]: ts=2026-09-22T11:22:19Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 55.289551] nix-grpc-daemon[786]: ts=2026-09-22T11:22:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 55.301838] nix-grpc-daemon[786]: ts=2026-09-22T11:22:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 55.314447] nix-grpc-daemon[867]: time=2026-09-22T11:22:18.546Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 55.323713] nix-grpc-daemon[786]: ts=2026-09-22T11:22:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 55.334848] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 55.505502] nix-daemon[855]: accepted connection from pid 998, user nix-grpc-daemon (trusted) worker1 # [ 55.517891] nix-daemon[855]: reaped child process 1001, status = succeeded worker1 # [ 55.660865] nix-daemon[855]: accepted connection from pid 1003, user nix-grpc-daemon (trusted) worker1 # [ 55.673446] nix-daemon[855]: reaped child process 1006, status = succeeded lb # [ 55.709826] niks3-server[1047]: 2026/09/22 11:22:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.695960] nix-grpc-daemon[867]: time=2026-09-22T11:22:18.928Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 55.697500] nix-grpc-daemon[867]: time=2026-09-22T11:22:18.930Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 55.738238] niks3-server[1047]: 2026/09/22 11:22:19 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 55.749834] niks3-server[1047]: 2026/09/22 11:22:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 55.756501] niks3-server[1047]: 2026/09/22 11:22:19 INFO Signed narinfos id=7 count=1 worker1 # [ 55.737645] nix-grpc-daemon[867]: time=2026-09-22T11:22:18.970Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.760108] niks3-server[1047]: 2026/09/22 11:22:19 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 55.773297] niks3-server[1047]: 2026/09/22 11:22:19 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete worker1 # [ 55.757990] nix-grpc-daemon[867]: time=2026-09-22T11:22:18.990Z level=INFO msg="Upload complete. (410ms)" lb # [ 55.779802] niks3-server[1047]: 2026/09/22 11:22:19 INFO Completed upload id=7 worker1 # [ 55.760520] nix-grpc-daemon[786]: ts=2026-09-22T11:22:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 55.782948] niks3-server[1047]: 2026/09/22 11:22:19 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 55.765239] nix-grpc-daemon[786]: ts=2026-09-22T11:22:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 55.770542] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 55.772743] nix-daemon[855]: reaped child process 996, status = succeeded worker1 # [ 55.777913] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 56.778750] envoy[899]: conn peer=[2001:db8:1::1]:36196 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9550 tx=4426 ms=7733 lb # [ 56.782597] envoy[899]: conn peer=[2001:db8:1::1]:57098 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=66 client # farm-top> LOG-farm-top-t1b worker1 # [ 57.004948] nix-daemon[855]: reaped child process 1010, status = succeeded worker1 # [ 57.146252] nix-daemon[855]: accepted connection from pid 1026, user nix-grpc-daemon (trusted) worker1 # [ 57.157925] nix-daemon[855]: reaped child process 1029, status = succeeded lb # [ 57.194969] niks3-server[1047]: 2026/09/22 11:22:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.184286] nix-grpc-daemon[867]: time=2026-09-22T11:22:20.415Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 57.185626] nix-grpc-daemon[867]: time=2026-09-22T11:22:20.415Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 57.228071] niks3-server[1047]: 2026/09/22 11:22:20 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 57.244927] niks3-server[1047]: 2026/09/22 11:22:20 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 57.254784] niks3-server[1047]: 2026/09/22 11:22:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 57.258907] niks3-server[1047]: 2026/09/22 11:22:20 INFO Signed narinfos id=8 count=1 worker1 # [ 57.239595] nix-grpc-daemon[867]: time=2026-09-22T11:22:20.471Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.263730] niks3-server[1047]: 2026/09/22 11:22:20 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 57.273071] niks3-server[1047]: 2026/09/22 11:22:20 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 57.275950] niks3-server[1047]: 2026/09/22 11:22:20 INFO Completed upload id=8 lb # [ 57.277917] niks3-server[1047]: 2026/09/22 11:22:20 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 57.255660] nix-grpc-daemon[867]: time=2026-09-22T11:22:20.488Z level=INFO msg="Upload complete. (270ms)" worker1 # [ 57.261689] nix-grpc-daemon[786]: ts=2026-09-22T11:22:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 57.274861] nix-daemon[855]: reaped child process 1008, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.27 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.74 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag sig >&2 worker2 # [ 57.820325] nix-grpc-daemon[789]: ts=2026-09-22T11:22:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36244 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 57.815311] nix-grpc-daemon[786]: ts=2026-09-22T11:22:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 57.841694] nix-grpc-daemon[789]: ts=2026-09-22T11:22:21Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 57.844188] nix-grpc-daemon[789]: ts=2026-09-22T11:22:21Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.846875] nix-grpc-daemon[789]: ts=2026-09-22T11:22:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 57.854737] nix-grpc-daemon[789]: ts=2026-09-22T11:22:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker2 # [ 57.860178] nix-grpc-daemon[789]: ts=2026-09-22T11:22:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 57.864622] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 57.879119] nix-grpc-daemon[789]: ts=2026-09-22T11:22:21Z level=info event=niks3_push_started pid=928 worker2 # [ 58.117834] nix-grpc-daemon[928]: time=2026-09-22T11:22:22.184Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 58.307621] nix-daemon[877]: accepted connection from pid 940, user nix-grpc-daemon (trusted) worker2 # [ 58.324699] nix-daemon[877]: reaped child process 943, status = succeeded worker2 # [ 58.479785] nix-daemon[877]: accepted connection from pid 945, user nix-grpc-daemon (trusted) worker2 # [ 58.493645] nix-daemon[877]: reaped child process 948, status = succeeded lb # [ 58.519424] niks3-server[1047]: 2026/09/22 11:22:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 58.514767] nix-grpc-daemon[928]: time=2026-09-22T11:22:22.585Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 58.517727] nix-grpc-daemon[928]: time=2026-09-22T11:22:22.588Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 58.544996] niks3-server[1047]: 2026/09/22 11:22:21 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 58.548052] niks3-server[1047]: 2026/09/22 11:22:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 58.550697] niks3-server[1047]: 2026/09/22 11:22:21 INFO Signed narinfos id=9 count=1 worker2 # [ 58.540923] nix-grpc-daemon[928]: time=2026-09-22T11:22:22.611Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.553144] niks3-server[1047]: 2026/09/22 11:22:21 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 58.558620] niks3-server[1047]: 2026/09/22 11:22:21 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 58.562156] niks3-server[1047]: 2026/09/22 11:22:21 INFO Completed upload id=9 worker2 # [ 58.553273] nix-grpc-daemon[928]: time=2026-09-22T11:22:22.623Z level=INFO msg="Upload complete. (408ms)" lb # [ 58.563683] niks3-server[1047]: 2026/09/22 11:22:21 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker2 # [ 58.555929] nix-grpc-daemon[789]: ts=2026-09-22T11:22:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 58.561480] nix-grpc-daemon[789]: ts=2026-09-22T11:22:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 58.567589] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 58.570217] nix-daemon[877]: reaped child process 926, status = succeeded client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... worker2 # [ 58.576182] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker2 # [ 59.791390] nix-daemon[877]: reaped child process 952, status = succeeded worker2 # [ 59.936741] nix-daemon[877]: accepted connection from pid 968, user nix-grpc-daemon (trusted) worker2 # [ 59.950606] nix-daemon[877]: reaped child process 971, status = succeeded lb # [ 59.976580] niks3-server[1047]: 2026/09/22 11:22:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 59.974494] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.044Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 59.976199] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.046Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 60.010562] niks3-server[1047]: 2026/09/22 11:22:23 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 60.023837] niks3-server[1047]: 2026/09/22 11:22:23 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 60.035619] niks3-server[1047]: 2026/09/22 11:22:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 60.041312] niks3-server[1047]: 2026/09/22 11:22:23 INFO Signed narinfos id=10 count=1 worker2 # [ 60.034289] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.104Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.044245] niks3-server[1047]: 2026/09/22 11:22:23 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 60.054473] niks3-server[1047]: 2026/09/22 11:22:23 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 60.061355] niks3-server[1047]: 2026/09/22 11:22:23 INFO Completed upload id=10 worker2 # [ 60.051533] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.121Z level=INFO msg="Upload complete. (266ms)" lb # [ 60.062982] niks3-server[1047]: 2026/09/22 11:22:23 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 60.058549] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 60.068825] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker2 # [ 60.072867] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 60.079995] nix-daemon[877]: reaped child process 950, status = succeeded worker2 # [ 60.112531] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 60.124574] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 60.136597] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.206Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker2 # [ 60.145138] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 60.154628] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 60.332164] nix-daemon[877]: accepted connection from pid 978, user nix-grpc-daemon (trusted) worker2 # [ 60.345395] nix-daemon[877]: reaped child process 981, status = succeeded worker2 # [ 60.511627] nix-daemon[877]: accepted connection from pid 983, user nix-grpc-daemon (trusted) worker2 # [ 60.526593] nix-daemon[877]: reaped child process 986, status = succeeded lb # [ 60.550616] niks3-server[1047]: 2026/09/22 11:22:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.550828] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.621Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 60.553120] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.623Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 60.582541] niks3-server[1047]: 2026/09/22 11:22:23 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 60.594555] niks3-server[1047]: 2026/09/22 11:22:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 60.599136] niks3-server[1047]: 2026/09/22 11:22:24 INFO Signed narinfos id=11 count=1 worker2 # [ 60.592441] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.662Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.608544] niks3-server[1047]: 2026/09/22 11:22:24 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 60.617490] niks3-server[1047]: 2026/09/22 11:22:24 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 60.623645] niks3-server[1047]: 2026/09/22 11:22:24 INFO Completed upload id=11 worker2 # [ 60.613681] nix-grpc-daemon[928]: time=2026-09-22T11:22:24.684Z level=INFO msg="Upload complete. (446ms)" lb # [ 60.625844] niks3-server[1047]: 2026/09/22 11:22:24 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 60.617183] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 60.622234] nix-grpc-daemon[789]: ts=2026-09-22T11:22:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 60.631484] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 60.640260] nix-daemon[877]: reaped child process 975, status = succeeded worker2 # [ 60.644664] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker2 # [ 61.460147] nix-daemon[877]: reaped child process 990, status = succeeded worker2 # [ 61.609699] nix-daemon[877]: accepted connection from pid 1006, user nix-grpc-daemon (trusted) worker2 # [ 61.623708] nix-daemon[877]: reaped child process 1009, status = succeeded lb # [ 61.648623] niks3-server[1047]: 2026/09/22 11:22:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.646649] nix-grpc-daemon[928]: time=2026-09-22T11:22:25.716Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 61.648215] nix-grpc-daemon[928]: time=2026-09-22T11:22:25.718Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 61.682921] niks3-server[1047]: 2026/09/22 11:22:25 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 61.694687] niks3-server[1047]: 2026/09/22 11:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 61.701924] niks3-server[1047]: 2026/09/22 11:22:25 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 61.707261] niks3-server[1047]: 2026/09/22 11:22:25 INFO Signed narinfos id=12 count=1 worker2 # [ 61.700302] nix-grpc-daemon[928]: time=2026-09-22T11:22:25.770Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.712624] niks3-server[1047]: 2026/09/22 11:22:25 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 61.722356] niks3-server[1047]: 2026/09/22 11:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 61.729769] niks3-server[1047]: 2026/09/22 11:22:25 INFO Completed upload id=12 lb # [ 61.731371] niks3-server[1047]: 2026/09/22 11:22:25 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 61.721564] nix-grpc-daemon[928]: time=2026-09-22T11:22:25.791Z level=INFO msg="Upload complete. (268ms)" worker2 # [ 61.728607] nix-grpc-daemon[789]: ts=2026-09-22T11:22:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 61.740299] nix-grpc-daemon[789]: ts=2026-09-22T11:22:25Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker2 # [ 61.744217] nix-grpc-daemon[789]: ts=2026-09-22T11:22:25Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 61.753844] nix-daemon[877]: reaped child process 988, status = succeeded worker2 # [ 61.783212] nix-grpc-daemon[789]: ts=2026-09-22T11:22:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 61.794749] nix-grpc-daemon[789]: ts=2026-09-22T11:22:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 61.806878] nix-grpc-daemon[928]: time=2026-09-22T11:22:25.877Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker2 # [ 61.814590] nix-grpc-daemon[789]: ts=2026-09-22T11:22:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 61.823133] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 61.988220] nix-daemon[877]: accepted connection from pid 1015, user nix-grpc-daemon (trusted) worker2 # [ 62.002736] nix-daemon[877]: reaped child process 1018, status = succeeded worker2 # [ 62.158120] nix-daemon[877]: accepted connection from pid 1020, user nix-grpc-daemon (trusted) worker2 # [ 62.173609] nix-daemon[877]: reaped child process 1023, status = succeeded lb # [ 62.197126] niks3-server[1047]: 2026/09/22 11:22:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.195302] nix-grpc-daemon[928]: time=2026-09-22T11:22:26.265Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 62.196692] nix-grpc-daemon[928]: time=2026-09-22T11:22:26.265Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 62.222582] niks3-server[1047]: 2026/09/22 11:22:25 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 62.231129] niks3-server[1047]: 2026/09/22 11:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker2 # [ 62.227529] nix-grpc-daemon[928]: time=2026-09-22T11:22:26.297Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.237361] niks3-server[1047]: 2026/09/22 11:22:25 INFO Signed narinfos id=13 count=1 lb # [ 62.243531] niks3-server[1047]: 2026/09/22 11:22:25 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 62.256529] niks3-server[1047]: 2026/09/22 11:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 62.261728] niks3-server[1047]: 2026/09/22 11:22:25 INFO Completed upload id=13 worker2 # [ 62.253866] nix-grpc-daemon[928]: time=2026-09-22T11:22:26.324Z level=INFO msg="Upload complete. (418ms)" lb # [ 62.264641] niks3-server[1047]: 2026/09/22 11:22:25 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 62.258223] nix-grpc-daemon[789]: ts=2026-09-22T11:22:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 62.262702] nix-grpc-daemon[789]: ts=2026-09-22T11:22:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 62.271431] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 62.277128] nix-daemon[877]: reaped child process 1013, status = succeeded client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 62.282343] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker2 # [ 63.304242] nix-daemon[877]: reaped child process 1027, status = succeeded worker2 # [ 63.453213] nix-daemon[877]: accepted connection from pid 1043, user nix-grpc-daemon (trusted) worker2 # [ 63.466744] nix-daemon[877]: reaped child process 1046, status = succeeded lb # [ 63.488292] niks3-server[1047]: 2026/09/22 11:22:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 63.486648] nix-grpc-daemon[928]: time=2026-09-22T11:22:27.556Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 63.488203] nix-grpc-daemon[928]: time=2026-09-22T11:22:27.558Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 63.521143] niks3-server[1047]: 2026/09/22 11:22:26 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 63.535151] niks3-server[1047]: 2026/09/22 11:22:26 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 63.543578] niks3-server[1047]: 2026/09/22 11:22:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 63.548721] niks3-server[1047]: 2026/09/22 11:22:26 INFO Signed narinfos id=14 count=1 worker2 # [ 63.541659] nix-grpc-daemon[928]: time=2026-09-22T11:22:27.611Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.561670] niks3-server[1047]: 2026/09/22 11:22:26 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 63.685406] niks3-server[1047]: 2026/09/22 11:22:27 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 63.691087] niks3-server[1047]: 2026/09/22 11:22:27 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 63.698736] niks3-server[1047]: 2026/09/22 11:22:27 INFO Completed upload id=14 worker2 # [ 63.688812] nix-grpc-daemon[928]: time=2026-09-22T11:22:27.759Z level=INFO msg="Upload complete. (396ms)" worker2 # [ 63.696897] nix-grpc-daemon[789]: ts=2026-09-22T11:22:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker2 # [ 63.711427] nix-daemon[877]: reaped child process 1025, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag sig >&2, in 6.15 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag sig outPath, in 0.20 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 64.152473] nix-grpc-daemon[786]: ts=2026-09-22T11:22:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:35690 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 64.198247] nix-grpc-daemon[786]: ts=2026-09-22T11:22:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:35690 worker1 # [ 64.206296] nix-grpc-daemon[786]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 64.222929] nix-grpc-daemon[786]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 64.234995] nix-grpc-daemon[786]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.31 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 64.484982] nix-grpc-daemon[789]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57712 worker2 # [ 64.487611] nix-grpc-daemon[789]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57712 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.21 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/878" client # removing stale temporary roots file "/nix/var/nix/temproots/809" client # removing stale temporary roots file "/nix/var/nix/temproots/824" client # removing stale temporary roots file "/nix/var/nix/temproots/845" client # removing stale temporary roots file "/nix/var/nix/temproots/900" client # removing stale temporary roots file "/nix/var/nix/temproots/865" client # removing stale temporary roots file "/nix/var/nix/temproots/886" client # removing stale temporary roots file "/nix/var/nix/temproots/857" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 64.906702] nix-grpc-daemon[789]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 64.908789] nix-grpc-daemon[789]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 64.914749] nix-grpc-daemon[928]: time=2026-09-22T11:22:28.985Z level=INFO msg="All 1 paths already cached" worker1 # [ 64.907488] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 64.910176] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 64.925256] nix-grpc-daemon[789]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36244 client # copying 3 paths... worker1 # [ 64.920500] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 64.936299] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 64.938812] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 64.956618] nix-grpc-daemon[789]: ts=2026-09-22T11:22:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 64.959314] nix-grpc-daemon[789]: ts=2026-09-22T11:22:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 64.964696] nix-grpc-daemon[789]: ts=2026-09-22T11:22:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 64.966919] nix-grpc-daemon[789]: ts=2026-09-22T11:22:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.54 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 7.42 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 65.083907] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: bd2f7dff8def44e39a31ecc9efeb4314 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 65.299228] nix[953]: don't know how to build these paths: client # [ 65.300115] nix[953]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 65.289549] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 65.309650] nix-grpc-daemon[789]: ts=2026-09-22T11:22:29Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 65.313914] nix-grpc-daemon[789]: ts=2026-09-22T11:22:29Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 65.341747] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 65.352401] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 client # [ 65.371041] nix[953]: copying 1 paths to 'lb:50051'... client # [ 65.371782] nix[953]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 65.362845] nix-grpc-daemon[786]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 65.373817] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 65.546911] nix-daemon[855]: accepted connection from pid 1036, user nix-grpc-daemon (trusted) worker1 # [ 65.560504] nix-daemon[855]: reaped child process 1039, status = succeeded worker1 # [ 65.711724] nix-daemon[855]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 65.723152] nix-daemon[855]: reaped child process 1044, status = succeeded lb # [ 65.759551] niks3-server[1047]: 2026/09/22 11:22:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.745315] nix-grpc-daemon[867]: time=2026-09-22T11:22:28.977Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 65.746807] nix-grpc-daemon[867]: time=2026-09-22T11:22:28.979Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 65.785963] niks3-server[1047]: 2026/09/22 11:22:29 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 65.796261] niks3-server[1047]: 2026/09/22 11:22:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 65.801065] niks3-server[1047]: 2026/09/22 11:22:29 INFO Signed narinfos id=15 count=1 worker1 # [ 65.782344] nix-grpc-daemon[867]: time=2026-09-22T11:22:29.014Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.813088] niks3-server[1047]: 2026/09/22 11:22:29 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 65.818180] niks3-server[1047]: 2026/09/22 11:22:29 INFO Completed upload id=15 worker1 # [ 65.799053] nix-grpc-daemon[867]: time=2026-09-22T11:22:29.031Z level=INFO msg="Upload complete. (414ms)" worker1 # [ 65.801320] nix-grpc-daemon[786]: ts=2026-09-22T11:22:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 65.823662] niks3-server[1047]: 2026/09/22 11:22:29 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 65.827946] niks3-server[1047]: 2026/09/22 11:22:29 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 65.806509] nix-grpc-daemon[786]: ts=2026-09-22T11:22:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 65.811223] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 65.813360] nix-daemon[855]: reaped child process 1034, status = succeeded worker1 # [ 65.818534] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # [ 65.827301] nix[953]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 66.155403] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 2d4d6284a93b4f1f9e603a9086ba2db4 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds) worker1 # [ 66.415868] nix-grpc-daemon[786]: ts=2026-09-22T11:22:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36134 client # [ 66.435476] nix[969]: this derivation will be built: worker2 # [ 66.439682] nix-grpc-daemon[789]: ts=2026-09-22T11:22:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 66.447735] nix-grpc-daemon[789]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'... client # [ 66.462035] nix[969]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 66.471198] nix-grpc-daemon[789]: ts=2026-09-22T11:22:30Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 66.468779] nix-grpc-daemon[786]: ts=2026-09-22T11:22:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 client # [ 66.482683] nix[969]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... lb # [ 66.778985] envoy[899]: conn peer=[2001:db8:1::1]:57114 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4169 tx=1895 ms=2058 lb # [ 66.782664] envoy[899]: conn peer=[2001:db8:1::1]:57116 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9524 tx=4372 ms=5929 lb # [ 66.786119] envoy[899]: conn peer=[2001:db8:1::1]:36694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1108 tx=2927 ms=124 lb # [ 66.789582] envoy[899]: conn peer=[2001:db8:1::1]:36714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=66 lb # [ 66.792884] envoy[899]: conn peer=[2001:db8:1::1]:36700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=74 lb # [ 66.796279] envoy[899]: conn peer=[2001:db8:1::1]:36696 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=83 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.06 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 70.845683] nix-daemon[855]: reaped child process 1048, status = succeeded worker1 # [ 71.005070] nix-daemon[855]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker1 # [ 71.016960] nix-daemon[855]: reaped child process 1085, status = succeeded lb # [ 71.054627] niks3-server[1047]: 2026/09/22 11:22:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 71.040755] nix-grpc-daemon[867]: time=2026-09-22T11:22:34.273Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 71.042858] nix-grpc-daemon[867]: time=2026-09-22T11:22:34.274Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 71.093218] niks3-server[1047]: 2026/09/22 11:22:34 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 71.105858] niks3-server[1047]: 2026/09/22 11:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 71.113976] niks3-server[1047]: 2026/09/22 11:22:34 INFO Signed narinfos id=16 count=1 worker1 # [ 71.095191] nix-grpc-daemon[867]: time=2026-09-22T11:22:34.327Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.119205] niks3-server[1047]: 2026/09/22 11:22:34 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 71.124215] niks3-server[1047]: 2026/09/22 11:22:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 71.133603] niks3-server[1047]: 2026/09/22 11:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 71.139555] niks3-server[1047]: 2026/09/22 11:22:34 INFO Completed upload id=16 worker1 # [ 71.119657] nix-grpc-daemon[867]: time=2026-09-22T11:22:34.352Z level=INFO msg="Upload complete. (288ms)" lb # [ 71.141870] niks3-server[1047]: 2026/09/22 11:22:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker1 # [ 71.122566] nix-grpc-daemon[786]: ts=2026-09-22T11:22:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 71.126135] nix-grpc-daemon[786]: ts=2026-09-22T11:22:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 71.131477] nix-daemon[855]: reaped child process 1046, status = succeeded client # [ 71.162789] systemd[1]: dedup1.service: Deactivated successfully. client # [ 71.165144] systemd[1]: dedup1.service: Consumed 114ms CPU time over 6.080s wall clock time, 43.5M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 71.204032] systemd[1]: dedup2.service: Deactivated successfully. client # [ 71.205440] systemd[1]: dedup2.service: Consumed 134ms CPU time over 5.050s wall clock time, 35.3M memory peak, 6.4K incoming IP traffic, 5.8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.06 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 72.340807] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 72.352513] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 72.358589] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 72.364871] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 72.371973] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 72.380755] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 72.391641] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 72.561072] nix-daemon[877]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker2 # [ 72.574576] nix-daemon[877]: reaped child process 1085, status = succeeded worker2 # [ 72.734395] nix-daemon[877]: accepted connection from pid 1087, user nix-grpc-daemon (trusted) worker2 # [ 72.746803] nix-daemon[877]: reaped child process 1090, status = succeeded lb # [ 72.771908] niks3-server[1047]: 2026/09/22 11:22:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.765875] nix-grpc-daemon[928]: time=2026-09-22T11:22:36.836Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 72.767451] nix-grpc-daemon[928]: time=2026-09-22T11:22:36.837Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 72.787731] niks3-server[1047]: 2026/09/22 11:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker2 # [ 72.783077] nix-grpc-daemon[928]: time=2026-09-22T11:22:36.853Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.793695] niks3-server[1047]: 2026/09/22 11:22:36 INFO Signed narinfos id=17 count=1 lb # [ 72.800968] niks3-server[1047]: 2026/09/22 11:22:36 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 72.805551] niks3-server[1047]: 2026/09/22 11:22:36 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 72.813243] niks3-server[1047]: 2026/09/22 11:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 72.818987] niks3-server[1047]: 2026/09/22 11:22:36 INFO Completed upload id=17 worker2 # [ 72.811488] nix-grpc-daemon[928]: time=2026-09-22T11:22:36.881Z level=INFO msg="Upload complete. (408ms)" lb # [ 72.823404] niks3-server[1047]: 2026/09/22 11:22:36 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 72.814282] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 72.817144] nix-grpc-daemon[789]: ts=2026-09-22T11:22:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 72.823524] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 72.826560] nix-daemon[877]: reaped child process 1080, status = succeeded worker2 # [ 72.832090] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) lb # [ 76.779609] envoy[899]: conn peer=[2001:db8:1::1]:36726 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3011 tx=1560 ms=5843 lb # [ 76.783422] envoy[899]: conn peer=[2001:db8:1::1]:36734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1576 tx=1599 ms=4765 worker2 # [ 78.648868] nix-grpc-daemon[789]: ts=2026-09-22T11:22:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=5 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker2 # [ 78.673195] nix-daemon[877]: reaped child process 1092, status = succeeded worker2 # [ 78.675294] nix-daemon[877]: reaped child process 1094, status = succeeded worker1 # [ 78.888190] nix-grpc-daemon[786]: ts=2026-09-22T11:22:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 78.915061] nix-grpc-daemon[789]: ts=2026-09-22T11:22:42Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 78.919695] nix-grpc-daemon[789]: ts=2026-09-22T11:22:42Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 78.910418] nix-grpc-daemon[786]: ts=2026-09-22T11:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 78.922676] nix-grpc-daemon[786]: ts=2026-09-22T11:22:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 78.932922] nix-grpc-daemon[786]: ts=2026-09-22T11:22:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 78.943673] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 79.111128] nix-daemon[855]: accepted connection from pid 1098, user nix-grpc-daemon (trusted) worker1 # [ 79.123509] nix-daemon[855]: reaped child process 1101, status = succeeded worker1 # [ 79.275255] nix-daemon[855]: accepted connection from pid 1103, user nix-grpc-daemon (trusted) worker1 # [ 79.286670] nix-daemon[855]: reaped child process 1106, status = succeeded lb # [ 79.323374] niks3-server[1047]: 2026/09/22 11:22:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.310100] nix-grpc-daemon[867]: time=2026-09-22T11:22:42.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 79.311667] nix-grpc-daemon[867]: time=2026-09-22T11:22:42.544Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 79.354150] niks3-server[1047]: 2026/09/22 11:22:42 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 79.362759] niks3-server[1047]: 2026/09/22 11:22:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker1 # [ 79.346657] nix-grpc-daemon[867]: time=2026-09-22T11:22:42.579Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.367842] niks3-server[1047]: 2026/09/22 11:22:42 INFO Signed narinfos id=18 count=1 lb # [ 79.373130] niks3-server[1047]: 2026/09/22 11:22:42 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 79.384964] niks3-server[1047]: 2026/09/22 11:22:42 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete worker1 # [ 79.368414] nix-grpc-daemon[867]: time=2026-09-22T11:22:42.600Z level=INFO msg="Upload complete. (413ms)" lb # [ 79.390390] niks3-server[1047]: 2026/09/22 11:22:42 INFO Completed upload id=18 worker1 # [ 79.370452] nix-grpc-daemon[786]: ts=2026-09-22T11:22:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 79.393862] niks3-server[1047]: 2026/09/22 11:22:42 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 79.376397] nix-grpc-daemon[786]: ts=2026-09-22T11:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 79.380933] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 79.383306] nix-daemon[855]: reaped child process 1096, status = succeeded worker1 # [ 79.388461] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 85.200971] nix-grpc-daemon[786]: ts=2026-09-22T11:22:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker1 # [ 85.225410] nix-daemon[855]: reaped child process 1108, status = succeeded worker1 # [ 85.227788] nix-daemon[855]: reaped child process 1110, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.32 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share client # [ 85.458726] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: b679ca1c2e7e44f6a0f48ca272c9d727 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share, in 0.04 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share worker2 # [ 85.651490] nix-grpc-daemon[789]: ts=2026-09-22T11:22:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36244 client # [ 85.655699] nix[1042]: don't know how to build these paths: client # [ 85.656979] nix[1042]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 85.669673] nix-grpc-daemon[789]: ts=2026-09-22T11:22:49Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 85.676466] nix-grpc-daemon[789]: ts=2026-09-22T11:22:49Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 85.683363] nix-grpc-daemon[789]: ts=2026-09-22T11:22:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 85.696490] nix-grpc-daemon[789]: ts=2026-09-22T11:22:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 client # [ 85.704106] nix[1042]: copying 1 paths to 'lb:50051'... client # [ 85.704905] nix[1042]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 85.708150] nix-grpc-daemon[789]: ts=2026-09-22T11:22:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 85.720664] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 85.900807] nix-daemon[877]: accepted connection from pid 1121, user nix-grpc-daemon (trusted) worker2 # [ 85.917562] nix-daemon[877]: reaped child process 1124, status = succeeded worker2 # [ 86.089359] nix-daemon[877]: accepted connection from pid 1126, user nix-grpc-daemon (trusted) worker2 # [ 86.104440] nix-daemon[877]: reaped child process 1129, status = succeeded lb # [ 86.129664] niks3-server[1047]: 2026/09/22 11:22:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.129559] nix-grpc-daemon[928]: time=2026-09-22T11:22:50.199Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 86.131095] nix-grpc-daemon[928]: time=2026-09-22T11:22:50.199Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 86.151317] niks3-server[1047]: 2026/09/22 11:22:49 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 86.158742] niks3-server[1047]: 2026/09/22 11:22:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 86.161835] niks3-server[1047]: 2026/09/22 11:22:49 INFO Signed narinfos id=19 count=1 worker2 # [ 86.152197] nix-grpc-daemon[928]: time=2026-09-22T11:22:50.222Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.165092] niks3-server[1047]: 2026/09/22 11:22:49 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 86.171108] niks3-server[1047]: 2026/09/22 11:22:49 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 86.175129] niks3-server[1047]: 2026/09/22 11:22:49 INFO Completed upload id=19 worker2 # [ 86.165197] nix-grpc-daemon[928]: time=2026-09-22T11:22:50.235Z level=INFO msg="Upload complete. (432ms)" lb # [ 86.176941] niks3-server[1047]: 2026/09/22 11:22:49 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 86.167609] nix-grpc-daemon[789]: ts=2026-09-22T11:22:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 86.171526] nix-grpc-daemon[789]: ts=2026-09-22T11:22:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 86.178806] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 86.183664] nix-daemon[877]: reaped child process 1119, status = succeeded client # [ 86.185751] nix[1042]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker2 # [ 86.189407] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) client # [ 86.512578] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 63a953a177154bb8b4c63cff816dd817 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share, in 1.05 seconds) worker1 # [ 86.691412] nix-grpc-daemon[786]: ts=2026-09-22T11:22:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36134 client # [ 86.705388] nix[1058]: don't know how to build these paths: client # [ 86.706213] nix[1058]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 86.716638] nix-grpc-daemon[789]: ts=2026-09-22T11:22:50Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 client # [ 86.716693] nix[1058]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker2 # [ 86.719372] nix-grpc-daemon[789]: ts=2026-09-22T11:22:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 lb # [ 86.779158] envoy[899]: conn peer=[2001:db8:1::1]:36742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2970 tx=977 ms=6317 lb # [ 86.780949] envoy[899]: conn peer=[2001:db8:1::1]:57936 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2982 tx=948 ms=6369 client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 89.802615] systemd[1]: share1.service: Sent signal SIGINT to main process 1042 (nix) on client request. client # [ 89.806164] nix[1042]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 89.809071] nix[1042]: error: interrupted by the user client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.04 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 89.840616] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 89.841969] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 89.844065] systemd[1]: share1.service: Consumed 101ms CPU time over 4.381s wall clock time, 41.4M memory peak, 6.2K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 0.04 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 90.208393] nix-daemon[877]: reaped child process 1133, status = succeeded worker2 # [ 90.363812] nix-daemon[877]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 90.377406] nix-daemon[877]: reaped child process 1172, status = succeeded lb # [ 90.404960] niks3-server[1047]: 2026/09/22 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.403224] nix-grpc-daemon[928]: time=2026-09-22T11:22:54.473Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 90.405870] nix-grpc-daemon[928]: time=2026-09-22T11:22:54.475Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 90.447217] niks3-server[1047]: 2026/09/22 11:22:53 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 90.453298] niks3-server[1047]: 2026/09/22 11:22:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 90.457592] niks3-server[1047]: 2026/09/22 11:22:53 INFO Signed narinfos id=20 count=1 worker2 # [ 90.450031] nix-grpc-daemon[928]: time=2026-09-22T11:22:54.520Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.465493] niks3-server[1047]: 2026/09/22 11:22:53 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 90.469800] niks3-server[1047]: 2026/09/22 11:22:53 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 90.478257] niks3-server[1047]: 2026/09/22 11:22:53 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 90.481393] niks3-server[1047]: 2026/09/22 11:22:53 INFO Completed upload id=20 worker2 # [ 90.471475] nix-grpc-daemon[928]: time=2026-09-22T11:22:54.541Z level=INFO msg="Upload complete. (271ms)" lb # [ 90.484214] niks3-server[1047]: 2026/09/22 11:22:53 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 90.478463] nix-grpc-daemon[789]: ts=2026-09-22T11:22:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 90.483554] nix-grpc-daemon[789]: ts=2026-09-22T11:22:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 90.494903] nix-daemon[877]: reaped child process 1131, status = succeeded client # [ 90.555907] systemd[1]: share2.service: Deactivated successfully. client # [ 90.560305] systemd[1]: share2.service: Consumed 103ms CPU time over 4.046s wall clock time, 35.1M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.09 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.04 seconds) (finished: subtest: the first client leaving does not fail the second, in 5.80 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 91.404725] systemd[1]: Started Nix Daemon. client # [ 91.590485] nix-daemon[1104]: accepted connection from pid 1101, user root (trusted) worker1 # [ 91.773469] nix-grpc-daemon[786]: ts=2026-09-22T11:22:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 91.778752] nix-grpc-daemon[786]: ts=2026-09-22T11:22:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 91.802797] nix-grpc-daemon[789]: ts=2026-09-22T11:22:55Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 91.793185] nix-grpc-daemon[786]: ts=2026-09-22T11:22:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 91.806872] nix-grpc-daemon[789]: ts=2026-09-22T11:22:55Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 91.804315] nix-grpc-daemon[786]: ts=2026-09-22T11:22:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 91.814974] nix-grpc-daemon[786]: ts=2026-09-22T11:22:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 91.825498] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 92.007073] nix-daemon[855]: accepted connection from pid 1149, user nix-grpc-daemon (trusted) worker1 # [ 92.018795] nix-daemon[855]: reaped child process 1152, status = succeeded worker1 # [ 92.181751] nix-daemon[855]: accepted connection from pid 1154, user nix-grpc-daemon (trusted) worker1 # [ 92.192222] nix-daemon[855]: reaped child process 1157, status = succeeded lb # [ 92.230649] niks3-server[1047]: 2026/09/22 11:22:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 92.217323] nix-grpc-daemon[867]: time=2026-09-22T11:22:55.449Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 92.218969] nix-grpc-daemon[867]: time=2026-09-22T11:22:55.451Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 92.265935] niks3-server[1047]: 2026/09/22 11:22:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 92.250556] nix-grpc-daemon[867]: time=2026-09-22T11:22:55.482Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.272156] niks3-server[1047]: 2026/09/22 11:22:55 INFO Signed narinfos id=21 count=1 lb # [ 92.279292] niks3-server[1047]: 2026/09/22 11:22:55 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 92.290421] niks3-server[1047]: 2026/09/22 11:22:55 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 92.299399] niks3-server[1047]: 2026/09/22 11:22:55 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 92.304763] niks3-server[1047]: 2026/09/22 11:22:55 INFO Completed upload id=21 worker1 # [ 92.285359] nix-grpc-daemon[867]: time=2026-09-22T11:22:55.517Z level=INFO msg="Upload complete. (448ms)" lb # [ 92.309598] niks3-server[1047]: 2026/09/22 11:22:55 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 92.289482] nix-grpc-daemon[786]: ts=2026-09-22T11:22:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 92.296325] nix-grpc-daemon[786]: ts=2026-09-22T11:22:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 92.304514] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 92.312631] nix-daemon[855]: reaped child process 1147, status = succeeded worker1 # [ 92.320760] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 93.344488] nix-daemon[855]: reaped child process 1161, status = succeeded worker1 # [ 93.486707] nix-daemon[855]: accepted connection from pid 1177, user nix-grpc-daemon (trusted) worker1 # [ 93.498128] nix-daemon[855]: reaped child process 1180, status = succeeded lb # [ 93.532968] niks3-server[1047]: 2026/09/22 11:22:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 93.521606] nix-grpc-daemon[867]: time=2026-09-22T11:22:56.753Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 93.523354] nix-grpc-daemon[867]: time=2026-09-22T11:22:56.755Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 93.575669] niks3-server[1047]: 2026/09/22 11:22:56 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 93.584074] niks3-server[1047]: 2026/09/22 11:22:56 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 93.589640] niks3-server[1047]: 2026/09/22 11:22:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 93.592399] niks3-server[1047]: 2026/09/22 11:22:57 INFO Signed narinfos id=22 count=1 worker1 # [ 93.572417] nix-grpc-daemon[867]: time=2026-09-22T11:22:56.804Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.595343] niks3-server[1047]: 2026/09/22 11:22:57 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 93.600285] niks3-server[1047]: 2026/09/22 11:22:57 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 93.604128] niks3-server[1047]: 2026/09/22 11:22:57 INFO Completed upload id=22 worker1 # [ 93.582635] nix-grpc-daemon[867]: time=2026-09-22T11:22:56.815Z level=INFO msg="Upload complete. (256ms)" lb # [ 93.605790] niks3-server[1047]: 2026/09/22 11:22:57 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 93.587374] nix-grpc-daemon[786]: ts=2026-09-22T11:22:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker1 # [ 93.598392] nix-daemon[855]: reaped child process 1159, status = succeeded worker2 # [ 93.648265] nix-grpc-daemon[789]: ts=2026-09-22T11:22:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 93.663208] nix-grpc-daemon[789]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 93.681626] nix-grpc-daemon[786]: ts=2026-09-22T11:22:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 93.686867] nix-grpc-daemon[786]: ts=2026-09-22T11:22:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 93.925523] nix-grpc-daemon[786]: ts=2026-09-22T11:22:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 93.932895] nix-grpc-daemon[786]: ts=2026-09-22T11:22:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 93.942304] nix-grpc-daemon[867]: time=2026-09-22T11:22:57.174Z level=INFO msg="All 1 paths already cached" worker2 # [ 93.967645] nix-grpc-daemon[789]: ts=2026-09-22T11:22:58Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 93.969711] nix-grpc-daemon[789]: ts=2026-09-22T11:22:58Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 93.962557] nix-grpc-daemon[786]: ts=2026-09-22T11:22:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 93.974762] nix-grpc-daemon[786]: ts=2026-09-22T11:22:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 93.986569] nix-grpc-daemon[867]: time=2026-09-22T11:22:57.218Z level=INFO msg="All 1 paths already cached" worker1 # [ 93.993670] nix-grpc-daemon[786]: ts=2026-09-22T11:22:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 94.003157] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 94.178696] nix-daemon[855]: accepted connection from pid 1184, user nix-grpc-daemon (trusted) worker1 # [ 94.191412] nix-daemon[855]: reaped child process 1187, status = succeeded worker1 # [ 94.341097] nix-daemon[855]: accepted connection from pid 1189, user nix-grpc-daemon (trusted) worker1 # [ 94.353211] nix-daemon[855]: reaped child process 1192, status = succeeded lb # [ 94.385473] niks3-server[1047]: 2026/09/22 11:22:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 94.372605] nix-grpc-daemon[867]: time=2026-09-22T11:22:57.604Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 94.373945] nix-grpc-daemon[867]: time=2026-09-22T11:22:57.604Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 94.409755] niks3-server[1047]: 2026/09/22 11:22:57 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 94.422273] niks3-server[1047]: 2026/09/22 11:22:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 94.428747] niks3-server[1047]: 2026/09/22 11:22:57 INFO Signed narinfos id=23 count=1 worker1 # [ 94.410321] nix-grpc-daemon[867]: time=2026-09-22T11:22:57.642Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.433881] niks3-server[1047]: 2026/09/22 11:22:57 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 94.443666] niks3-server[1047]: 2026/09/22 11:22:57 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker1 # [ 94.428746] nix-grpc-daemon[867]: time=2026-09-22T11:22:57.661Z level=INFO msg="Upload complete. (413ms)" lb # [ 94.450364] niks3-server[1047]: 2026/09/22 11:22:57 INFO Completed upload id=23 worker1 # [ 94.430842] nix-grpc-daemon[786]: ts=2026-09-22T11:22:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 94.455509] niks3-server[1047]: 2026/09/22 11:22:57 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 94.436832] nix-daemon[855]: reaped child process 1182, status = succeeded worker1 # [ 94.438400] nix-grpc-daemon[786]: ts=2026-09-22T11:22:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 94.442447] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 94.447841] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 96.072700] nix-daemon[855]: reaped child process 1196, status = succeeded worker1 # [ 96.227870] nix-daemon[855]: accepted connection from pid 1212, user nix-grpc-daemon (trusted) worker1 # [ 96.240656] nix-daemon[855]: reaped child process 1215, status = succeeded lb # [ 96.280364] niks3-server[1047]: 2026/09/22 11:22:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 96.267982] nix-grpc-daemon[867]: time=2026-09-22T11:22:59.500Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 96.269719] nix-grpc-daemon[867]: time=2026-09-22T11:22:59.502Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 96.317795] niks3-server[1047]: 2026/09/22 11:22:59 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 96.331913] niks3-server[1047]: 2026/09/22 11:22:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 96.336328] niks3-server[1047]: 2026/09/22 11:22:59 INFO Signed narinfos id=24 count=1 worker1 # [ 96.316970] nix-grpc-daemon[867]: time=2026-09-22T11:22:59.549Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.343538] niks3-server[1047]: 2026/09/22 11:22:59 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 96.347469] niks3-server[1047]: 2026/09/22 11:22:59 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 96.356268] niks3-server[1047]: 2026/09/22 11:22:59 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 96.362852] niks3-server[1047]: 2026/09/22 11:22:59 INFO Completed upload id=24 lb # [ 96.364602] niks3-server[1047]: 2026/09/22 11:22:59 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 96.342636] nix-grpc-daemon[867]: time=2026-09-22T11:22:59.575Z level=INFO msg="Upload complete. (285ms)" worker1 # [ 96.348840] nix-grpc-daemon[786]: ts=2026-09-22T11:22:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker1 # [ 96.358297] nix-grpc-daemon[786]: ts=2026-09-22T11:22:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 96.367700] nix-daemon[855]: reaped child process 1194, status = succeeded worker2 # [ 96.388510] nix-grpc-daemon[789]: ts=2026-09-22T11:23:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 96.395493] nix-grpc-daemon[789]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 96.403313] nix-grpc-daemon[789]: ts=2026-09-22T11:23:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 96.678476] nix-grpc-daemon[786]: ts=2026-09-22T11:22:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 96.695423] nix-grpc-daemon[789]: ts=2026-09-22T11:23:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 96.705104] nix-grpc-daemon[928]: time=2026-09-22T11:23:00.774Z level=INFO msg="All 2 paths already cached" worker2 # [ 96.719228] nix-grpc-daemon[789]: ts=2026-09-22T11:23:00Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 96.723164] nix-grpc-daemon[789]: ts=2026-09-22T11:23:00Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 96.760461] nix-grpc-daemon[786]: ts=2026-09-22T11:22:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 lb # [ 96.781963] envoy[899]: conn peer=[2001:db8:1::1]:44778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=814 ms=4170 lb # [ 96.786649] envoy[899]: conn peer=[2001:db8:1::1]:44782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1197 ms=3827 lb # [ 96.790237] envoy[899]: conn peer=[2001:db8:1::1]:43382 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=27 lb # [ 96.794951] envoy[899]: conn peer=[2001:db8:1::1]:44790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3421 tx=1960 ms=1938 lb # [ 96.798622] envoy[899]: conn peer=[2001:db8:1::1]:43398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=67 lb # [ 96.802395] envoy[899]: conn peer=[2001:db8:1::1]:43392 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3893 tx=2154 ms=2523 worker1 # [ 96.789258] nix-grpc-daemon[786]: ts=2026-09-22T11:23:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 96.798027] nix-grpc-daemon[867]: time=2026-09-22T11:23:00.030Z level=INFO msg="All 2 paths already cached" worker1 # [ 96.803108] nix-grpc-daemon[786]: ts=2026-09-22T11:23:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 96.806995] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 96.957373] nix-daemon[855]: accepted connection from pid 1219, user nix-grpc-daemon (trusted) worker1 # [ 96.969220] nix-daemon[855]: reaped child process 1222, status = succeeded worker1 # [ 97.129249] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 97.140419] nix-daemon[855]: reaped child process 1227, status = succeeded lb # [ 97.178837] niks3-server[1047]: 2026/09/22 11:23:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.165120] nix-grpc-daemon[867]: time=2026-09-22T11:23:00.397Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 97.166588] nix-grpc-daemon[867]: time=2026-09-22T11:23:00.399Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 97.206479] niks3-server[1047]: 2026/09/22 11:23:00 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 97.218513] niks3-server[1047]: 2026/09/22 11:23:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign worker1 # [ 97.201383] nix-grpc-daemon[867]: time=2026-09-22T11:23:00.433Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.223569] niks3-server[1047]: 2026/09/22 11:23:00 INFO Signed narinfos id=25 count=1 lb # [ 97.229613] niks3-server[1047]: 2026/09/22 11:23:00 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 97.242098] niks3-server[1047]: 2026/09/22 11:23:00 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete worker1 # [ 97.225604] nix-grpc-daemon[867]: time=2026-09-22T11:23:00.458Z level=INFO msg="Upload complete. (412ms)" lb # [ 97.247238] niks3-server[1047]: 2026/09/22 11:23:00 INFO Completed upload id=25 lb # [ 97.249620] niks3-server[1047]: 2026/09/22 11:23:00 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 97.228350] nix-grpc-daemon[786]: ts=2026-09-22T11:23:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 97.234788] nix-grpc-daemon[786]: ts=2026-09-22T11:23:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 97.241935] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 97.245837] nix-daemon[855]: reaped child process 1217, status = succeeded worker1 # [ 97.250158] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 98.067902] nix-daemon[855]: reaped child process 1231, status = succeeded worker1 # [ 98.219908] nix-daemon[855]: accepted connection from pid 1247, user nix-grpc-daemon (trusted) worker1 # [ 98.232173] nix-daemon[855]: reaped child process 1250, status = succeeded lb # [ 98.271251] niks3-server[1047]: 2026/09/22 11:23:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.259320] nix-grpc-daemon[867]: time=2026-09-22T11:23:01.491Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 98.260774] nix-grpc-daemon[867]: time=2026-09-22T11:23:01.493Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 98.307262] niks3-server[1047]: 2026/09/22 11:23:01 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 98.315092] niks3-server[1047]: 2026/09/22 11:23:01 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 98.323907] niks3-server[1047]: 2026/09/22 11:23:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 98.327749] niks3-server[1047]: 2026/09/22 11:23:01 INFO Signed narinfos id=26 count=1 worker1 # [ 98.308358] nix-grpc-daemon[867]: time=2026-09-22T11:23:01.540Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.334361] niks3-server[1047]: 2026/09/22 11:23:01 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 98.339554] niks3-server[1047]: 2026/09/22 11:23:01 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 98.342656] niks3-server[1047]: 2026/09/22 11:23:01 INFO Completed upload id=26 worker1 # [ 98.321221] nix-grpc-daemon[867]: time=2026-09-22T11:23:01.553Z level=INFO msg="Upload complete. (264ms)" lb # [ 98.345165] niks3-server[1047]: 2026/09/22 11:23:01 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 98.327106] nix-grpc-daemon[786]: ts=2026-09-22T11:23:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker1 # [ 98.337134] nix-daemon[855]: reaped child process 1229, status = succeeded worker1 # [ 98.372517] nix-grpc-daemon[786]: ts=2026-09-22T11:23:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 worker2 # [ 98.402785] nix-grpc-daemon[789]: ts=2026-09-22T11:23:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 98.411709] nix-grpc-daemon[789]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 98.420836] nix-grpc-daemon[789]: ts=2026-09-22T11:23:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_out=232 client # [ 98.531941] nix-daemon[1104]: reaped child process 1106, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.32 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.42 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 99.709565] nix-daemon[1104]: accepted connection from pid 1187, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 99.926184] nix-grpc-daemon[789]: ts=2026-09-22T11:23:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36244 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 99.917738] nix-grpc-daemon[786]: ts=2026-09-22T11:23:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 100.071185] nix-daemon[855]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 100.083611] nix-daemon[855]: reaped child process 1260, status = succeeded lb # [ 100.119616] niks3-server[1047]: 2026/09/22 11:23:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 100.106855] nix-grpc-daemon[867]: time=2026-09-22T11:23:03.339Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 100.108695] nix-grpc-daemon[867]: time=2026-09-22T11:23:03.340Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 100.149606] niks3-server[1047]: 2026/09/22 11:23:03 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 100.159594] niks3-server[1047]: 2026/09/22 11:23:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 100.142488] nix-grpc-daemon[867]: time=2026-09-22T11:23:03.374Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.164113] niks3-server[1047]: 2026/09/22 11:23:03 INFO Signed narinfos id=27 count=1 lb # [ 100.171113] niks3-server[1047]: 2026/09/22 11:23:03 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 100.181969] niks3-server[1047]: 2026/09/22 11:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 100.188149] niks3-server[1047]: 2026/09/22 11:23:03 INFO Completed upload id=27 worker1 # [ 100.166628] nix-grpc-daemon[867]: time=2026-09-22T11:23:03.399Z level=INFO msg="Upload complete. (247ms)" lb # [ 100.190411] niks3-server[1047]: 2026/09/22 11:23:03 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 100.198159] nix-grpc-daemon[789]: ts=2026-09-22T11:23:04Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 100.200778] nix-grpc-daemon[789]: ts=2026-09-22T11:23:04Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 100.243045] nix-grpc-daemon[789]: ts=2026-09-22T11:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 100.252122] nix-grpc-daemon[789]: ts=2026-09-22T11:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 client # copying 2 paths to 'lb:50051'... worker2 # [ 100.263451] nix-grpc-daemon[789]: ts=2026-09-22T11:23:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 100.273449] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 100.425689] nix-daemon[877]: accepted connection from pid 1190, user nix-grpc-daemon (trusted) worker2 # [ 100.440567] nix-daemon[877]: reaped child process 1193, status = succeeded worker2 # [ 100.582762] nix-daemon[877]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 100.597495] nix-daemon[877]: reaped child process 1198, status = succeeded lb # [ 100.619569] niks3-server[1047]: 2026/09/22 11:23:04 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 100.625450] niks3-server[1047]: 2026/09/22 11:23:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.620380] nix-grpc-daemon[928]: time=2026-09-22T11:23:04.689Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 100.621733] nix-grpc-daemon[928]: time=2026-09-22T11:23:04.689Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker2 # [ 100.623354] nix-grpc-daemon[928]: time=2026-09-22T11:23:04.690Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 100.642024] niks3-server[1047]: 2026/09/22 11:23:04 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 100.646181] niks3-server[1047]: 2026/09/22 11:23:04 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 100.648898] niks3-server[1047]: 2026/09/22 11:23:04 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 100.652943] niks3-server[1047]: 2026/09/22 11:23:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 100.654642] niks3-server[1047]: 2026/09/22 11:23:04 INFO Signed narinfos id=28 count=1 lb # [ 100.655980] niks3-server[1047]: 2026/09/22 11:23:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 100.658525] niks3-server[1047]: 2026/09/22 11:23:04 INFO Signed narinfos id=29 count=2 worker2 # [ 100.648723] nix-grpc-daemon[928]: time=2026-09-22T11:23:04.718Z level=INFO msg="Uploading 3 narinfos" lb # [ 100.663133] niks3-server[1047]: 2026/09/22 11:23:04 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 100.670625] niks3-server[1047]: 2026/09/22 11:23:04 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 100.675442] niks3-server[1047]: 2026/09/22 11:23:04 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 100.677442] niks3-server[1047]: 2026/09/22 11:23:04 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 100.680812] niks3-server[1047]: 2026/09/22 11:23:04 INFO Completed upload id=28 lb # [ 100.682301] niks3-server[1047]: 2026/09/22 11:23:04 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 100.684318] niks3-server[1047]: 2026/09/22 11:23:04 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 100.686541] niks3-server[1047]: 2026/09/22 11:23:04 INFO Completed upload id=29 worker2 # [ 100.676515] nix-grpc-daemon[928]: time=2026-09-22T11:23:04.746Z level=INFO msg="Upload complete. (395ms)" worker2 # [ 100.679608] nix-grpc-daemon[789]: ts=2026-09-22T11:23:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 100.683419] nix-grpc-daemon[789]: ts=2026-09-22T11:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 100.691397] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 100.693578] nix-daemon[877]: reaped child process 1188, status = succeeded worker2 # [ 100.700186] nix-grpc-daemon[789]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 100.707052] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 101.720735] nix-daemon[877]: reaped child process 1203, status = succeeded worker2 # [ 101.868727] nix-daemon[877]: accepted connection from pid 1219, user nix-grpc-daemon (trusted) worker2 # [ 101.880797] nix-daemon[877]: reaped child process 1222, status = succeeded lb # [ 101.906246] niks3-server[1047]: 2026/09/22 11:23:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.904134] nix-grpc-daemon[928]: time=2026-09-22T11:23:05.974Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 101.934569] niks3-server[1047]: 2026/09/22 11:23:05 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 101.941879] niks3-server[1047]: 2026/09/22 11:23:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 101.946118] niks3-server[1047]: 2026/09/22 11:23:05 INFO Signed narinfos id=30 count=1 worker2 # [ 101.938837] nix-grpc-daemon[928]: time=2026-09-22T11:23:06.009Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.955764] niks3-server[1047]: 2026/09/22 11:23:05 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 101.967952] niks3-server[1047]: 2026/09/22 11:23:05 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 101.974224] niks3-server[1047]: 2026/09/22 11:23:05 INFO Completed upload id=30 worker2 # [ 101.963925] nix-grpc-daemon[928]: time=2026-09-22T11:23:06.034Z level=INFO msg="Upload complete. (248ms)" lb # [ 101.976914] niks3-server[1047]: 2026/09/22 11:23:05 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 101.968512] nix-grpc-daemon[789]: ts=2026-09-22T11:23:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 worker2 # [ 101.980208] nix-daemon[877]: reaped child process 1200, status = succeeded client # copying 1 paths... worker1 # [ 102.006467] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 102.015120] nix-grpc-daemon[786]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 102.041658] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 102.043938] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=0 paths=1 nar_bytes_out=120 client # [ 102.156061] nix-daemon[1104]: reaped child process 1190, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.67 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 102.336193] nix-daemon[1104]: accepted connection from pid 1209, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 102.498262] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36134 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 102.501264] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 102.506832] nix-grpc-daemon[867]: time=2026-09-22T11:23:05.739Z level=INFO msg="All 1 paths already cached" worker2 # [ 102.529040] nix-grpc-daemon[789]: ts=2026-09-22T11:23:06Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 102.531258] nix-grpc-daemon[789]: ts=2026-09-22T11:23:06Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 102.521597] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 102.529513] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36134 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 102.541520] nix-grpc-daemon[786]: ts=2026-09-22T11:23:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 102.545909] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 102.556555] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5) worker1 # [ 102.569049] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 194 ms (attempt 2/5) worker1 # [ 102.765792] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 189 ms (attempt 3/5) worker1 # [ 102.957891] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 205 ms (attempt 4/5) worker1 # [ 103.170428] nix-grpc-daemon[786]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 103.174829] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 103.180123] nix-grpc-daemon[786]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 103.381188] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 103.393421] nix-daemon[855]: reaped child process 1273, status = succeeded worker1 # [ 103.539256] nix-daemon[855]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker1 # [ 103.549732] nix-daemon[855]: reaped child process 1278, status = succeeded lb # [ 103.587431] niks3-server[1047]: 2026/09/22 11:23:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.576197] nix-grpc-daemon[867]: time=2026-09-22T11:23:06.808Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 103.578104] nix-grpc-daemon[867]: time=2026-09-22T11:23:06.810Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 103.619273] niks3-server[1047]: 2026/09/22 11:23:07 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 103.627694] niks3-server[1047]: 2026/09/22 11:23:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker1 # [ 103.610973] nix-grpc-daemon[867]: time=2026-09-22T11:23:06.843Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.632806] niks3-server[1047]: 2026/09/22 11:23:07 INFO Signed narinfos id=31 count=1 lb # [ 103.638670] niks3-server[1047]: 2026/09/22 11:23:07 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 103.648701] niks3-server[1047]: 2026/09/22 11:23:07 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 103.655328] niks3-server[1047]: 2026/09/22 11:23:07 INFO Completed upload id=31 worker1 # [ 103.633718] nix-grpc-daemon[867]: time=2026-09-22T11:23:06.866Z level=INFO msg="Upload complete. (434ms)" worker1 # [ 103.637237] nix-grpc-daemon[786]: ts=2026-09-22T11:23:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 103.659950] niks3-server[1047]: 2026/09/22 11:23:07 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 103.642544] nix-grpc-daemon[786]: ts=2026-09-22T11:23:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 103.652950] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker1 # [ 103.657494] nix-daemon[855]: reaped child process 1263, status = succeeded worker1 # [ 103.661781] nix-daemon[855]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 104.486310] nix-daemon[855]: reaped child process 1282, status = succeeded worker1 # [ 104.622435] nix-daemon[855]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) worker1 # [ 104.633940] nix-daemon[855]: reaped child process 1301, status = succeeded lb # [ 104.667928] niks3-server[1047]: 2026/09/22 11:23:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 104.654143] nix-grpc-daemon[867]: time=2026-09-22T11:23:07.886Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 104.696521] niks3-server[1047]: 2026/09/22 11:23:08 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 104.705462] niks3-server[1047]: 2026/09/22 11:23:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 104.711258] niks3-server[1047]: 2026/09/22 11:23:08 INFO Signed narinfos id=32 count=1 worker1 # [ 104.692633] nix-grpc-daemon[867]: time=2026-09-22T11:23:07.925Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.717051] niks3-server[1047]: 2026/09/22 11:23:08 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 104.729401] niks3-server[1047]: 2026/09/22 11:23:08 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete worker1 # [ 104.712418] nix-grpc-daemon[867]: time=2026-09-22T11:23:07.944Z level=INFO msg="Upload complete. (244ms)" lb # [ 104.734064] niks3-server[1047]: 2026/09/22 11:23:08 INFO Completed upload id=32 worker1 # [ 104.714931] nix-grpc-daemon[786]: ts=2026-09-22T11:23:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36134 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 lb # [ 104.738925] niks3-server[1047]: 2026/09/22 11:23:08 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo client # copying 1 paths... worker1 # [ 104.724571] nix-grpc-daemon[786]: ts=2026-09-22T11:23:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 104.727608] nix-daemon[855]: reaped child process 1280, status = succeeded client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 104.757052] nix-grpc-daemon[789]: ts=2026-09-22T11:23:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 104.765271] nix-grpc-daemon[789]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 104.773390] nix-grpc-daemon[789]: ts=2026-09-22T11:23:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_out=120 client # [ 104.860316] nix-daemon[1104]: reaped child process 1212, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.70 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 105.034232] nix-daemon[1104]: accepted connection from pid 1231, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 105.217770] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36244 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 105.220769] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 105.226594] nix-grpc-daemon[928]: time=2026-09-22T11:23:09.296Z level=INFO msg="All 1 paths already cached" worker2 # [ 105.235845] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 105.238108] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 105.240516] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 105.247759] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 105.255377] nix-grpc-daemon[928]: time=2026-09-22T11:23:09.325Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 105.259861] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 105.265601] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 105.396442] nix-daemon[877]: accepted connection from pid 1231, user nix-grpc-daemon (trusted) worker2 # [ 105.410320] nix-daemon[877]: reaped child process 1234, status = succeeded worker2 # [ 105.543403] nix-daemon[877]: accepted connection from pid 1236, user nix-grpc-daemon (trusted) worker2 # [ 105.556623] nix-daemon[877]: reaped child process 1239, status = succeeded lb # [ 105.578128] niks3-server[1047]: 2026/09/22 11:23:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 105.577212] nix-grpc-daemon[928]: time=2026-09-22T11:23:09.647Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 105.578549] nix-grpc-daemon[928]: time=2026-09-22T11:23:09.647Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 105.604668] niks3-server[1047]: 2026/09/22 11:23:09 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 105.614748] niks3-server[1047]: 2026/09/22 11:23:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 105.620991] niks3-server[1047]: 2026/09/22 11:23:09 INFO Signed narinfos id=33 count=1 worker2 # [ 105.613868] nix-grpc-daemon[928]: time=2026-09-22T11:23:09.684Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.628258] niks3-server[1047]: 2026/09/22 11:23:09 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 105.637641] niks3-server[1047]: 2026/09/22 11:23:09 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete worker2 # [ 105.632872] nix-grpc-daemon[928]: time=2026-09-22T11:23:09.703Z level=INFO msg="Upload complete. (362ms)" lb # [ 105.643127] niks3-server[1047]: 2026/09/22 11:23:09 INFO Completed upload id=33 worker2 # [ 105.636070] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 105.646607] niks3-server[1047]: 2026/09/22 11:23:09 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 105.640545] nix-grpc-daemon[789]: ts=2026-09-22T11:23:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 105.647323] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) worker2 # [ 105.649720] nix-daemon[877]: reaped child process 1229, status = succeeded client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 105.655082] nix-daemon[877]: accepted connection from pid 789, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 106.687636] nix-daemon[877]: reaped child process 1243, status = succeeded lb # [ 106.781351] envoy[899]: conn peer=[2001:db8:1::1]:43414 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4353 tx=2410 ms=1784 lb # [ 106.783137] envoy[899]: conn peer=[2001:db8:1::1]:43426 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=74 lb # [ 106.784874] envoy[899]: conn peer=[2001:db8:1::1]:43432 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3879 tx=2059 ms=2182 lb # [ 106.786491] envoy[899]: conn peer=[2001:db8:1::1]:43442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=54 lb # [ 106.788060] envoy[899]: conn peer=[2001:db8:1::1]:43454 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3740 tx=2119 ms=2311 lb # [ 106.789757] envoy[899]: conn peer=[2001:db8:1::1]:42414 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=68 worker2 # [ 106.827978] nix-daemon[877]: accepted connection from pid 1259, user nix-grpc-daemon (trusted) worker2 # [ 106.841849] nix-daemon[877]: reaped child process 1262, status = succeeded lb # [ 106.864450] niks3-server[1047]: 2026/09/22 11:23:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 106.860397] nix-grpc-daemon[928]: time=2026-09-22T11:23:10.929Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 106.877716] niks3-server[1047]: 2026/09/22 11:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 106.880319] niks3-server[1047]: 2026/09/22 11:23:10 INFO Signed narinfos id=34 count=1 worker2 # [ 106.870406] nix-grpc-daemon[928]: time=2026-09-22T11:23:10.940Z level=INFO msg="Uploading 1 narinfos" lb # [ 106.883596] niks3-server[1047]: 2026/09/22 11:23:10 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 106.886066] niks3-server[1047]: 2026/09/22 11:23:10 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 106.890152] niks3-server[1047]: 2026/09/22 11:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 106.892827] niks3-server[1047]: 2026/09/22 11:23:10 INFO Completed upload id=34 worker2 # [ 106.882782] nix-grpc-daemon[928]: time=2026-09-22T11:23:10.953Z level=INFO msg="Upload complete. (220ms)" lb # [ 106.895142] niks3-server[1047]: 2026/09/22 11:23:10 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 106.885476] nix-grpc-daemon[789]: ts=2026-09-22T11:23:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker2 # [ 106.893022] nix-daemon[877]: reaped child process 1241, status = succeeded client # copying 1 paths... worker2 # [ 106.931413] nix-grpc-daemon[789]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36244 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 106.950592] nix-grpc-daemon[789]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 worker2 # [ 106.954614] nix-grpc-daemon[789]: ts=2026-09-22T11:23:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36244 duration_s=0 paths=1 nar_bytes_out=120 client # [ 107.056397] nix-daemon[1104]: reaped child process 1234, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.20 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 8.43 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.36 seconds) client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds) worker2 # [ 108.192611] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 108.435878] nix-grpc-daemon[789]: ts=2026-09-22T11:23:12Z level=info event=signal_exit lb # [ 108.727909] niks3-server[1047]: 2026/09/22 11:23:12 INFO lead: released remote=192.168.1.4:41544 worker1 # [ 109.709121] nix-grpc-daemon[786]: ts=2026-09-22T11:23:12Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 109.725319] nix-grpc-daemon[789]: ts=2026-09-22T11:23:13Z level=info event=scheduler_restarting worker2 # [ 109.728378] nix-grpc-daemon[789]: ts=2026-09-22T11:23:13Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 109.731874] nix-grpc-daemon[789]: ts=2026-09-22T11:23:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36240 worker2 # [ 109.735219] nix-grpc-daemon[789]: ts=2026-09-22T11:23:13Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 109.738268] nix-grpc-daemon[789]: ts=2026-09-22T11:23:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36240 worker2 # [ 109.742433] nix-grpc-daemon[789]: ts=2026-09-22T11:23:13Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 109.761649] nix-daemon[877]: reaped child process 879, status = succeeded worker1 # [ 109.909431] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.913971] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.936279] nix-grpc-daemon[789]: ts=2026-09-22T11:23:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 110.114319] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.116091] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.169919] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 110.171535] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 110.173315] systemd[1]: nix-grpc-daemon.service: Consumed 2.626s CPU time over 1min 33.028s wall clock time, 58.4M memory peak, 97.1K incoming IP traffic, 284.4K outgoing IP traffic. worker2 # [ 110.177330] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 110.179063] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 110.180469] systemd[1]: nix-grpc-daemon.socket: Consumed 279us CPU time over 1min 40.849s wall clock time, 256K memory peak, 114.1K incoming IP traffic, 96.2K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.04 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 110.316805] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.320710] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 110.365735] niks3-server[1047]: 2026/09/22 11:23:13 INFO lead: acquired remote=192.168.1.3:43918 worker1 # [ 110.347190] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_take_over worker1 # [ 110.416593] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36134 worker1 # [ 110.422988] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36134 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 110.515797] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 110.521678] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.526820] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.572584] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 110.615918] systemd[1]: Starting scheduler-token.service... worker2 # [ 110.674557] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 110.675871] systemd[1]: Finished scheduler-token.service. worker2 # [ 110.677327] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 58ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 110.682291] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 110.729147] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.732461] nix-grpc-daemon[786]: ts=2026-09-22T11:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.815030] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 110.817244] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 110.820785] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 110.827065] nix-grpc-daemon[1286]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 110.830109] nix-grpc-daemon[1286]: E0000 00:00:1790076194.897336 1286 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 110.834379] nix-grpc-daemon[1286]: E0000 00:00:1790076194.900574 1286 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 110.838136] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 110.839667] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 110.848073] nix-grpc-daemon[1286]: E0000 00:00:1790076194.917995 1327 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 110.861062] nix-grpc-daemon[1286]: E0000 00:00:1790076194.931483 1327 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 110.864212] nix-grpc-daemon[1286]: E0000 00:00:1790076194.933681 1327 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 110.875524] nix-grpc-daemon[1286]: E0000 00:00:1790076194.945961 1327 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 110.883256] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 110.884987] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.929627] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.933777] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.085580] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.087366] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.087966] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=signal_exit worker1 # [ 111.134743] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.138876] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.288257] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.290207] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.340202] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.344184] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 111.410627] niks3-server[1047]: 2026/09/22 11:23:14 INFO lead: released remote=192.168.1.3:43918 worker2 # [ 111.490825] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.492538] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.545498] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.549675] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.693293] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.694969] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.752247] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.755492] nix-grpc-daemon[786]: ts=2026-09-22T11:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.897501] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.900599] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.952915] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.957386] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.098335] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.102303] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.158288] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.162238] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.303319] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.307194] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.363190] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.367252] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.387618] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=scheduler_restarting worker1 # [ 112.413227] nix-daemon[855]: reaped child process 857, status = succeeded worker2 # [ 112.508384] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.512197] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.581179] nix-grpc-daemon[786]: ts=2026-09-22T11:23:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 112.713318] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.717190] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.919425] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.922525] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.120256] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.122041] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.262667] nix-grpc-daemon[786]: E0000 00:00:1790076196.493982 831 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 113.267562] nix-grpc-daemon[786]: E0000 00:00:1790076196.494259 831 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 113.323166] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.327099] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.527653] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.529511] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.730279] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.732116] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.933939] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.937768] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.105507] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 114.109818] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 114.111989] systemd[1]: nix-grpc-daemon.service: Consumed 3.253s CPU time over 1min 37.356s wall clock time, 62.1M memory peak, 112.4K incoming IP traffic, 213.3K outgoing IP traffic. worker1 # [ 114.122457] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 114.125862] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 114.139329] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.128677] systemd[1]: nix-grpc-daemon.socket: Consumed 284us CPU time over 1min 43.957s wall clock time, 256K memory peak, 110.3K incoming IP traffic, 96K outgoing IP traffic. worker2 # [ 114.143409] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 114.344639] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.348635] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.405617] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 114.414953] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 114.434517] nix-grpc-daemon[1286]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 1/5) worker2 # [ 114.465510] nix-grpc-daemon[1286]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5) worker2 # [ 114.549645] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.553602] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.611612] nix-grpc-daemon[1286]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 3/5) worker2 # [ 114.754364] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.756386] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.801176] nix-grpc-daemon[1286]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 797 ms (attempt 4/5) worker2 # [ 114.957795] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.959925] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.161386] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.165251] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.365811] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.367670] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.568416] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.570156] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.601518] nix-grpc-daemon[1286]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 115.603746] nix-grpc-daemon[1286]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 115.623164] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 115.636697] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 115.655451] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=niks3_push_started pid=1346 worker2 # [ 115.771057] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.773125] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.838912] nix-grpc-daemon[1346]: time=2026-09-22T11:23:19.908Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 115.847760] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:19Z level=info event=scheduler_take_over lb # [ 115.858745] niks3-server[1047]: 2026/09/22 11:23:19 INFO lead: acquired remote=192.168.1.4:35912 worker2 # [ 115.975691] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.985062] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:20Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 115.986897] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:20Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38946 worker2 # [ 115.988474] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 115.997075] nix-daemon[877]: accepted connection from pid 1359, user nix-grpc-daemon (trusted) worker2 # [ 116.009543] nix-daemon[877]: reaped child process 1362, status = succeeded lb # [ 116.031863] niks3-server[1047]: 2026/09/22 11:23:19 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 116.038793] niks3-server[1047]: 2026/09/22 11:23:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 116.033427] nix-grpc-daemon[1346]: time=2026-09-22T11:23:20.103Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 116.035058] nix-grpc-daemon[1346]: time=2026-09-22T11:23:20.105Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 116.037132] nix-grpc-daemon[1346]: time=2026-09-22T11:23:20.107Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 116.076460] niks3-server[1047]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 116.090593] niks3-server[1047]: 2026/09/22 11:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 116.092554] niks3-server[1047]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 116.097120] niks3-server[1047]: 2026/09/22 11:23:19 INFO Signed narinfos id=35 count=1 lb # [ 116.100105] niks3-server[1047]: 2026/09/22 11:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 116.102222] niks3-server[1047]: 2026/09/22 11:23:19 INFO Signed narinfos id=36 count=2 worker2 # [ 116.094106] nix-grpc-daemon[1346]: time=2026-09-22T11:23:20.163Z level=INFO msg="Uploading 3 narinfos" lb # [ 116.127780] niks3-server[1047]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 116.138926] niks3-server[1047]: 2026/09/22 11:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 116.166405] niks3-server[1047]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 116.172858] niks3-server[1047]: 2026/09/22 11:23:19 INFO Completed upload id=35 lb # [ 116.174563] niks3-server[1047]: 2026/09/22 11:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 116.176689] niks3-server[1047]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 116.179117] niks3-server[1047]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 116.183257] niks3-server[1047]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 116.187130] niks3-server[1047]: 2026/09/22 11:23:19 INFO Completed upload id=36 worker2 # [ 116.177251] nix-grpc-daemon[1346]: time=2026-09-22T11:23:20.247Z level=INFO msg="Upload complete. (334ms)" worker2 # [ 116.181525] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 116.191711] nix-daemon[877]: reaped child process 1344, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 2.01 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 116.290564] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 116.298335] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 116.449307] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 116.451061] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 116.454919] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 116.460065] nix-grpc-daemon[1324]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 116.461347] nix-grpc-daemon[1324]: E0000 00:00:1790076199.692241 1324 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 116.467110] nix-grpc-daemon[1324]: E0000 00:00:1790076199.697382 1324 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 116.472867] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 116.475279] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 116.480122] nix-grpc-daemon[1324]: E0000 00:00:1790076199.711390 1365 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 116.492735] nix-grpc-daemon[1324]: E0000 00:00:1790076199.725213 1365 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 116.497849] nix-grpc-daemon[1324]: E0000 00:00:1790076199.727795 1365 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 116.507548] nix-grpc-daemon[1324]: E0000 00:00:1790076199.739967 1365 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 116.517257] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.530329] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38946 worker2 # [ 116.531925] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb # [ 116.781836] envoy[899]: conn peer=[2001:db8:1::1]:42426 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=54 lb # [ 116.784224] envoy[899]: conn peer=[2001:db8:1::1]:42416 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3755 tx=2099 ms=1789 lb # [ 116.786234] envoy[899]: conn peer=[2001:db8:1::4]:39682 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=95747 tx=4537 ms=92433 lb # [ 116.788412] envoy[899]: conn peer=[2001:db8:1::1]:42430 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=17 lb # [ 116.790542] envoy[899]: conn peer=[2001:db8:1::3]:54536 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=26532 tx=5045 ms=94627 lb # [ 116.792621] envoy[899]: conn peer=[2001:db8:1::1]:45784 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=305 ms=1790 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.53 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb # [ 117.731432] niks3-server[1047]: 2026/09/22 11:23:21 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 117.735069] niks3-server[1047]: 2026/09/22 11:23:21 INFO lead: released remote=192.168.1.4:35912 lb # [ 117.737716] systemd[1]: Stopping niks3 server... worker1 # [ 117.714980] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:20Z level=info event=scheduler_lock_lost status=200 worker2 # [ 117.727260] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:21Z level=info event=scheduler_lock_lost status=200 lb # [ 117.756588] systemd[1]: niks3.service: Deactivated successfully. lb # [ 117.758435] systemd[1]: Stopped niks3 server. lb # [ 117.759226] systemd[1]: niks3.service: Consumed 766ms CPU time over 1min 27.806s wall clock time, 22.5M memory peak, 100K incoming IP traffic, 142.3K outgoing IP traffic. lb # [ 117.768929] systemd[1]: Starting niks3 server... lb # [ 117.846130] niks3-server[1194]: 2026/09/22 11:23:21 goose: no migrations to run. current version: 20260920000000 lb # [ 117.854315] niks3-server[1194]: 2026/09/22 11:23:21 OK 1_commit_pending_closure.sql (6.27ms) lb # [ 117.859166] niks3-server[1194]: 2026/09/22 11:23:21 OK 2_object_stats_trigger.sql (2.71ms) lb # [ 117.860423] niks3-server[1194]: 2026/09/22 11:23:21 goose: up to current file version: 2 lb # [ 117.863545] niks3-server[1194]: 2026/09/22 11:23:21 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key lb # [ 117.878845] niks3-server[1194]: 2026/09/22 11:23:21 INFO Read proxy enabled — serving cache objects from S3 lb # [ 117.880483] niks3-server[1194]: 2026/09/22 11:23:21 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 117.883056] niks3-server[1194]: 2026/09/22 11:23:21 INFO systemd watchdog enabled interval=15s lb # [ 117.884347] systemd[1]: Started niks3 server. lb # [ 117.886117] niks3-server[1194]: 2026/09/22 11:23:21 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 118.346899] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38932 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 118.356279] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 118.382164] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 118.386141] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 118.435709] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 118.449450] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38932 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 118.462386] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 118.473124] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 118.638158] nix-daemon[877]: accepted connection from pid 1379, user nix-grpc-daemon (trusted) worker2 # [ 118.652715] nix-daemon[877]: reaped child process 1382, status = succeeded lb # [ 118.739895] niks3-server[1194]: 2026/09/22 11:23:22 INFO lead: acquired remote=192.168.1.4:35682 worker2 # [ 118.793271] nix-daemon[877]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 118.806713] nix-daemon[877]: reaped child process 1389, status = succeeded lb # [ 118.832126] niks3-server[1194]: 2026/09/22 11:23:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 118.835849] nix-grpc-daemon[1346]: time=2026-09-22T11:23:22.906Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 118.837434] nix-grpc-daemon[1346]: time=2026-09-22T11:23:22.907Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 118.866911] niks3-server[1194]: 2026/09/22 11:23:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 118.870259] niks3-server[1194]: 2026/09/22 11:23:22 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 118.882872] niks3-server[1194]: 2026/09/22 11:23:22 INFO Signed narinfos id=37 count=1 worker2 # [ 118.874615] nix-grpc-daemon[1346]: time=2026-09-22T11:23:22.945Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.894602] niks3-server[1194]: 2026/09/22 11:23:22 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 118.897156] niks3-server[1194]: 2026/09/22 11:23:22 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 118.904052] niks3-server[1194]: 2026/09/22 11:23:22 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo lb # [ 118.908673] niks3-server[1194]: 2026/09/22 11:23:22 INFO Completed upload id=37 worker2 # [ 118.898730] nix-grpc-daemon[1346]: time=2026-09-22T11:23:22.969Z level=INFO msg="Upload complete. (413ms)" worker2 # [ 118.902055] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 118.906456] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 118.913646] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 118.917599] nix-daemon[877]: reaped child process 1377, status = succeeded client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... worker2 # [ 118.923286] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 120.341716] nix-daemon[877]: reaped child process 1393, status = succeeded worker2 # [ 120.463066] nix-daemon[877]: accepted connection from pid 1409, user nix-grpc-daemon (trusted) worker2 # [ 120.475577] nix-daemon[877]: reaped child process 1412, status = succeeded lb # [ 120.496163] niks3-server[1194]: 2026/09/22 11:23:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.525695] nix-grpc-daemon[1346]: time=2026-09-22T11:23:24.595Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.529066] nix-grpc-daemon[1346]: time=2026-09-22T11:23:24.597Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 120.570758] niks3-server[1194]: 2026/09/22 11:23:23 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 120.581382] niks3-server[1194]: 2026/09/22 11:23:23 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 120.589961] niks3-server[1194]: 2026/09/22 11:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 120.595048] niks3-server[1194]: 2026/09/22 11:23:24 INFO Signed narinfos id=38 count=1 worker2 # [ 120.585678] nix-grpc-daemon[1346]: time=2026-09-22T11:23:24.655Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.600440] niks3-server[1194]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 120.610385] niks3-server[1194]: 2026/09/22 11:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 120.613733] niks3-server[1194]: 2026/09/22 11:23:24 INFO Completed upload id=38 worker2 # [ 120.604095] nix-grpc-daemon[1346]: time=2026-09-22T11:23:24.674Z level=INFO msg="Upload complete. (272ms)" lb # [ 120.616754] niks3-server[1194]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 120.616695] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 120.624827] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:24Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 120.629259] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:24Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 120.640154] nix-daemon[877]: reaped child process 1391, status = succeeded worker2 # [ 120.667564] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 120.678516] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 120.689092] nix-grpc-daemon[1346]: time=2026-09-22T11:23:24.759Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 120.695221] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 120.701689] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 120.855443] nix-daemon[877]: accepted connection from pid 1418, user nix-grpc-daemon (trusted) worker2 # [ 120.875056] nix-daemon[877]: reaped child process 1421, status = succeeded worker2 # [ 121.006576] nix-daemon[877]: accepted connection from pid 1423, user nix-grpc-daemon (trusted) worker2 # [ 121.020620] nix-daemon[877]: reaped child process 1426, status = succeeded lb # [ 121.040790] niks3-server[1194]: 2026/09/22 11:23:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 121.036139] nix-grpc-daemon[1346]: time=2026-09-22T11:23:25.106Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 121.037531] nix-grpc-daemon[1346]: time=2026-09-22T11:23:25.106Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 121.057694] niks3-server[1194]: 2026/09/22 11:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 121.060928] niks3-server[1194]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 121.063424] niks3-server[1194]: 2026/09/22 11:23:24 INFO Signed narinfos id=39 count=1 worker2 # [ 121.053657] nix-grpc-daemon[1346]: time=2026-09-22T11:23:25.123Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.066768] niks3-server[1194]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 121.071649] niks3-server[1194]: 2026/09/22 11:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 121.077090] niks3-server[1194]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo lb # [ 121.080474] niks3-server[1194]: 2026/09/22 11:23:24 INFO Completed upload id=39 worker2 # [ 121.070479] nix-grpc-daemon[1346]: time=2026-09-22T11:23:25.140Z level=INFO msg="Upload complete. (363ms)" worker2 # [ 121.072964] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 121.075625] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 121.082072] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 121.087491] nix-daemon[877]: reaped child process 1416, status = succeeded worker2 # [ 121.092202] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 121.706314] nix-daemon[877]: reaped child process 1430, status = succeeded worker2 # [ 121.819279] nix-daemon[877]: accepted connection from pid 1446, user nix-grpc-daemon (trusted) worker2 # [ 121.833200] nix-daemon[877]: reaped child process 1449, status = succeeded lb # [ 121.854297] niks3-server[1194]: 2026/09/22 11:23:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 121.858449] nix-grpc-daemon[1346]: time=2026-09-22T11:23:25.928Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 121.860118] nix-grpc-daemon[1346]: time=2026-09-22T11:23:25.930Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 121.897113] niks3-server[1194]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 121.911374] niks3-server[1194]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 121.921347] niks3-server[1194]: 2026/09/22 11:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 121.926627] niks3-server[1194]: 2026/09/22 11:23:25 INFO Signed narinfos id=40 count=1 worker2 # [ 121.919464] nix-grpc-daemon[1346]: time=2026-09-22T11:23:25.989Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.934046] niks3-server[1194]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 121.941347] niks3-server[1194]: 2026/09/22 11:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 121.945841] niks3-server[1194]: 2026/09/22 11:23:25 INFO Completed upload id=40 worker2 # [ 121.936096] nix-grpc-daemon[1346]: time=2026-09-22T11:23:26.006Z level=INFO msg="Upload complete. (237ms)" lb # [ 121.947888] niks3-server[1194]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 121.939032] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 duration_s=0 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 121.945874] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 121.948325] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 121.952882] nix-daemon[877]: reaped child process 1428, status = succeeded worker2 # [ 121.989918] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 121.998925] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 122.007142] nix-grpc-daemon[1346]: time=2026-09-22T11:23:26.077Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 122.012627] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 122.016405] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 122.133598] nix-daemon[877]: accepted connection from pid 1455, user nix-grpc-daemon (trusted) worker2 # [ 122.148705] nix-daemon[877]: reaped child process 1458, status = succeeded worker2 # [ 122.265367] nix-daemon[877]: accepted connection from pid 1460, user nix-grpc-daemon (trusted) worker2 # [ 122.278847] nix-daemon[877]: reaped child process 1463, status = succeeded lb # [ 122.299295] niks3-server[1194]: 2026/09/22 11:23:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 122.301450] nix-grpc-daemon[1346]: time=2026-09-22T11:23:26.371Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 122.303060] nix-grpc-daemon[1346]: time=2026-09-22T11:23:26.373Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 122.336242] niks3-server[1194]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 122.345959] niks3-server[1194]: 2026/09/22 11:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker2 # [ 122.340425] nix-grpc-daemon[1346]: time=2026-09-22T11:23:26.410Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.350492] niks3-server[1194]: 2026/09/22 11:23:25 INFO Signed narinfos id=41 count=1 lb # [ 122.358222] niks3-server[1194]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 122.366874] niks3-server[1194]: 2026/09/22 11:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 122.371331] niks3-server[1194]: 2026/09/22 11:23:25 INFO Completed upload id=41 worker2 # [ 122.361340] nix-grpc-daemon[1346]: time=2026-09-22T11:23:26.431Z level=INFO msg="Upload complete. (338ms)" lb # [ 122.373857] niks3-server[1194]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 122.363775] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38932 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 122.368698] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 worker2 # [ 122.374781] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) worker2 # [ 122.377158] nix-daemon[877]: reaped child process 1453, status = succeeded worker2 # [ 122.382707] nix-daemon[877]: accepted connection from pid 1286, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 123.398793] nix-daemon[877]: reaped child process 1467, status = succeeded worker2 # [ 123.518761] nix-daemon[877]: accepted connection from pid 1483, user nix-grpc-daemon (trusted) worker2 # [ 123.533077] nix-daemon[877]: reaped child process 1486, status = succeeded lb # [ 123.552693] niks3-server[1194]: 2026/09/22 11:23:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.550031] nix-grpc-daemon[1346]: time=2026-09-22T11:23:27.620Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 123.553322] nix-grpc-daemon[1346]: time=2026-09-22T11:23:27.622Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 123.578689] niks3-server[1194]: 2026/09/22 11:23:26 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 123.584674] niks3-server[1194]: 2026/09/22 11:23:26 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 123.594349] niks3-server[1194]: 2026/09/22 11:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 123.589604] nix-grpc-daemon[1346]: time=2026-09-22T11:23:27.659Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.599478] niks3-server[1194]: 2026/09/22 11:23:27 INFO Signed narinfos id=42 count=1 lb # [ 123.601902] niks3-server[1194]: 2026/09/22 11:23:27 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 123.607145] niks3-server[1194]: 2026/09/22 11:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 123.610232] niks3-server[1194]: 2026/09/22 11:23:27 INFO Completed upload id=42 worker2 # [ 123.600259] nix-grpc-daemon[1346]: time=2026-09-22T11:23:27.670Z level=INFO msg="Upload complete. (210ms)" lb # [ 123.611742] niks3-server[1194]: 2026/09/22 11:23:27 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 123.602943] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38932 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 123.611671] nix-daemon[877]: reaped child process 1465, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2, in 5.54 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath, in 0.17 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.25 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 124.020485] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 124.837981] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:28Z level=info event=signal_exit lb # [ 124.946735] niks3-server[1194]: 2026/09/22 11:23:28 INFO lead: released remote=192.168.1.4:35682 worker1 # [ 125.925651] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 125.941590] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:30Z level=info event=scheduler_restarting worker2 # [ 125.945552] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:30Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 125.948925] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38946 worker2 # [ 125.952537] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:30Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 125.955898] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38946 worker2 # [ 125.959375] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:30Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 125.976711] nix-daemon[877]: reaped child process 1338, status = succeeded worker1 # [ 126.125458] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 126.127516] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 126.149817] nix-grpc-daemon[1286]: ts=2026-09-22T11:23:30Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 126.328723] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 126.332944] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 126.533828] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 126.537774] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 126.738811] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 126.742906] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 126.783152] envoy[899]: conn peer=[2001:db8:1::1]:45788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9739 tx=4464 ms=5313 lb # [ 126.786842] envoy[899]: conn peer=[2001:db8:1::4]:40740 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=22397 tx=1359 ms=15259 worker2 # [ 126.877231] nix-grpc-daemon[1286]: E0000 00:00:1790076210.947584 1331 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker2 # [ 126.879449] nix-grpc-daemon[1286]: E0000 00:00:1790076210.947676 1331 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 126.945735] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 126.948909] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.146362] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.150141] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.350591] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.352405] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.553409] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.557314] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.757613] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.761170] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.962113] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.963689] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.022685] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 128.024305] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 128.025351] systemd[1]: nix-grpc-daemon.service: Consumed 1.126s CPU time over 17.339s wall clock time, 35.2M memory peak, 49.8K incoming IP traffic, 105.1K outgoing IP traffic. worker2 # [ 128.029592] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 128.031358] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 128.032542] systemd[1]: nix-grpc-daemon.socket: Consumed 330us CPU time over 17.520s wall clock time, 256K memory peak, 38.7K incoming IP traffic, 28.9K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 128.164067] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.165765] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.366377] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.368119] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.568650] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.570502] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 128.741362] niks3-server[1194]: 2026/09/22 11:23:32 INFO lead: acquired remote=192.168.1.3:37478 worker1 # [ 128.719710] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:31Z level=info event=scheduler_take_over worker1 # [ 128.771084] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.772870] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.973901] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.975656] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 129.176065] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.179997] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:32Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:33692 worker1 # [ 129.182410] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:32Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2 worker1 # [ 130.389248] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 130.400266] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 130.414604] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 130.425224] nix-grpc-daemon[1324]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5) worker1 # [ 130.510082] nix-grpc-daemon[1324]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 107 ms (attempt 2/5) worker1 # [ 130.623352] nix-grpc-daemon[1324]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 3/5) worker1 # [ 130.772296] nix-grpc-daemon[1324]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 4/5) worker1 # [ 130.838426] nix-grpc-daemon[1324]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 130.842188] nix-grpc-daemon[1324]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 130.868832] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 130.874132] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 130.913180] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 130.925717] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33706 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 130.937087] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 130.945509] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 130.966395] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=info event=niks3_push_started pid=1403 worker1 # [ 131.120514] nix-grpc-daemon[1403]: time=2026-09-22T11:23:34.352Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 131.257957] nix-daemon[855]: accepted connection from pid 1416, user nix-grpc-daemon (trusted) worker1 # [ 131.270195] nix-daemon[855]: reaped child process 1419, status = succeeded worker1 # [ 131.386226] nix-daemon[855]: accepted connection from pid 1421, user nix-grpc-daemon (trusted) worker1 # [ 131.398808] nix-daemon[855]: reaped child process 1424, status = succeeded lb # [ 131.431430] niks3-server[1194]: 2026/09/22 11:23:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 131.414489] nix-grpc-daemon[1403]: time=2026-09-22T11:23:34.646Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 131.417906] nix-grpc-daemon[1403]: time=2026-09-22T11:23:34.648Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 131.453195] niks3-server[1194]: 2026/09/22 11:23:34 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 131.455833] niks3-server[1194]: 2026/09/22 11:23:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 131.457901] niks3-server[1194]: 2026/09/22 11:23:34 INFO Signed narinfos id=43 count=1 worker1 # [ 131.436810] nix-grpc-daemon[1403]: time=2026-09-22T11:23:34.669Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.462535] niks3-server[1194]: 2026/09/22 11:23:34 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 131.466414] niks3-server[1194]: 2026/09/22 11:23:34 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 131.470722] niks3-server[1194]: 2026/09/22 11:23:34 INFO Completed upload id=43 worker1 # [ 131.448830] nix-grpc-daemon[1403]: time=2026-09-22T11:23:34.681Z level=INFO msg="Upload complete. (324ms)" lb # [ 131.472280] niks3-server[1194]: 2026/09/22 11:23:34 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 131.451449] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 131.454992] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 131.461970] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 131.464329] nix-daemon[855]: reaped child process 1401, status = succeeded client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker1 # [ 131.469607] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 132.082994] nix-daemon[855]: reaped child process 1428, status = succeeded worker1 # [ 132.214081] nix-daemon[855]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) worker1 # [ 132.227526] nix-daemon[855]: reaped child process 1447, status = succeeded lb # [ 132.256580] niks3-server[1194]: 2026/09/22 11:23:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.242318] nix-grpc-daemon[1403]: time=2026-09-22T11:23:35.473Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 132.243714] nix-grpc-daemon[1403]: time=2026-09-22T11:23:35.473Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 132.281647] niks3-server[1194]: 2026/09/22 11:23:35 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 132.290724] niks3-server[1194]: 2026/09/22 11:23:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 132.295488] niks3-server[1194]: 2026/09/22 11:23:35 INFO Signed narinfos id=44 count=1 worker1 # [ 132.274386] nix-grpc-daemon[1403]: time=2026-09-22T11:23:35.506Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.299414] niks3-server[1194]: 2026/09/22 11:23:35 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 132.309517] niks3-server[1194]: 2026/09/22 11:23:35 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 132.314611] niks3-server[1194]: 2026/09/22 11:23:35 INFO Completed upload id=44 worker1 # [ 132.292671] nix-grpc-daemon[1403]: time=2026-09-22T11:23:35.525Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 132.295141] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=0 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 lb # [ 132.317744] niks3-server[1194]: 2026/09/22 11:23:35 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo lb # [ 132.324544] niks3-server[1194]: 2026/09/22 11:23:35 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls worker1 # [ 132.306714] nix-daemon[855]: reaped child process 1426, status = succeeded worker1 # [ 132.308924] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:35Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 132.311058] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:35Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 132.352915] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 132.364207] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 132.378322] nix-grpc-daemon[1403]: time=2026-09-22T11:23:35.610Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 132.387141] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 132.398117] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 132.547443] nix-daemon[855]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) worker1 # [ 132.566129] nix-daemon[855]: reaped child process 1456, status = succeeded worker1 # [ 132.705127] nix-daemon[855]: accepted connection from pid 1458, user nix-grpc-daemon (trusted) worker1 # [ 132.717991] nix-daemon[855]: reaped child process 1461, status = succeeded lb # [ 132.749968] niks3-server[1194]: 2026/09/22 11:23:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.738922] nix-grpc-daemon[1403]: time=2026-09-22T11:23:35.971Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 132.740560] nix-grpc-daemon[1403]: time=2026-09-22T11:23:35.973Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 132.783134] niks3-server[1194]: 2026/09/22 11:23:36 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 132.793791] niks3-server[1194]: 2026/09/22 11:23:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign worker1 # [ 132.778934] nix-grpc-daemon[1403]: time=2026-09-22T11:23:36.011Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.800442] niks3-server[1194]: 2026/09/22 11:23:36 INFO Signed narinfos id=45 count=1 lb # [ 132.803942] niks3-server[1194]: 2026/09/22 11:23:36 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 132.815391] niks3-server[1194]: 2026/09/22 11:23:36 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 132.822215] niks3-server[1194]: 2026/09/22 11:23:36 INFO Completed upload id=45 worker1 # [ 132.800475] nix-grpc-daemon[1403]: time=2026-09-22T11:23:36.032Z level=INFO msg="Upload complete. (392ms)" lb # [ 132.823860] niks3-server[1194]: 2026/09/22 11:23:36 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 132.803865] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 132.806802] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 132.814302] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 132.817083] nix-daemon[855]: reaped child process 1451, status = succeeded worker1 # [ 132.822342] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 133.436360] nix-daemon[855]: reaped child process 1465, status = succeeded worker1 # [ 133.580384] nix-daemon[855]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) worker1 # [ 133.593537] nix-daemon[855]: reaped child process 1484, status = succeeded lb # [ 133.630904] niks3-server[1194]: 2026/09/22 11:23:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.615965] nix-grpc-daemon[1403]: time=2026-09-22T11:23:36.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 133.617441] nix-grpc-daemon[1403]: time=2026-09-22T11:23:36.847Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 133.649628] niks3-server[1194]: 2026/09/22 11:23:37 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 133.657748] niks3-server[1194]: 2026/09/22 11:23:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 133.660604] niks3-server[1194]: 2026/09/22 11:23:37 INFO Signed narinfos id=46 count=1 worker1 # [ 133.640711] nix-grpc-daemon[1403]: time=2026-09-22T11:23:36.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.665867] niks3-server[1194]: 2026/09/22 11:23:37 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 133.668586] niks3-server[1194]: 2026/09/22 11:23:37 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 133.675662] niks3-server[1194]: 2026/09/22 11:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 133.680332] niks3-server[1194]: 2026/09/22 11:23:37 INFO Completed upload id=46 worker1 # [ 133.658739] nix-grpc-daemon[1403]: time=2026-09-22T11:23:36.891Z level=INFO msg="Upload complete. (230ms)" lb # [ 133.681723] niks3-server[1194]: 2026/09/22 11:23:37 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 133.661283] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=0 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 133.668643] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 133.672284] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.674930] nix-daemon[855]: reaped child process 1463, status = succeeded worker1 # [ 133.711519] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 133.720743] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 133.731440] nix-grpc-daemon[1403]: time=2026-09-22T11:23:36.963Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 133.739804] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 133.746835] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 133.897892] nix-daemon[855]: accepted connection from pid 1490, user nix-grpc-daemon (trusted) worker1 # [ 133.912070] nix-daemon[855]: reaped child process 1493, status = succeeded worker1 # [ 134.067600] nix-daemon[855]: accepted connection from pid 1495, user nix-grpc-daemon (trusted) worker1 # [ 134.080891] nix-daemon[855]: reaped child process 1498, status = succeeded lb # [ 134.111631] niks3-server[1194]: 2026/09/22 11:23:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 134.093978] nix-grpc-daemon[1403]: time=2026-09-22T11:23:37.326Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 134.095530] nix-grpc-daemon[1403]: time=2026-09-22T11:23:37.328Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 134.127622] niks3-server[1194]: 2026/09/22 11:23:37 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 134.131074] niks3-server[1194]: 2026/09/22 11:23:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 134.133891] niks3-server[1194]: 2026/09/22 11:23:37 INFO Signed narinfos id=47 count=1 worker1 # [ 134.112265] nix-grpc-daemon[1403]: time=2026-09-22T11:23:37.344Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.137234] niks3-server[1194]: 2026/09/22 11:23:37 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 134.141668] niks3-server[1194]: 2026/09/22 11:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 134.146781] niks3-server[1194]: 2026/09/22 11:23:37 INFO Completed upload id=47 worker1 # [ 134.125117] nix-grpc-daemon[1403]: time=2026-09-22T11:23:37.357Z level=INFO msg="Upload complete. (369ms)" lb # [ 134.147954] niks3-server[1194]: 2026/09/22 11:23:37 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 134.127627] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 134.130463] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 134.136410] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 134.141392] nix-daemon[855]: reaped child process 1488, status = succeeded worker1 # [ 134.146217] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 135.360736] nix-daemon[855]: reaped child process 1502, status = succeeded worker1 # [ 135.510521] nix-daemon[855]: accepted connection from pid 1518, user nix-grpc-daemon (trusted) worker1 # [ 135.523402] nix-daemon[855]: reaped child process 1521, status = succeeded lb # [ 135.557791] niks3-server[1194]: 2026/09/22 11:23:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.541792] nix-grpc-daemon[1403]: time=2026-09-22T11:23:38.774Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 135.543341] nix-grpc-daemon[1403]: time=2026-09-22T11:23:38.775Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 135.577647] niks3-server[1194]: 2026/09/22 11:23:38 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 135.580920] niks3-server[1194]: 2026/09/22 11:23:38 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 135.584949] niks3-server[1194]: 2026/09/22 11:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 135.587563] niks3-server[1194]: 2026/09/22 11:23:39 INFO Signed narinfos id=48 count=1 worker1 # [ 135.566095] nix-grpc-daemon[1403]: time=2026-09-22T11:23:38.798Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.592857] niks3-server[1194]: 2026/09/22 11:23:39 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 135.595728] niks3-server[1194]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 135.598121] niks3-server[1194]: 2026/09/22 11:23:39 INFO Completed upload id=48 worker1 # [ 135.576406] nix-grpc-daemon[1403]: time=2026-09-22T11:23:38.808Z level=INFO msg="Upload complete. (222ms)" lb # [ 135.599444] niks3-server[1194]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 135.578905] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 135.586420] nix-daemon[855]: reaped child process 1500, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 5.42 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.18 seconds) worker2 # [ 135.850053] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 135.854137] systemd[1]: Starting scheduler-token.service... worker2 # [ 135.914841] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 135.916502] systemd[1]: Finished scheduler-token.service. worker2 # [ 135.919109] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 62ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 135.923221] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 136.067706] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 136.070123] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 136.073380] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 136.080064] nix-grpc-daemon[1507]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 136.081345] nix-grpc-daemon[1507]: E0000 00:00:1790076220.149835 1507 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 136.086071] nix-grpc-daemon[1507]: E0000 00:00:1790076220.154863 1507 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 136.091209] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 136.097991] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 136.105311] nix-grpc-daemon[1507]: E0000 00:00:1790076220.174397 1546 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 136.117151] nix-grpc-daemon[1507]: E0000 00:00:1790076220.187631 1546 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 136.120168] nix-grpc-daemon[1507]: E0000 00:00:1790076220.189819 1546 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 136.131251] nix-grpc-daemon[1507]: E0000 00:00:1790076220.201687 1546 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 136.138967] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 136.134161] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 136.139309] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:33692 worker1 # [ 136.143813] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.53 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs client # [ 136.427914] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 8da5c30f8dca4880873ae9a5eed8d498 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds) worker2 # [ 136.640614] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57636 worker2 # [ 136.652937] nix-daemon[877]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) client # [ 136.663429] nix[1357]: don't know how to build these paths: client # [ 136.664386] nix[1357]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 136.663102] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 136.667085] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 136.704865] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 136.715538] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33706 client # [ 136.733276] nix[1357]: copying 1 paths to 'lb:50051'... worker1 # [ 136.724762] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 client # [ 136.735137] nix[1357]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 136.737316] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) lb # [ 136.784529] envoy[899]: conn peer=[2001:db8:1::1]:59506 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9577 tx=4413 ms=5210 worker1 # [ 136.917563] nix-daemon[855]: accepted connection from pid 1534, user nix-grpc-daemon (trusted) worker1 # [ 136.929487] nix-daemon[855]: reaped child process 1537, status = succeeded worker1 # [ 137.090687] nix-daemon[855]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) worker1 # [ 137.102730] nix-daemon[855]: reaped child process 1542, status = succeeded lb # [ 137.135824] niks3-server[1194]: 2026/09/22 11:23:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.118764] nix-grpc-daemon[1403]: time=2026-09-22T11:23:40.350Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.120126] nix-grpc-daemon[1403]: time=2026-09-22T11:23:40.350Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 137.151674] niks3-server[1194]: 2026/09/22 11:23:40 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 137.165539] niks3-server[1194]: 2026/09/22 11:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 137.171621] niks3-server[1194]: 2026/09/22 11:23:40 INFO Signed narinfos id=49 count=1 worker1 # [ 137.153276] nix-grpc-daemon[1403]: time=2026-09-22T11:23:40.385Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.176598] niks3-server[1194]: 2026/09/22 11:23:40 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 137.189345] niks3-server[1194]: 2026/09/22 11:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete worker1 # [ 137.173832] nix-grpc-daemon[1403]: time=2026-09-22T11:23:40.406Z level=INFO msg="Upload complete. (425ms)" lb # [ 137.195550] niks3-server[1194]: 2026/09/22 11:23:40 INFO Completed upload id=49 worker1 # [ 137.175818] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 137.199115] niks3-server[1194]: 2026/09/22 11:23:40 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 137.182167] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 worker1 # [ 137.183868] nix-daemon[855]: reaped child process 1532, status = succeeded worker1 # [ 137.186669] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 137.192686] nix-daemon[855]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) client # [ 137.201249] nix[1357]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 139.211300] systemd-journald[289]: Received client request to rotate journal, rotating. worker2 # [ 139.228652] systemd-journald[289]: Vacuuming done, freed 0B of archived journals from /var/log/journal/589e47287e214817a9242c1f065477a7. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 139.134285] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) client: must succeed: sleep 5.0 worker1 # [ 139.476866] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:42Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.05 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 144.411244] nix-daemon[855]: reaped child process 1546, status = succeeded worker1 # [ 144.540987] nix-daemon[855]: accepted connection from pid 1587, user nix-grpc-daemon (trusted) worker1 # [ 144.553491] nix-daemon[855]: reaped child process 1590, status = succeeded lb # [ 144.592427] niks3-server[1194]: 2026/09/22 11:23:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.580147] nix-grpc-daemon[1403]: time=2026-09-22T11:23:47.812Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.582145] nix-grpc-daemon[1403]: time=2026-09-22T11:23:47.814Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 144.625593] niks3-server[1194]: 2026/09/22 11:23:48 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 144.641130] niks3-server[1194]: 2026/09/22 11:23:48 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 144.652755] niks3-server[1194]: 2026/09/22 11:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 144.636690] nix-grpc-daemon[1403]: time=2026-09-22T11:23:47.869Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.658499] niks3-server[1194]: 2026/09/22 11:23:48 INFO Signed narinfos id=50 count=1 lb # [ 144.663838] niks3-server[1194]: 2026/09/22 11:23:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 144.672351] niks3-server[1194]: 2026/09/22 11:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 144.679610] niks3-server[1194]: 2026/09/22 11:23:48 INFO Completed upload id=50 worker1 # [ 144.657840] nix-grpc-daemon[1403]: time=2026-09-22T11:23:47.890Z level=INFO msg="Upload complete. (251ms)" lb # [ 144.682757] niks3-server[1194]: 2026/09/22 11:23:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 144.661527] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33706 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 144.669852] nix-daemon[855]: reaped child process 1544, status = succeeded client # [ 144.709556] systemd[1]: rs.service: Deactivated successfully. client # [ 144.713180] systemd[1]: rs.service: Consumed 133ms CPU time over 8.284s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 145.476268] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:48Z level=info event=signal_exit lb # [ 145.969849] niks3-server[1194]: 2026/09/22 11:23:49 INFO lead: released remote=192.168.1.3:37478 lb # [ 146.112112] niks3-server[1194]: 2026/09/22 11:23:49 INFO lead: acquired remote=192.168.1.4:54802 worker2 # [ 146.105755] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:50Z level=info event=scheduler_take_over lb # [ 146.785489] envoy[899]: conn peer=[2001:db8:1::1]:42176 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2973 tx=1539 ms=8047 worker2 # [ 146.960414] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:51Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 146.952918] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:50Z level=info event=scheduler_restarting worker1 # [ 146.957239] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:50Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 146.960697] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33692 worker1 # [ 146.964331] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:50Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 146.967672] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33692 worker1 # [ 146.971145] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:50Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 146.987330] nix-daemon[855]: reaped child process 1393, status = succeeded worker2 # [ 147.162818] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 147.154868] nix-grpc-daemon[1324]: E0000 00:00:1790076230.387176 1369 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 147.175586] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:51Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 147.163508] nix-grpc-daemon[1324]: E0000 00:00:1790076230.387290 1369 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 147.179996] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:35772 worker1 # [ 147.172545] nix-grpc-daemon[1324]: ts=2026-09-22T11:23:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 147.184399] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.16 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 148.236306] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 148.237448] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 148.238398] systemd[1]: nix-grpc-daemon.service: Consumed 1.285s CPU time over 31.937s wall clock time, 35.9M memory peak, 48.1K incoming IP traffic, 96.4K outgoing IP traffic. worker1 # [ 148.245481] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 148.368742] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 148.370487] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 148.373924] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 148.381063] nix-grpc-daemon[1597]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 148.383094] nix-grpc-daemon[1597]: E0000 00:00:1790076231.613212 1597 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.386946] nix-grpc-daemon[1597]: E0000 00:00:1790076231.618347 1597 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.389551] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 148.392803] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 148.399067] nix-grpc-daemon[1597]: E0000 00:00:1790076231.631094 1639 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.410581] nix-grpc-daemon[1597]: E0000 00:00:1790076231.643058 1639 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.414117] nix-grpc-daemon[1597]: E0000 00:00:1790076231.645293 1639 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.424587] nix-grpc-daemon[1597]: E0000 00:00:1790076231.657064 1639 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.432087] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.446120] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:35772 worker2 # [ 148.449179] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.50 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid client # [ 148.904651] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 956d99a393694d3c8ae778ad6ee92cc6 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds) worker2 # [ 149.101754] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57636 client # [ 149.102790] nix[1393]: don't know how to build these paths: client # [ 149.103697] nix[1393]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 149.110630] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:53Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 149.112719] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:53Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 149.154550] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57636 worker2 # [ 149.166745] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5) worker2 # [ 149.233609] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5) worker2 # [ 149.342806] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 339 ms (attempt 3/5) worker2 # [ 149.684827] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 4/5) worker2 # [ 149.701722] nix-grpc-daemon[1507]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 149.703454] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 149.715126] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57636 client # [ 149.719086] nix[1393]: copying 1 paths to 'lb:50051'... client # [ 149.719895] nix[1393]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker2 # [ 149.722926] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57636 worker2 # [ 149.726691] nix-daemon[877]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker2 # [ 149.738891] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:53Z level=info event=niks3_push_started pid=1635 worker2 # [ 149.899429] nix-grpc-daemon[1635]: time=2026-09-22T11:23:53.969Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 150.029227] nix-daemon[877]: accepted connection from pid 1648, user nix-grpc-daemon (trusted) worker2 # [ 150.040159] nix-daemon[877]: reaped child process 1651, status = succeeded worker2 # [ 150.188428] nix-daemon[877]: accepted connection from pid 1653, user nix-grpc-daemon (trusted) worker2 # [ 150.200478] nix-daemon[877]: reaped child process 1660, status = succeeded lb # [ 150.221362] niks3-server[1194]: 2026/09/22 11:23:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 150.219059] nix-grpc-daemon[1635]: time=2026-09-22T11:23:54.289Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 150.221873] nix-grpc-daemon[1635]: time=2026-09-22T11:23:54.291Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 150.252425] niks3-server[1194]: 2026/09/22 11:23:53 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 150.262120] niks3-server[1194]: 2026/09/22 11:23:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 150.268124] niks3-server[1194]: 2026/09/22 11:23:53 INFO Signed narinfos id=51 count=1 worker2 # [ 150.261141] nix-grpc-daemon[1635]: time=2026-09-22T11:23:54.331Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.278517] niks3-server[1194]: 2026/09/22 11:23:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 150.287401] niks3-server[1194]: 2026/09/22 11:23:53 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 150.295042] niks3-server[1194]: 2026/09/22 11:23:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker2 # [ 150.288795] nix-grpc-daemon[1635]: time=2026-09-22T11:23:54.359Z level=INFO msg="Upload complete. (385ms)" lb # [ 150.298803] niks3-server[1194]: 2026/09/22 11:23:53 INFO Completed upload id=51 worker2 # [ 150.291718] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57636 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 150.296435] nix-grpc-daemon[1507]: ts=2026-09-22T11:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57636 worker2 # [ 150.305465] nix-daemon[877]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker2 # [ 150.310537] nix-daemon[877]: reaped child process 1633, status = succeeded worker2 # [ 150.316367] nix-daemon[877]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) client # [ 150.313131] nix[1393]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 152.631276] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1507 (nix-grpc-daemon) on client request. worker2 # [ 152.634422] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 152.649688] niks3-server[1194]: 2026/09/22 11:23:56 INFO lead: released remote=192.168.1.4:54802 client # [ 152.644899] nix[1393]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again client # [ 152.647099] nix[1393]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 152.635938] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker2 # [ 152.653135] systemd[1]: Starting scheduler-token.service... worker2 # [ 152.663253] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 152.665859] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 152.670299] systemd[1]: nix-grpc-daemon.service: Consumed 416ms CPU time over 16.738s wall clock time, 33.5M memory peak, 14.5K incoming IP traffic, 27.7K outgoing IP traffic. worker2 # [ 152.678679] nix-daemon[877]: reaped child process 1566, status = succeeded worker2 # [ 152.680207] nix-daemon[877]: reaped child process 1662, status = succeeded worker2 # [ 152.691277] nix-daemon[1664]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 152.695168] nix-daemon[877]: reaped child process 1664, status = failed with exit code 1 worker2 # [ 152.745504] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 152.747269] systemd[1]: Finished scheduler-token.service. worker2 # [ 152.748708] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 94ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 152.751970] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 152.756637] systemd[1]: Starting scheduler-token.service... worker2 # [ 152.810882] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 152.812235] systemd[1]: Finished scheduler-token.service. worker2 # [ 152.815128] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 54ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 152.819121] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 152.835892] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 152.973723] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 152.976302] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 152.980498] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 152.988061] nix-grpc-daemon[1707]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 152.991105] nix-grpc-daemon[1707]: E0000 00:00:1790076237.058227 1707 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 152.995120] nix-grpc-daemon[1707]: E0000 00:00:1790076237.061450 1707 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 153.000372] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 153.004718] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 152.995773] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.42 seconds) client: must succeed: sleep 5.0 lb # [ 153.020281] niks3-server[1194]: 2026/09/22 11:23:56 INFO lead: acquired remote=192.168.1.4:48410 worker2 # [ 153.012068] nix-grpc-daemon[1707]: E0000 00:00:1790076237.081526 1749 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 153.015754] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=scheduler_take_over worker2 # [ 153.025120] nix-grpc-daemon[1707]: E0000 00:00:1790076237.095536 1749 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 153.030056] nix-grpc-daemon[1707]: E0000 00:00:1790076237.098095 1749 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 153.039788] nix-grpc-daemon[1707]: E0000 00:00:1790076237.110199 1749 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 153.048948] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 153.054713] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 153.056334] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38734 worker2 # [ 153.058193] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 153.159217] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 153.164155] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker1 # [ 153.197146] nix-grpc-daemon[1597]: ts=2026-09-22T11:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 153.207145] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 153.212992] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38734 worker2 # [ 153.216504] nix-grpc-daemon[1707]: ts=2026-09-22T11:23:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 153.226394] nix-daemon[877]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker2 # [ 153.241512] nix-daemon[877]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) client # [ 153.249734] nix[1393]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker2 # [ 153.253762] nix-daemon[877]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) lb # [ 156.784682] envoy[899]: conn peer=[2001:db8:1::3]:37638 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4581 tx=1106 ms=30638 lb # [ 156.786231] envoy[899]: conn peer=[2001:db8:1::4]:47426 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2046 tx=311 ms=16510 client: (finished: must succeed: sleep 5.0, in 5.05 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 158.471763] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:02Z level=info event=niks3_push_started pid=1790 worker2 # [ 158.500914] nix-daemon[877]: reaped child process 1765, status = succeeded worker2 # [ 158.661741] nix-grpc-daemon[1790]: time=2026-09-22T11:24:02.731Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 158.811633] nix-daemon[877]: accepted connection from pid 1803, user nix-grpc-daemon (trusted) worker2 # [ 158.823827] nix-daemon[877]: reaped child process 1806, status = succeeded lb # [ 158.852221] niks3-server[1194]: 2026/09/22 11:24:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 158.851179] nix-grpc-daemon[1790]: time=2026-09-22T11:24:02.921Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 158.852719] nix-grpc-daemon[1790]: time=2026-09-22T11:24:02.923Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 158.902234] niks3-server[1194]: 2026/09/22 11:24:02 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 158.907980] niks3-server[1194]: 2026/09/22 11:24:02 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 158.918800] niks3-server[1194]: 2026/09/22 11:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 158.922397] niks3-server[1194]: 2026/09/22 11:24:02 INFO Signed narinfos id=52 count=1 worker2 # [ 158.915226] nix-grpc-daemon[1790]: time=2026-09-22T11:24:02.985Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.929188] niks3-server[1194]: 2026/09/22 11:24:02 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 158.938177] niks3-server[1194]: 2026/09/22 11:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 158.941946] niks3-server[1194]: 2026/09/22 11:24:02 INFO Completed upload id=52 worker2 # [ 158.932252] nix-grpc-daemon[1790]: time=2026-09-22T11:24:03.002Z level=INFO msg="Upload complete. (266ms)" worker2 # [ 158.940108] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 158.952163] nix-daemon[877]: reaped child process 1763, status = succeeded client # [ 158.970967] systemd[1]: mid.service: Deactivated successfully. client # [ 158.972476] systemd[1]: mid.service: Consumed 124ms CPU time over 10.067s wall clock time, 41.4M memory peak, 8.6K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.56 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr client # [ 159.464237] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 3ad0f94aea244623b044dbf41ed30da1 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds) worker1 # [ 159.669974] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 159.674896] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) client # [ 159.689897] nix[1429]: don't know how to build these paths: client # [ 159.690839] nix[1429]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 159.700382] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:03Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 159.704499] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:03Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.731069] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 159.737221] nix-grpc-daemon[1597]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 1/5) worker1 # [ 159.803721] nix-grpc-daemon[1597]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 2/5) worker1 # [ 159.940350] nix-grpc-daemon[1597]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 3/5) worker1 # [ 160.255539] nix-grpc-daemon[1597]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 482 ms (attempt 4/5) worker1 # [ 160.738200] nix-grpc-daemon[1597]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 160.740257] nix-grpc-daemon[1597]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 160.756829] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 160.764758] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 client # [ 160.773815] nix[1429]: copying 1 paths to 'lb:50051'... client # [ 160.777076] nix[1429]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker1 # [ 160.771982] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 160.781893] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:04Z level=info event=niks3_push_started pid=1693 worker1 # [ 160.941950] nix-grpc-daemon[1693]: time=2026-09-22T11:24:04.174Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 161.091117] nix-daemon[855]: accepted connection from pid 1706, user nix-grpc-daemon (trusted) worker1 # [ 161.101558] nix-daemon[855]: reaped child process 1709, status = succeeded worker1 # [ 161.246918] nix-daemon[855]: accepted connection from pid 1711, user nix-grpc-daemon (trusted) worker1 # [ 161.258397] nix-daemon[855]: reaped child process 1714, status = succeeded lb # [ 161.294252] niks3-server[1194]: 2026/09/22 11:24:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.283191] nix-grpc-daemon[1693]: time=2026-09-22T11:24:04.515Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 161.285562] nix-grpc-daemon[1693]: time=2026-09-22T11:24:04.517Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 161.335950] niks3-server[1194]: 2026/09/22 11:24:04 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 161.341767] niks3-server[1194]: 2026/09/22 11:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 161.347247] niks3-server[1194]: 2026/09/22 11:24:04 INFO Signed narinfos id=53 count=1 worker1 # [ 161.328711] nix-grpc-daemon[1693]: time=2026-09-22T11:24:04.560Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.358440] niks3-server[1194]: 2026/09/22 11:24:04 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 161.363532] niks3-server[1194]: 2026/09/22 11:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 161.372831] niks3-server[1194]: 2026/09/22 11:24:04 INFO Completed upload id=53 worker1 # [ 161.351224] nix-grpc-daemon[1693]: time=2026-09-22T11:24:04.583Z level=INFO msg="Upload complete. (405ms)" lb # [ 161.374847] niks3-server[1194]: 2026/09/22 11:24:04 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker1 # [ 161.354800] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 161.360131] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 161.368504] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 161.375128] nix-daemon[855]: reaped child process 1691, status = succeeded worker1 # [ 161.378089] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) client # [ 161.386421] nix[1429]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 162.837547] systemd[1]: intr.service: Sent signal SIGINT to main process 1429 (nix) on client request. worker1 # [ 162.830433] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:06Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 162.843888] nix[1429]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 162.849667] nix[1429]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 162.884396] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 162.885765] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 162.887728] systemd[1]: intr.service: Consumed 114ms CPU time over 3.422s wall clock time, 39.4M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 162.995255] nix-daemon[855]: reaped child process 1716, status = succeeded worker1 # [ 162.998685] nix-daemon[1718]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 163.002434] nix-daemon[855]: reaped child process 1718, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.63 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw client # [ 164.117235] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: c1c3d2c5c6584ce4a993bbaa96c4a561 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds) client # [ 164.324055] nix[1450]: don't know how to build these paths: worker2 # [ 164.325778] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38758 client # [ 164.324858] nix[1450]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 164.331481] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:08Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 164.333522] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:08Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 164.374102] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 164.380033] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5) worker2 # [ 164.418502] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 2/5) worker2 # [ 164.442952] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 194 ms (attempt 3/5) worker2 # [ 164.639629] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 777 ms (attempt 4/5) worker2 # [ 165.420396] nix-grpc-daemon[1707]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 165.421828] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 165.433964] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 client # [ 165.438271] nix[1450]: copying 1 paths to 'lb:50051'... worker2 # [ 165.444238] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 client # [ 165.441576] nix[1450]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker2 # [ 165.450945] nix-daemon[877]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker2 # [ 165.603801] nix-daemon[877]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker2 # [ 165.615910] nix-daemon[877]: reaped child process 1853, status = succeeded worker2 # [ 165.762447] nix-daemon[877]: accepted connection from pid 1855, user nix-grpc-daemon (trusted) worker2 # [ 165.773230] nix-daemon[877]: reaped child process 1858, status = succeeded lb # [ 165.795646] niks3-server[1194]: 2026/09/22 11:24:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 165.794633] nix-grpc-daemon[1790]: time=2026-09-22T11:24:09.864Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 165.796273] nix-grpc-daemon[1790]: time=2026-09-22T11:24:09.866Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 165.824481] niks3-server[1194]: 2026/09/22 11:24:09 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 165.834998] niks3-server[1194]: 2026/09/22 11:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 165.839841] niks3-server[1194]: 2026/09/22 11:24:09 INFO Signed narinfos id=54 count=1 worker2 # [ 165.833106] nix-grpc-daemon[1790]: time=2026-09-22T11:24:09.903Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.851135] niks3-server[1194]: 2026/09/22 11:24:09 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 165.857408] niks3-server[1194]: 2026/09/22 11:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker2 # [ 165.852508] nix-grpc-daemon[1790]: time=2026-09-22T11:24:09.922Z level=INFO msg="Upload complete. (395ms)" lb # [ 165.863286] niks3-server[1194]: 2026/09/22 11:24:09 INFO Completed upload id=54 worker2 # [ 165.854589] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 165.867254] niks3-server[1194]: 2026/09/22 11:24:09 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker2 # [ 165.859533] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 165.865922] nix-daemon[877]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker2 # [ 165.868210] nix-daemon[877]: reaped child process 1848, status = succeeded client # [ 165.869795] nix[1450]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker2 # [ 165.873387] nix-daemon[877]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) lb # [ 166.785391] envoy[899]: conn peer=[2001:db8:1::1]:53116 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3934 tx=1941 ms=9855 lb # [ 166.786971] envoy[899]: conn peer=[2001:db8:1::1]:57326 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2993 tx=851 ms=3188 worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 168.230848] nixos[1894]: switching to system configuration /nix/store/f4fgvcyl12l15s7pxq6ja191ka2vx57d-nixos-system-worker2-test worker2 # [ 168.234637] systemd[1]: Stopped target Remote File Systems. worker2 # activating the configuration... worker2 # [ 168.236865] systemd[1]: Stopped target Local File Systems. worker2 # setting up /etc... worker2 # [ 168.829587] systemd[1]: Reload requested from client PID 1894 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 168.831271] systemd[1]: Reloading... worker2 # [ 169.482265] systemd[1]: Reloading finished in 646 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 169.535316] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 169.668250] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 169.673033] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 169.677221] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 169.679290] dbus-broker-launch[536]: Caught SIGHUP, trigger reload. worker2 # [ 169.681775] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 169.713074] dbus-broker-launch[536]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 169.714916] dbus-broker-launch[536]: NSS returned no entry for 'systemd-timesync' worker2 # [ 169.717098] dbus-broker-launch[536]: Invalid user-name in /nix/store/s93qka0z548yjbxqnmj4c4b32apww6jv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 169.726228] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 169.744572] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 169.746396] systemd[1]: Reached target Local File Systems. worker2 # [ 169.753071] systemd[1]: Reached target Remote File Systems. worker2 # [ 169.757434] systemd[1]: Starting linger-users.service... worker2 # [ 169.760318] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 169.761801] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 169.773842] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 169.778080] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 169.779261] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 169.782173] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 169.786755] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 169.788383] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 169.790108] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 169.822814] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 169.824127] systemd[1]: Finished linger-users.service. worker2 # [ 170.000559] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:14Z level=info event=draining worker2 # [ 170.185584] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 170.188763] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 170.446349] nixos[1894]: finished switching to system configuration /nix/store/f4fgvcyl12l15s7pxq6ja191ka2vx57d-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.83 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2 worker1 # [ 170.742708] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37720 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker1 # [ 170.751492] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker2 # [ 170.783607] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:14Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 170.785580] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:14Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 170.823181] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 170.837229] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 client # copying 1 paths to 'lb:50051'... worker1 # [ 170.849326] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker1 # [ 170.868932] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 171.016140] nix-daemon[855]: accepted connection from pid 1773, user nix-grpc-daemon (trusted) worker1 # [ 171.027691] nix-daemon[855]: reaped child process 1776, status = succeeded worker1 # [ 171.178361] nix-daemon[855]: accepted connection from pid 1778, user nix-grpc-daemon (trusted) worker1 # [ 171.189786] nix-daemon[855]: reaped child process 1781, status = succeeded lb # [ 171.225810] niks3-server[1194]: 2026/09/22 11:24:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.215222] nix-grpc-daemon[1693]: time=2026-09-22T11:24:14.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 171.216896] nix-grpc-daemon[1693]: time=2026-09-22T11:24:14.449Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 171.256348] niks3-server[1194]: 2026/09/22 11:24:14 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 171.266563] niks3-server[1194]: 2026/09/22 11:24:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 171.269860] niks3-server[1194]: 2026/09/22 11:24:14 INFO Signed narinfos id=55 count=1 worker1 # [ 171.251202] nix-grpc-daemon[1693]: time=2026-09-22T11:24:14.483Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.278994] niks3-server[1194]: 2026/09/22 11:24:14 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 171.287130] niks3-server[1194]: 2026/09/22 11:24:14 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 171.294609] niks3-server[1194]: 2026/09/22 11:24:14 INFO Completed upload id=55 worker1 # [ 171.273222] nix-grpc-daemon[1693]: time=2026-09-22T11:24:14.505Z level=INFO msg="Upload complete. (390ms)" lb # [ 171.296281] niks3-server[1194]: 2026/09/22 11:24:14 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker1 # [ 171.278384] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 171.283295] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 171.291356] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 171.296323] nix-daemon[855]: reaped child process 1771, status = succeeded worker1 # [ 171.301123] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker1 # [ 172.731725] nix-daemon[855]: reaped child process 1785, status = succeeded worker1 # [ 172.853049] nix-daemon[855]: accepted connection from pid 1801, user nix-grpc-daemon (trusted) worker1 # [ 172.863465] nix-daemon[855]: reaped child process 1804, status = succeeded lb # [ 172.898134] niks3-server[1194]: 2026/09/22 11:24:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.880941] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.113Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.882439] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.114Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 172.915477] niks3-server[1194]: 2026/09/22 11:24:16 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 172.921671] niks3-server[1194]: 2026/09/22 11:24:16 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 172.927600] niks3-server[1194]: 2026/09/22 11:24:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 172.911193] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.143Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.932834] niks3-server[1194]: 2026/09/22 11:24:16 INFO Signed narinfos id=56 count=1 lb # [ 172.937392] niks3-server[1194]: 2026/09/22 11:24:16 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 172.942726] niks3-server[1194]: 2026/09/22 11:24:16 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 172.945904] niks3-server[1194]: 2026/09/22 11:24:16 INFO Completed upload id=56 worker1 # [ 172.924206] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.156Z level=INFO msg="Upload complete. (215ms)" lb # [ 172.947374] niks3-server[1194]: 2026/09/22 11:24:16 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker1 # [ 172.926649] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker1 # [ 172.933102] nix-daemon[855]: reaped child process 1783, status = succeeded worker2 # [ 172.945363] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:17Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 172.948269] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:17Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 172.978329] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 172.989297] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 172.999137] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.231Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 173.006858] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker1 # [ 173.027161] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 173.156273] nix-daemon[855]: accepted connection from pid 1808, user nix-grpc-daemon (trusted) worker1 # [ 173.168106] nix-daemon[855]: reaped child process 1811, status = succeeded worker1 # [ 173.297237] nix-daemon[855]: accepted connection from pid 1813, user nix-grpc-daemon (trusted) worker1 # [ 173.308746] nix-daemon[855]: reaped child process 1816, status = succeeded lb # [ 173.344196] niks3-server[1194]: 2026/09/22 11:24:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 173.330951] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.563Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 173.332707] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.565Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 173.376929] niks3-server[1194]: 2026/09/22 11:24:16 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 173.388864] niks3-server[1194]: 2026/09/22 11:24:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 173.373084] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.605Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.394978] niks3-server[1194]: 2026/09/22 11:24:16 INFO Signed narinfos id=57 count=1 lb # [ 173.399603] niks3-server[1194]: 2026/09/22 11:24:16 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 173.410321] niks3-server[1194]: 2026/09/22 11:24:16 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 173.416470] niks3-server[1194]: 2026/09/22 11:24:16 INFO Completed upload id=57 worker1 # [ 173.394761] nix-grpc-daemon[1693]: time=2026-09-22T11:24:16.627Z level=INFO msg="Upload complete. (355ms)" lb # [ 173.417901] niks3-server[1194]: 2026/09/22 11:24:16 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker1 # [ 173.398426] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 173.403082] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 173.412111] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 173.416457] nix-daemon[855]: reaped child process 1806, status = succeeded worker1 # [ 173.421336] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker1 # [ 174.048144] nix-daemon[855]: reaped child process 1820, status = succeeded worker1 # [ 174.201086] nix-daemon[855]: accepted connection from pid 1836, user nix-grpc-daemon (trusted) worker1 # [ 174.212892] nix-daemon[855]: reaped child process 1839, status = succeeded lb # [ 174.243862] niks3-server[1194]: 2026/09/22 11:24:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.227140] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.459Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 174.228611] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.461Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 174.263595] niks3-server[1194]: 2026/09/22 11:24:17 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 174.267807] niks3-server[1194]: 2026/09/22 11:24:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 174.270140] niks3-server[1194]: 2026/09/22 11:24:17 INFO Signed narinfos id=58 count=1 worker1 # [ 174.249937] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.482Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.272804] niks3-server[1194]: 2026/09/22 11:24:17 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 174.276852] niks3-server[1194]: 2026/09/22 11:24:17 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 174.281056] niks3-server[1194]: 2026/09/22 11:24:17 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 174.285076] niks3-server[1194]: 2026/09/22 11:24:17 INFO Completed upload id=58 worker1 # [ 174.264632] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.497Z level=INFO msg="Upload complete. (237ms)" lb # [ 174.286792] niks3-server[1194]: 2026/09/22 11:24:17 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker1 # [ 174.267054] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker2 # [ 174.283658] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:18Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 174.273801] nix-daemon[855]: reaped child process 1818, status = succeeded worker2 # [ 174.285400] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:18Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 174.314841] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 174.324190] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 174.333549] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.565Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 174.340101] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker1 # [ 174.348948] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 174.492129] nix-daemon[855]: accepted connection from pid 1843, user nix-grpc-daemon (trusted) worker1 # [ 174.503759] nix-daemon[855]: reaped child process 1846, status = succeeded worker1 # [ 174.651294] nix-daemon[855]: accepted connection from pid 1848, user nix-grpc-daemon (trusted) worker1 # [ 174.662771] nix-daemon[855]: reaped child process 1851, status = succeeded lb # [ 174.697972] niks3-server[1194]: 2026/09/22 11:24:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.680308] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.912Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 174.681834] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.914Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 174.713635] niks3-server[1194]: 2026/09/22 11:24:18 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 174.716564] niks3-server[1194]: 2026/09/22 11:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 174.718333] niks3-server[1194]: 2026/09/22 11:24:18 INFO Signed narinfos id=59 count=1 worker1 # [ 174.698680] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.931Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.722081] niks3-server[1194]: 2026/09/22 11:24:18 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 174.726363] niks3-server[1194]: 2026/09/22 11:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 174.729714] niks3-server[1194]: 2026/09/22 11:24:18 INFO Completed upload id=59 worker1 # [ 174.707918] nix-grpc-daemon[1693]: time=2026-09-22T11:24:17.940Z level=INFO msg="Upload complete. (350ms)" lb # [ 174.731228] niks3-server[1194]: 2026/09/22 11:24:18 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker1 # [ 174.710042] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 174.713478] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 174.717466] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 174.721846] nix-daemon[855]: reaped child process 1841, status = succeeded client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker1 # [ 174.726358] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker1 # [ 175.139381] nix-daemon[855]: reaped child process 1855, status = succeeded worker1 # [ 175.247751] nix-daemon[855]: accepted connection from pid 1871, user nix-grpc-daemon (trusted) worker1 # [ 175.259575] nix-daemon[855]: reaped child process 1874, status = succeeded lb # [ 175.292800] niks3-server[1194]: 2026/09/22 11:24:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 175.279601] nix-grpc-daemon[1693]: time=2026-09-22T11:24:18.511Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 175.281050] nix-grpc-daemon[1693]: time=2026-09-22T11:24:18.513Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 175.329834] niks3-server[1194]: 2026/09/22 11:24:18 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 175.338203] niks3-server[1194]: 2026/09/22 11:24:18 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 175.346213] niks3-server[1194]: 2026/09/22 11:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 175.328484] nix-grpc-daemon[1693]: time=2026-09-22T11:24:18.560Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.350226] niks3-server[1194]: 2026/09/22 11:24:18 INFO Signed narinfos id=60 count=1 lb # [ 175.356384] niks3-server[1194]: 2026/09/22 11:24:18 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 175.364985] niks3-server[1194]: 2026/09/22 11:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 175.368256] niks3-server[1194]: 2026/09/22 11:24:18 INFO Completed upload id=60 worker1 # [ 175.346240] nix-grpc-daemon[1693]: time=2026-09-22T11:24:18.578Z level=INFO msg="Upload complete. (214ms)" lb # [ 175.370902] niks3-server[1194]: 2026/09/22 11:24:18 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker1 # [ 175.350629] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker1 # [ 175.362189] nix-daemon[855]: reaped child process 1853, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 4.93 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.17 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 175.697323] nix-daemon[877]: reaped child process 1862, status = succeeded worker2 # [ 175.822363] nix-daemon[877]: accepted connection from pid 2040, user nix-grpc-daemon (trusted) worker2 # [ 175.835272] nix-daemon[877]: reaped child process 2043, status = succeeded lb # [ 175.856122] niks3-server[1194]: 2026/09/22 11:24:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 175.854085] nix-grpc-daemon[1790]: time=2026-09-22T11:24:19.924Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 175.855687] nix-grpc-daemon[1790]: time=2026-09-22T11:24:19.926Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 175.889768] niks3-server[1194]: 2026/09/22 11:24:19 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 175.900990] niks3-server[1194]: 2026/09/22 11:24:19 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 175.910107] niks3-server[1194]: 2026/09/22 11:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker2 # [ 175.905451] nix-grpc-daemon[1790]: time=2026-09-22T11:24:19.975Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.915128] niks3-server[1194]: 2026/09/22 11:24:19 INFO Signed narinfos id=61 count=1 lb # [ 175.923091] niks3-server[1194]: 2026/09/22 11:24:19 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 175.932876] niks3-server[1194]: 2026/09/22 11:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 175.938343] niks3-server[1194]: 2026/09/22 11:24:19 INFO Completed upload id=61 worker2 # [ 175.928691] nix-grpc-daemon[1790]: time=2026-09-22T11:24:19.999Z level=INFO msg="Upload complete. (239ms)" lb # [ 175.941331] niks3-server[1194]: 2026/09/22 11:24:19 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker2 # [ 175.937357] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 175.950192] nix-daemon[877]: reaped child process 1860, status = succeeded client # [ 175.969568] systemd[1]: sw.service: Deactivated successfully. client # [ 175.972880] systemd[1]: sw.service: Consumed 130ms CPU time over 11.852s wall clock time, 41.4M memory peak, 7.5K incoming IP traffic, 8.5K outgoing IP traffic. worker2 # [ 176.001479] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:20Z level=info event=signal_exit lb # [ 176.250094] niks3-server[1194]: 2026/09/22 11:24:19 INFO lead: released remote=192.168.1.4:48410 client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } lb # [ 176.785914] envoy[899]: conn peer=[2001:db8:1::1]:36738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9525 tx=4353 ms=4665 lb # [ 176.787512] envoy[899]: conn peer=[2001:db8:1::1]:36736 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1560 ms=11621 client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 176.852646] systemd[1]: Starting scheduler-token.service... worker2 # [ 176.923596] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 176.925167] systemd[1]: Finished scheduler-token.service. worker2 # [ 176.926520] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 72ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 177.228895] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:20Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 177.243469] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:21Z level=info event=scheduler_restarting worker2 # [ 177.248403] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38734 worker2 # [ 177.252294] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:21Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 177.255691] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:21Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 177.259609] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38734 worker2 # [ 177.263453] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:21Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 177.278528] nix-daemon[877]: reaped child process 1761, status = succeeded worker1 # [ 177.429431] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 177.433173] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 177.455584] nix-grpc-daemon[1707]: ts=2026-09-22T11:24:21Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 177.633552] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 177.635268] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 177.836305] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 177.840265] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 178.040591] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.042456] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 178.171255] nix-grpc-daemon[1707]: E0000 00:00:1790076262.241442 1752 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 178.176376] nix-grpc-daemon[1707]: E0000 00:00:1790076262.241647 1752 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 178.244162] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.247791] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 178.397385] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_take_over lb # [ 178.419357] niks3-server[1194]: 2026/09/22 11:24:21 INFO lead: acquired remote=192.168.1.3:52384 worker1 # [ 178.448578] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.452494] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 178.653047] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.654761] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 178.855670] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.859647] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 179.019355] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 179.020530] systemd[1]: nix-grpc-daemon.service: Consumed 637ms CPU time over 26.355s wall clock time, 33.3M memory peak, 23.9K incoming IP traffic, 31.7K outgoing IP traffic. worker2 # [ 179.027968] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 179.060451] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.064269] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 179.173955] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 179.176348] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 179.180233] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 179.187063] nix-grpc-daemon[2060]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 179.188679] nix-grpc-daemon[2060]: E0000 00:00:1790076263.256903 2060 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 179.193608] nix-grpc-daemon[2060]: E0000 00:00:1790076263.262088 2060 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 179.197845] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 179.200985] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 179.207083] nix-grpc-daemon[2060]: E0000 00:00:1790076263.275414 2102 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.43 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 179.219084] nix-grpc-daemon[2060]: E0000 00:00:1790076263.288766 2102 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 179.222107] nix-grpc-daemon[2060]: E0000 00:00:1790076263.288908 2102 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 179.232371] nix-grpc-daemon[2060]: E0000 00:00:1790076263.302815 2102 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 179.239438] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 179.241038] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 179.266326] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.269474] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 179.441773] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.443254] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 179.446299] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37760 worker1 # [ 179.450714] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 179.466965] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.470897] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37760 worker1 # [ 179.474426] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:22Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.37 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 180.638328] nix-grpc-daemon[2060]: ts=2026-09-22T11:24:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 180.649369] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker1 # [ 180.652062] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 180.684623] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker1 # [ 180.686550] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 180.688464] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker1 # [ 180.690053] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 180.728423] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 180.736732] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 180.744337] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 180.752071] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 180.911690] nix-daemon[855]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker1 # [ 180.924621] nix-daemon[855]: reaped child process 1886, status = succeeded worker1 # [ 181.081845] nix-daemon[855]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 181.094343] nix-daemon[855]: reaped child process 1891, status = succeeded lb # [ 181.126439] niks3-server[1194]: 2026/09/22 11:24:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 181.113107] nix-grpc-daemon[1693]: time=2026-09-22T11:24:24.345Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 181.114514] nix-grpc-daemon[1693]: time=2026-09-22T11:24:24.345Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 181.158099] niks3-server[1194]: 2026/09/22 11:24:24 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 181.166057] niks3-server[1194]: 2026/09/22 11:24:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 181.150966] nix-grpc-daemon[1693]: time=2026-09-22T11:24:24.383Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.172430] niks3-server[1194]: 2026/09/22 11:24:24 INFO Signed narinfos id=62 count=1 lb # [ 181.191749] niks3-server[1194]: 2026/09/22 11:24:24 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 181.201565] niks3-server[1194]: 2026/09/22 11:24:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 181.206289] niks3-server[1194]: 2026/09/22 11:24:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo lb # [ 181.210842] niks3-server[1194]: 2026/09/22 11:24:24 INFO Completed upload id=62 worker1 # [ 181.189442] nix-grpc-daemon[1693]: time=2026-09-22T11:24:24.421Z level=INFO msg="Upload complete. (428ms)" worker1 # [ 181.193858] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 181.199694] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 181.212107] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 181.221220] nix-daemon[855]: reaped child process 1881, status = succeeded worker1 # [ 181.227867] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 182.455258] nix-daemon[855]: reaped child process 1895, status = succeeded worker1 # [ 182.606085] nix-daemon[855]: accepted connection from pid 1911, user nix-grpc-daemon (trusted) worker1 # [ 182.616596] nix-daemon[855]: reaped child process 1914, status = succeeded lb # [ 182.653123] niks3-server[1194]: 2026/09/22 11:24:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.641698] nix-grpc-daemon[1693]: time=2026-09-22T11:24:25.873Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 182.644149] nix-grpc-daemon[1693]: time=2026-09-22T11:24:25.875Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 182.690452] niks3-server[1194]: 2026/09/22 11:24:26 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 182.702817] niks3-server[1194]: 2026/09/22 11:24:26 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 182.713804] niks3-server[1194]: 2026/09/22 11:24:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 182.719122] niks3-server[1194]: 2026/09/22 11:24:26 INFO Signed narinfos id=63 count=1 worker1 # [ 182.697404] nix-grpc-daemon[1693]: time=2026-09-22T11:24:25.929Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.724441] niks3-server[1194]: 2026/09/22 11:24:26 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 182.734059] niks3-server[1194]: 2026/09/22 11:24:26 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 182.739227] niks3-server[1194]: 2026/09/22 11:24:26 INFO Completed upload id=63 worker1 # [ 182.717903] nix-grpc-daemon[1693]: time=2026-09-22T11:24:25.950Z level=INFO msg="Upload complete. (280ms)" lb # [ 182.741463] niks3-server[1194]: 2026/09/22 11:24:26 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 182.724633] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker1 # [ 182.738231] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:25Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 182.741663] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:25Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 182.749672] nix-daemon[855]: reaped child process 1893, status = succeeded worker1 # [ 182.778397] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 182.788333] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 182.797546] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 182.805531] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 182.957834] nix-daemon[855]: accepted connection from pid 1920, user nix-grpc-daemon (trusted) worker1 # [ 182.969466] nix-daemon[855]: reaped child process 1923, status = succeeded worker1 # [ 183.104647] nix-daemon[855]: accepted connection from pid 1925, user nix-grpc-daemon (trusted) worker1 # [ 183.115935] nix-daemon[855]: reaped child process 1928, status = succeeded lb # [ 183.149721] niks3-server[1194]: 2026/09/22 11:24:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 183.136677] nix-grpc-daemon[1693]: time=2026-09-22T11:24:26.369Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 183.138621] nix-grpc-daemon[1693]: time=2026-09-22T11:24:26.370Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 183.173234] niks3-server[1194]: 2026/09/22 11:24:26 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 183.182227] niks3-server[1194]: 2026/09/22 11:24:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 183.166181] nix-grpc-daemon[1693]: time=2026-09-22T11:24:26.398Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.187752] niks3-server[1194]: 2026/09/22 11:24:26 INFO Signed narinfos id=64 count=1 lb # [ 183.191113] niks3-server[1194]: 2026/09/22 11:24:26 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 183.201359] niks3-server[1194]: 2026/09/22 11:24:26 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete worker1 # [ 183.185713] nix-grpc-daemon[1693]: time=2026-09-22T11:24:26.418Z level=INFO msg="Upload complete. (369ms)" lb # [ 183.207641] niks3-server[1194]: 2026/09/22 11:24:26 INFO Completed upload id=64 worker1 # [ 183.187923] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 183.210832] niks3-server[1194]: 2026/09/22 11:24:26 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 183.191703] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 183.197749] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 183.199984] nix-daemon[855]: reaped child process 1918, status = succeeded worker1 # [ 183.205041] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 184.420541] nix-daemon[855]: reaped child process 1932, status = succeeded worker1 # [ 184.557165] nix-daemon[855]: accepted connection from pid 1948, user nix-grpc-daemon (trusted) worker1 # [ 184.569273] nix-daemon[855]: reaped child process 1951, status = succeeded lb # [ 184.602825] niks3-server[1194]: 2026/09/22 11:24:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 184.590353] nix-grpc-daemon[1693]: time=2026-09-22T11:24:27.822Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 184.591844] nix-grpc-daemon[1693]: time=2026-09-22T11:24:27.824Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 184.639076] niks3-server[1194]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 184.649624] niks3-server[1194]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 184.655530] niks3-server[1194]: 2026/09/22 11:24:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 184.659090] niks3-server[1194]: 2026/09/22 11:24:28 INFO Signed narinfos id=65 count=1 worker1 # [ 184.639986] nix-grpc-daemon[1693]: time=2026-09-22T11:24:27.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.664525] niks3-server[1194]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 184.673637] niks3-server[1194]: 2026/09/22 11:24:28 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 184.682417] niks3-server[1194]: 2026/09/22 11:24:28 INFO Completed upload id=65 worker1 # [ 184.660713] nix-grpc-daemon[1693]: time=2026-09-22T11:24:27.893Z level=INFO msg="Upload complete. (249ms)" lb # [ 184.683648] niks3-server[1194]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 184.668858] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker1 # [ 184.675755] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:27Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 184.681212] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 184.684381] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:27Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 184.691024] nix-daemon[855]: reaped child process 1930, status = succeeded worker1 # [ 184.692399] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 184.698291] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 184.702114] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 184.849932] nix-daemon[855]: accepted connection from pid 1957, user nix-grpc-daemon (trusted) worker1 # [ 184.862857] nix-daemon[855]: reaped child process 1960, status = succeeded worker1 # [ 185.003891] nix-daemon[855]: accepted connection from pid 1962, user nix-grpc-daemon (trusted) worker1 # [ 185.014597] nix-daemon[855]: reaped child process 1965, status = succeeded lb # [ 185.047636] niks3-server[1194]: 2026/09/22 11:24:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 185.033307] nix-grpc-daemon[1693]: time=2026-09-22T11:24:28.265Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 185.034809] nix-grpc-daemon[1693]: time=2026-09-22T11:24:28.267Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 185.075084] niks3-server[1194]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 185.086596] niks3-server[1194]: 2026/09/22 11:24:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 185.093117] niks3-server[1194]: 2026/09/22 11:24:28 INFO Signed narinfos id=66 count=1 worker1 # [ 185.074326] nix-grpc-daemon[1693]: time=2026-09-22T11:24:28.306Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.096224] niks3-server[1194]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 185.109380] niks3-server[1194]: 2026/09/22 11:24:28 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 185.115163] niks3-server[1194]: 2026/09/22 11:24:28 INFO Completed upload id=66 worker1 # [ 185.095681] nix-grpc-daemon[1693]: time=2026-09-22T11:24:28.328Z level=INFO msg="Upload complete. (387ms)" lb # [ 185.118148] niks3-server[1194]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 185.099093] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 185.104307] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 185.112913] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 185.119724] nix-daemon[855]: reaped child process 1955, status = succeeded worker1 # [ 185.123975] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 186.349837] nix-daemon[855]: reaped child process 1969, status = succeeded worker1 # [ 186.471163] nix-daemon[855]: accepted connection from pid 1985, user nix-grpc-daemon (trusted) worker1 # [ 186.482905] nix-daemon[855]: reaped child process 1988, status = succeeded lb # [ 186.514816] niks3-server[1194]: 2026/09/22 11:24:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 186.501392] nix-grpc-daemon[1693]: time=2026-09-22T11:24:29.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 186.503039] nix-grpc-daemon[1693]: time=2026-09-22T11:24:29.735Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 186.553486] niks3-server[1194]: 2026/09/22 11:24:29 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 186.559275] niks3-server[1194]: 2026/09/22 11:24:29 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 186.569702] niks3-server[1194]: 2026/09/22 11:24:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 186.573808] niks3-server[1194]: 2026/09/22 11:24:29 INFO Signed narinfos id=67 count=1 worker1 # [ 186.555516] nix-grpc-daemon[1693]: time=2026-09-22T11:24:29.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.581344] niks3-server[1194]: 2026/09/22 11:24:29 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 186.589472] niks3-server[1194]: 2026/09/22 11:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 186.596115] niks3-server[1194]: 2026/09/22 11:24:30 INFO Completed upload id=67 worker1 # [ 186.574594] nix-grpc-daemon[1693]: time=2026-09-22T11:24:29.807Z level=INFO msg="Upload complete. (243ms)" lb # [ 186.598929] niks3-server[1194]: 2026/09/22 11:24:30 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 186.587828] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker1 # [ 186.592254] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:29Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 186.596237] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 186.599247] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:29Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 186.609342] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 186.611979] nix-daemon[855]: reaped child process 1967, status = succeeded worker1 # [ 186.617286] nix-grpc-daemon[1693]: time=2026-09-22T11:24:29.849Z level=INFO msg="All 1 paths already cached" worker1 # [ 186.621677] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 186.625347] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 186.751791] nix-daemon[855]: accepted connection from pid 1994, user nix-grpc-daemon (trusted) worker1 # [ 186.763823] nix-daemon[855]: reaped child process 1997, status = succeeded lb # [ 186.785789] envoy[899]: conn peer=[2001:db8:1::4]:60460 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1584 tx=344 ms=24401 worker1 # [ 186.910035] nix-daemon[855]: accepted connection from pid 1999, user nix-grpc-daemon (trusted) worker1 # [ 186.922085] nix-daemon[855]: reaped child process 2002, status = succeeded lb # [ 186.957277] niks3-server[1194]: 2026/09/22 11:24:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 186.942975] nix-grpc-daemon[1693]: time=2026-09-22T11:24:30.175Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 186.944512] nix-grpc-daemon[1693]: time=2026-09-22T11:24:30.177Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 186.983807] niks3-server[1194]: 2026/09/22 11:24:30 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 186.995911] niks3-server[1194]: 2026/09/22 11:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker1 # [ 186.979507] nix-grpc-daemon[1693]: time=2026-09-22T11:24:30.212Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.001609] niks3-server[1194]: 2026/09/22 11:24:30 INFO Signed narinfos id=68 count=1 lb # [ 187.006508] niks3-server[1194]: 2026/09/22 11:24:30 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 187.019356] niks3-server[1194]: 2026/09/22 11:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 187.024506] niks3-server[1194]: 2026/09/22 11:24:30 INFO Completed upload id=68 worker1 # [ 187.004989] nix-grpc-daemon[1693]: time=2026-09-22T11:24:30.237Z level=INFO msg="Upload complete. (373ms)" worker1 # [ 187.007197] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 187.028130] niks3-server[1194]: 2026/09/22 11:24:30 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 187.012389] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 187.016976] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 187.019187] nix-daemon[855]: reaped child process 1992, status = succeeded worker1 # [ 187.024384] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 188.249403] nix-daemon[855]: reaped child process 2006, status = succeeded worker1 # [ 188.401215] nix-daemon[855]: accepted connection from pid 2022, user nix-grpc-daemon (trusted) worker1 # [ 188.413372] nix-daemon[855]: reaped child process 2025, status = succeeded lb # [ 188.450085] niks3-server[1194]: 2026/09/22 11:24:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 188.432645] nix-grpc-daemon[1693]: time=2026-09-22T11:24:31.664Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 188.436883] nix-grpc-daemon[1693]: time=2026-09-22T11:24:31.666Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 188.472374] niks3-server[1194]: 2026/09/22 11:24:31 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 188.476056] niks3-server[1194]: 2026/09/22 11:24:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 188.478234] niks3-server[1194]: 2026/09/22 11:24:31 INFO Signed narinfos id=69 count=1 worker1 # [ 188.456767] nix-grpc-daemon[1693]: time=2026-09-22T11:24:31.689Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.481634] niks3-server[1194]: 2026/09/22 11:24:31 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 188.484972] niks3-server[1194]: 2026/09/22 11:24:31 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 188.488944] niks3-server[1194]: 2026/09/22 11:24:31 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 188.491921] niks3-server[1194]: 2026/09/22 11:24:31 INFO Completed upload id=69 worker1 # [ 188.471533] nix-grpc-daemon[1693]: time=2026-09-22T11:24:31.704Z level=INFO msg="Upload complete. (240ms)" lb # [ 188.493838] niks3-server[1194]: 2026/09/22 11:24:31 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 188.474191] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker1 # [ 188.478940] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:31Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 188.481716] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:31Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 188.486466] nix-daemon[855]: reaped child process 2004, status = succeeded worker1 # [ 188.519384] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 188.524493] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 188.530282] nix-grpc-daemon[1693]: time=2026-09-22T11:24:31.762Z level=INFO msg="All 1 paths already cached" worker1 # [ 188.533488] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 188.537156] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 188.665215] nix-daemon[855]: accepted connection from pid 2031, user nix-grpc-daemon (trusted) worker1 # [ 188.676842] nix-daemon[855]: reaped child process 2034, status = succeeded worker1 # [ 188.808767] nix-daemon[855]: accepted connection from pid 2036, user nix-grpc-daemon (trusted) worker1 # [ 188.820655] nix-daemon[855]: reaped child process 2039, status = succeeded lb # [ 188.851804] niks3-server[1194]: 2026/09/22 11:24:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 188.838545] nix-grpc-daemon[1693]: time=2026-09-22T11:24:32.070Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 188.839885] nix-grpc-daemon[1693]: time=2026-09-22T11:24:32.070Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 188.891615] niks3-server[1194]: 2026/09/22 11:24:32 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 188.900598] niks3-server[1194]: 2026/09/22 11:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 188.883247] nix-grpc-daemon[1693]: time=2026-09-22T11:24:32.115Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.905831] niks3-server[1194]: 2026/09/22 11:24:32 INFO Signed narinfos id=70 count=1 lb # [ 188.912929] niks3-server[1194]: 2026/09/22 11:24:32 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 188.917240] niks3-server[1194]: 2026/09/22 11:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 188.921232] niks3-server[1194]: 2026/09/22 11:24:32 INFO Completed upload id=70 worker1 # [ 188.899600] nix-grpc-daemon[1693]: time=2026-09-22T11:24:32.132Z level=INFO msg="Upload complete. (356ms)" lb # [ 188.923392] niks3-server[1194]: 2026/09/22 11:24:32 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 188.901835] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 188.905352] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 188.914056] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 188.916258] nix-daemon[855]: reaped child process 2029, status = succeeded worker1 # [ 188.921537] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 189.734823] nix-daemon[855]: reaped child process 2043, status = succeeded worker1 # [ 189.862287] nix-daemon[855]: accepted connection from pid 2059, user nix-grpc-daemon (trusted) worker1 # [ 189.874377] nix-daemon[855]: reaped child process 2062, status = succeeded lb # [ 189.907475] niks3-server[1194]: 2026/09/22 11:24:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 189.894456] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.126Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 189.896975] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.128Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 189.935563] niks3-server[1194]: 2026/09/22 11:24:33 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 189.960489] niks3-server[1194]: 2026/09/22 11:24:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign worker1 # [ 189.942375] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.174Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.965128] niks3-server[1194]: 2026/09/22 11:24:33 INFO Signed narinfos id=71 count=1 lb # [ 189.969908] niks3-server[1194]: 2026/09/22 11:24:33 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 189.975211] niks3-server[1194]: 2026/09/22 11:24:33 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 189.983365] niks3-server[1194]: 2026/09/22 11:24:33 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 189.986049] niks3-server[1194]: 2026/09/22 11:24:33 INFO Completed upload id=71 worker1 # [ 189.964257] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.196Z level=INFO msg="Upload complete. (236ms)" lb # [ 189.988385] niks3-server[1194]: 2026/09/22 11:24:33 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 189.970753] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker1 # [ 189.980412] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 189.985311] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 189.988658] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 189.998084] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 190.000458] nix-daemon[855]: reaped child process 2041, status = succeeded worker1 # [ 190.004189] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.236Z level=INFO msg="All 1 paths already cached" worker1 # [ 190.008125] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 190.013154] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 190.155995] nix-daemon[855]: accepted connection from pid 2068, user nix-grpc-daemon (trusted) worker1 # [ 190.167895] nix-daemon[855]: reaped child process 2071, status = succeeded worker1 # [ 190.294187] nix-daemon[855]: accepted connection from pid 2073, user nix-grpc-daemon (trusted) worker1 # [ 190.306863] nix-daemon[855]: reaped child process 2076, status = succeeded lb # [ 190.337833] niks3-server[1194]: 2026/09/22 11:24:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 190.320678] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.553Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 190.322438] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.554Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 190.366441] niks3-server[1194]: 2026/09/22 11:24:33 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 190.373966] niks3-server[1194]: 2026/09/22 11:24:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign worker1 # [ 190.356956] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.589Z level=INFO msg="Uploading 1 narinfos" lb # [ 190.379095] niks3-server[1194]: 2026/09/22 11:24:33 INFO Signed narinfos id=72 count=1 lb # [ 190.385489] niks3-server[1194]: 2026/09/22 11:24:33 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 190.396132] niks3-server[1194]: 2026/09/22 11:24:33 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 190.402437] niks3-server[1194]: 2026/09/22 11:24:33 INFO Completed upload id=72 worker1 # [ 190.381275] nix-grpc-daemon[1693]: time=2026-09-22T11:24:33.613Z level=INFO msg="Upload complete. (362ms)" worker1 # [ 190.383578] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 190.404769] niks3-server[1194]: 2026/09/22 11:24:33 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 190.390043] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 190.391931] nix-daemon[855]: reaped child process 2066, status = succeeded worker1 # [ 190.394986] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 190.402037] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 191.815701] nix-daemon[855]: reaped child process 2080, status = succeeded worker1 # [ 191.930285] nix-daemon[855]: accepted connection from pid 2096, user nix-grpc-daemon (trusted) worker1 # [ 191.942188] nix-daemon[855]: reaped child process 2099, status = succeeded lb # [ 191.976125] niks3-server[1194]: 2026/09/22 11:24:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 191.961388] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.193Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 191.963082] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.195Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 192.002604] niks3-server[1194]: 2026/09/22 11:24:35 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 192.018277] niks3-server[1194]: 2026/09/22 11:24:35 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 192.027709] niks3-server[1194]: 2026/09/22 11:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 192.032485] niks3-server[1194]: 2026/09/22 11:24:35 INFO Signed narinfos id=73 count=1 worker1 # [ 192.013246] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 192.042891] niks3-server[1194]: 2026/09/22 11:24:35 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 192.050373] niks3-server[1194]: 2026/09/22 11:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 192.053432] niks3-server[1194]: 2026/09/22 11:24:35 INFO Completed upload id=73 lb # [ 192.054864] niks3-server[1194]: 2026/09/22 11:24:35 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 192.031919] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.264Z level=INFO msg="Upload complete. (221ms)" worker1 # [ 192.041850] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker1 # [ 192.048160] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 192.052535] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 192.057187] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 192.064154] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 192.066572] nix-daemon[855]: reaped child process 2078, status = succeeded worker1 # [ 192.070215] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.302Z level=INFO msg="All 2 paths already cached" worker1 # [ 192.074217] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 192.079070] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 192.209382] nix-daemon[855]: accepted connection from pid 2105, user nix-grpc-daemon (trusted) worker1 # [ 192.221272] nix-daemon[855]: reaped child process 2108, status = succeeded worker1 # [ 192.372032] nix-daemon[855]: accepted connection from pid 2110, user nix-grpc-daemon (trusted) worker1 # [ 192.383675] nix-daemon[855]: reaped child process 2113, status = succeeded lb # [ 192.417813] niks3-server[1194]: 2026/09/22 11:24:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 192.403612] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.635Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 192.404980] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.635Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 192.443500] niks3-server[1194]: 2026/09/22 11:24:35 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 192.451722] niks3-server[1194]: 2026/09/22 11:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 192.456625] niks3-server[1194]: 2026/09/22 11:24:35 INFO Signed narinfos id=74 count=1 worker1 # [ 192.437936] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.670Z level=INFO msg="Uploading 1 narinfos" lb # [ 192.468951] niks3-server[1194]: 2026/09/22 11:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete worker1 # [ 192.454086] nix-grpc-daemon[1693]: time=2026-09-22T11:24:35.686Z level=INFO msg="Upload complete. (370ms)" lb # [ 192.475719] niks3-server[1194]: 2026/09/22 11:24:35 INFO Completed upload id=74 worker1 # [ 192.456067] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 192.459539] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 lb # [ 192.482186] niks3-server[1194]: 2026/09/22 11:24:35 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 192.486154] niks3-server[1194]: 2026/09/22 11:24:35 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 192.466431] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 192.468340] nix-daemon[855]: reaped child process 2103, status = succeeded worker1 # [ 192.473193] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 193.687490] nix-daemon[855]: reaped child process 2117, status = succeeded worker1 # [ 193.793504] nix-daemon[855]: accepted connection from pid 2133, user nix-grpc-daemon (trusted) worker1 # [ 193.805113] nix-daemon[855]: reaped child process 2136, status = succeeded lb # [ 193.840553] niks3-server[1194]: 2026/09/22 11:24:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 193.827114] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.059Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 193.828567] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.061Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 193.871154] niks3-server[1194]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 193.883950] niks3-server[1194]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 193.897745] niks3-server[1194]: 2026/09/22 11:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker1 # [ 193.880851] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.113Z level=INFO msg="Uploading 1 narinfos" lb # [ 193.902450] niks3-server[1194]: 2026/09/22 11:24:37 INFO Signed narinfos id=75 count=1 lb # [ 193.908549] niks3-server[1194]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 193.917285] niks3-server[1194]: 2026/09/22 11:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 193.921897] niks3-server[1194]: 2026/09/22 11:24:37 INFO Completed upload id=75 worker1 # [ 193.900229] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.132Z level=INFO msg="Upload complete. (220ms)" lb # [ 193.924388] niks3-server[1194]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 193.908465] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 worker1 # [ 193.915259] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:37Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 193.924267] nix-daemon[855]: reaped child process 2115, status = succeeded worker1 # [ 193.950844] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 193.962939] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 193.976375] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.208Z level=INFO msg="All 2 paths already cached" worker1 # [ 193.983469] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 193.994128] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 194.112620] nix-daemon[855]: accepted connection from pid 2140, user nix-grpc-daemon (trusted) worker1 # [ 194.124506] nix-daemon[855]: reaped child process 2143, status = succeeded worker1 # [ 194.261204] nix-daemon[855]: accepted connection from pid 2145, user nix-grpc-daemon (trusted) worker1 # [ 194.271498] nix-daemon[855]: reaped child process 2148, status = succeeded lb # [ 194.303751] niks3-server[1194]: 2026/09/22 11:24:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 194.289792] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.522Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 194.291568] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.524Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 194.333845] niks3-server[1194]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 194.344585] niks3-server[1194]: 2026/09/22 11:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign lb # [ 194.349779] niks3-server[1194]: 2026/09/22 11:24:37 INFO Signed narinfos id=76 count=1 worker1 # [ 194.331084] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.563Z level=INFO msg="Uploading 1 narinfos" lb # [ 194.356290] niks3-server[1194]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 194.368483] niks3-server[1194]: 2026/09/22 11:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 194.372608] niks3-server[1194]: 2026/09/22 11:24:37 INFO Completed upload id=76 worker1 # [ 194.353103] nix-grpc-daemon[1693]: time=2026-09-22T11:24:37.585Z level=INFO msg="Upload complete. (349ms)" lb # [ 194.376219] niks3-server[1194]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 194.355706] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 194.361315] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 194.372392] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 194.374470] nix-daemon[855]: reaped child process 2138, status = succeeded worker1 # [ 194.379926] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 195.207792] nix-daemon[855]: reaped child process 2152, status = succeeded worker1 # [ 195.320911] nix-daemon[855]: accepted connection from pid 2168, user nix-grpc-daemon (trusted) worker1 # [ 195.332609] nix-daemon[855]: reaped child process 2171, status = succeeded lb # [ 195.365415] niks3-server[1194]: 2026/09/22 11:24:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 195.352039] nix-grpc-daemon[1693]: time=2026-09-22T11:24:38.584Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 195.354848] nix-grpc-daemon[1693]: time=2026-09-22T11:24:38.585Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 195.402919] niks3-server[1194]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 195.408284] niks3-server[1194]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 195.416777] niks3-server[1194]: 2026/09/22 11:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 195.421419] niks3-server[1194]: 2026/09/22 11:24:38 INFO Signed narinfos id=77 count=1 worker1 # [ 195.402838] nix-grpc-daemon[1693]: time=2026-09-22T11:24:38.635Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.431343] niks3-server[1194]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 195.439122] niks3-server[1194]: 2026/09/22 11:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 195.444344] niks3-server[1194]: 2026/09/22 11:24:38 INFO Completed upload id=77 lb # [ 195.447282] niks3-server[1194]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 195.424557] nix-grpc-daemon[1693]: time=2026-09-22T11:24:38.657Z level=INFO msg="Upload complete. (237ms)" worker1 # [ 195.432761] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker1 # [ 195.439535] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:38Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 195.448702] nix-daemon[855]: reaped child process 2150, status = succeeded worker1 # [ 195.475210] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 195.486280] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 195.498373] nix-grpc-daemon[1693]: time=2026-09-22T11:24:38.730Z level=INFO msg="All 2 paths already cached" worker1 # [ 195.505832] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 195.513552] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 195.651575] nix-daemon[855]: accepted connection from pid 2175, user nix-grpc-daemon (trusted) worker1 # [ 195.663618] nix-daemon[855]: reaped child process 2178, status = succeeded worker1 # [ 195.807575] nix-daemon[855]: accepted connection from pid 2180, user nix-grpc-daemon (trusted) worker1 # [ 195.819124] nix-daemon[855]: reaped child process 2183, status = succeeded lb # [ 195.850725] niks3-server[1194]: 2026/09/22 11:24:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 195.836659] nix-grpc-daemon[1693]: time=2026-09-22T11:24:39.069Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 195.838195] nix-grpc-daemon[1693]: time=2026-09-22T11:24:39.070Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 195.877834] niks3-server[1194]: 2026/09/22 11:24:39 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 195.888617] niks3-server[1194]: 2026/09/22 11:24:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 195.892524] niks3-server[1194]: 2026/09/22 11:24:39 INFO Signed narinfos id=78 count=1 worker1 # [ 195.874720] nix-grpc-daemon[1693]: time=2026-09-22T11:24:39.107Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.900244] niks3-server[1194]: 2026/09/22 11:24:39 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 195.910499] niks3-server[1194]: 2026/09/22 11:24:39 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete worker1 # [ 195.893327] nix-grpc-daemon[1693]: time=2026-09-22T11:24:39.125Z level=INFO msg="Upload complete. (368ms)" lb # [ 195.915270] niks3-server[1194]: 2026/09/22 11:24:39 INFO Completed upload id=78 worker1 # [ 195.895354] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 195.918382] niks3-server[1194]: 2026/09/22 11:24:39 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 195.900865] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 195.905963] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 195.908115] nix-daemon[855]: reaped child process 2173, status = succeeded worker1 # [ 195.913290] nix-daemon[855]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker1 # [ 196.925652] nix-daemon[855]: reaped child process 2187, status = succeeded worker1 # [ 197.044272] nix-daemon[855]: accepted connection from pid 2203, user nix-grpc-daemon (trusted) worker1 # [ 197.054776] nix-daemon[855]: reaped child process 2206, status = succeeded lb # [ 197.089631] niks3-server[1194]: 2026/09/22 11:24:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 197.075628] nix-grpc-daemon[1693]: time=2026-09-22T11:24:40.307Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 197.077389] nix-grpc-daemon[1693]: time=2026-09-22T11:24:40.309Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 197.126432] niks3-server[1194]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 197.131581] niks3-server[1194]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 197.145587] niks3-server[1194]: 2026/09/22 11:24:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 197.150943] niks3-server[1194]: 2026/09/22 11:24:40 INFO Signed narinfos id=79 count=1 worker1 # [ 197.131844] nix-grpc-daemon[1693]: time=2026-09-22T11:24:40.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.155595] niks3-server[1194]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 197.166921] niks3-server[1194]: 2026/09/22 11:24:40 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 197.170273] niks3-server[1194]: 2026/09/22 11:24:40 INFO Completed upload id=79 worker1 # [ 197.148662] nix-grpc-daemon[1693]: time=2026-09-22T11:24:40.381Z level=INFO msg="Upload complete. (229ms)" lb # [ 197.171852] niks3-server[1194]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 197.154640] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37720 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 worker1 # [ 197.165955] nix-daemon[855]: reaped child process 2185, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.77 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 197.299985] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: ceb3cbd975b4437aa4b5ad688a8f5f32 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 197.482615] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37720 client # [ 197.497141] nix[1530]: don't know how to build these paths: client # [ 197.498208] nix[1530]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 197.489164] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 client # [ 197.516088] nix[1530]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker worker1 # [ 197.506503] nix-grpc-daemon[1597]: ts=2026-09-22T11:24:40Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 206.788195] envoy[899]: conn peer=[2001:db8:1::1]:56110 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27098 tx=12420 ms=16551 client # [ 227.517306] nix[1530]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 227.525396] nix[1530]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 227.557570] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 227.562300] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 227.565773] systemd[1]: gpu.service: Consumed 128ms CPU time over 30.262s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5.1K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.45 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 47.86 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.91 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 229.413997] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:12Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2 client # don't know how to build these paths: worker1 # [ 230.518377] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37720 client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker1 # [ 230.521353] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37720 worker1 # [ 230.537258] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:13Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker1 # [ 230.539047] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:13Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 230.594388] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 230.600797] nix-grpc-daemon[2060]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 1/5) worker2 # [ 230.661576] nix-grpc-daemon[2060]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 195 ms (attempt 2/5) worker2 # [ 230.862578] nix-grpc-daemon[2060]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 3/5) worker2 # [ 230.880411] nix-grpc-daemon[2060]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 505 ms (attempt 4/5) worker2 # [ 231.391328] nix-grpc-daemon[2060]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 231.393149] nix-grpc-daemon[2060]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 231.405300] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33654 client # copying 1 paths to 'lb:50051'... worker2 # [ 231.414477] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33654 client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 231.421599] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 231.432916] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:15Z level=info event=niks3_push_started pid=2120 worker2 # [ 231.616675] nix-grpc-daemon[2120]: time=2026-09-22T11:25:15.686Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 231.776395] nix-daemon[877]: accepted connection from pid 2133, user nix-grpc-daemon (trusted) worker2 # [ 231.788903] nix-daemon[877]: reaped child process 2136, status = succeeded worker2 # [ 231.954202] nix-daemon[877]: accepted connection from pid 2138, user nix-grpc-daemon (trusted) worker2 # [ 231.966316] nix-daemon[877]: reaped child process 2141, status = succeeded lb # [ 231.993126] niks3-server[1194]: 2026/09/22 11:25:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 231.992399] nix-grpc-daemon[2120]: time=2026-09-22T11:25:16.062Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 231.994373] nix-grpc-daemon[2120]: time=2026-09-22T11:25:16.064Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 232.031683] niks3-server[1194]: 2026/09/22 11:25:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign worker2 # [ 232.034475] nix-grpc-daemon[2120]: time=2026-09-22T11:25:16.104Z level=INFO msg="Uploading 1 narinfos" lb # [ 232.044344] niks3-server[1194]: 2026/09/22 11:25:15 INFO Signed narinfos id=80 count=1 lb # [ 232.047295] niks3-server[1194]: 2026/09/22 11:25:15 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 232.056482] niks3-server[1194]: 2026/09/22 11:25:15 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 232.068856] niks3-server[1194]: 2026/09/22 11:25:15 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 232.074334] niks3-server[1194]: 2026/09/22 11:25:15 INFO Completed upload id=80 worker2 # [ 232.066553] nix-grpc-daemon[2120]: time=2026-09-22T11:25:16.136Z level=INFO msg="Upload complete. (445ms)" lb # [ 232.077899] niks3-server[1194]: 2026/09/22 11:25:15 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 232.071565] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33654 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 232.077663] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 232.088114] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 232.092296] nix-daemon[877]: reaped child process 2118, status = succeeded worker2 # [ 232.098142] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 232.912580] nix-daemon[877]: reaped child process 2145, status = succeeded worker2 # [ 233.057381] nix-daemon[877]: accepted connection from pid 2161, user nix-grpc-daemon (trusted) worker2 # [ 233.068546] nix-daemon[877]: reaped child process 2164, status = succeeded lb # [ 233.089884] niks3-server[1194]: 2026/09/22 11:25:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 233.086706] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.156Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 233.088304] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.158Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 233.112494] niks3-server[1194]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 233.117439] niks3-server[1194]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 233.121050] niks3-server[1194]: 2026/09/22 11:25:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 233.122960] niks3-server[1194]: 2026/09/22 11:25:16 INFO Signed narinfos id=81 count=1 worker2 # [ 233.115073] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.184Z level=INFO msg="Uploading 1 narinfos" lb # [ 233.126257] niks3-server[1194]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 233.131154] niks3-server[1194]: 2026/09/22 11:25:16 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 233.135044] niks3-server[1194]: 2026/09/22 11:25:16 INFO Completed upload id=81 worker2 # [ 233.124887] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.195Z level=INFO msg="Upload complete. (220ms)" lb # [ 233.136838] niks3-server[1194]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 233.127548] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker2 # [ 233.134303] nix-daemon[877]: reaped child process 2143, status = succeeded worker1 # [ 233.125811] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:16Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker1 # [ 233.129781] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:16Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 233.180101] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 233.187533] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 233.194924] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.265Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 233.200534] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33654 client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 233.206717] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 233.337534] nix-daemon[877]: accepted connection from pid 2168, user nix-grpc-daemon (trusted) worker2 # [ 233.350548] nix-daemon[877]: reaped child process 2171, status = succeeded worker2 # [ 233.489665] nix-daemon[877]: accepted connection from pid 2173, user nix-grpc-daemon (trusted) worker2 # [ 233.502559] nix-daemon[877]: reaped child process 2176, status = succeeded lb # [ 233.523213] niks3-server[1194]: 2026/09/22 11:25:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 233.522509] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.592Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 233.523870] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.592Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 233.552166] niks3-server[1194]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 233.560155] niks3-server[1194]: 2026/09/22 11:25:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 233.564992] niks3-server[1194]: 2026/09/22 11:25:16 INFO Signed narinfos id=82 count=1 worker2 # [ 233.557822] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.628Z level=INFO msg="Uploading 1 narinfos" lb # [ 233.568300] niks3-server[1194]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 233.579318] niks3-server[1194]: 2026/09/22 11:25:16 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 233.582031] niks3-server[1194]: 2026/09/22 11:25:16 INFO Completed upload id=82 worker2 # [ 233.572040] nix-grpc-daemon[2120]: time=2026-09-22T11:25:17.642Z level=INFO msg="Upload complete. (360ms)" lb # [ 233.583373] niks3-server[1194]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 233.574221] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33654 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 233.576977] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 233.580751] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 233.586985] nix-daemon[877]: reaped child process 2166, status = succeeded client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... worker2 # [ 233.591520] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 234.817324] nix-daemon[877]: reaped child process 2180, status = succeeded worker2 # [ 234.968388] nix-daemon[877]: accepted connection from pid 2196, user nix-grpc-daemon (trusted) worker2 # [ 234.979388] nix-daemon[877]: reaped child process 2199, status = succeeded lb # [ 235.004854] niks3-server[1194]: 2026/09/22 11:25:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 234.999118] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.069Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 235.000666] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.071Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 235.022824] niks3-server[1194]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 235.026941] niks3-server[1194]: 2026/09/22 11:25:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 235.029362] niks3-server[1194]: 2026/09/22 11:25:18 INFO Signed narinfos id=83 count=1 worker2 # [ 235.020866] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.091Z level=INFO msg="Uploading 1 narinfos" lb # [ 235.032347] niks3-server[1194]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 235.034723] niks3-server[1194]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 235.038814] niks3-server[1194]: 2026/09/22 11:25:18 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 235.042085] niks3-server[1194]: 2026/09/22 11:25:18 INFO Completed upload id=83 worker2 # [ 235.033210] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.103Z level=INFO msg="Upload complete. (232ms)" lb # [ 235.043873] niks3-server[1194]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 235.035923] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 worker2 # [ 235.042686] nix-daemon[877]: reaped child process 2178, status = succeeded worker1 # [ 235.031812] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:18Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker1 # [ 235.036200] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:18Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 235.086069] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 235.094440] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 235.103715] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.174Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 235.109737] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 235.116051] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 235.274527] nix-daemon[877]: accepted connection from pid 2203, user nix-grpc-daemon (trusted) worker2 # [ 235.287106] nix-daemon[877]: reaped child process 2206, status = succeeded worker2 # [ 235.442198] nix-daemon[877]: accepted connection from pid 2208, user nix-grpc-daemon (trusted) worker2 # [ 235.454777] nix-daemon[877]: reaped child process 2211, status = succeeded lb # [ 235.478419] niks3-server[1194]: 2026/09/22 11:25:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 235.476183] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.546Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 235.477586] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.546Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 235.501187] niks3-server[1194]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 235.513735] niks3-server[1194]: 2026/09/22 11:25:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign worker2 # [ 235.508463] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.578Z level=INFO msg="Uploading 1 narinfos" lb # [ 235.518827] niks3-server[1194]: 2026/09/22 11:25:18 INFO Signed narinfos id=84 count=1 lb # [ 235.524838] niks3-server[1194]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 235.536950] niks3-server[1194]: 2026/09/22 11:25:18 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete worker2 # [ 235.531645] nix-grpc-daemon[2120]: time=2026-09-22T11:25:19.602Z level=INFO msg="Upload complete. (409ms)" lb # [ 235.541944] niks3-server[1194]: 2026/09/22 11:25:18 INFO Completed upload id=84 worker2 # [ 235.533798] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33654 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 235.545120] niks3-server[1194]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 235.538990] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 worker2 # [ 235.544510] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 235.546831] nix-daemon[877]: reaped child process 2201, status = succeeded worker2 # [ 235.552052] nix-daemon[877]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 236.791160] envoy[899]: conn peer=[2001:db8:1::1]:49758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=30047 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 237.168849] nix-daemon[877]: reaped child process 2215, status = succeeded worker2 # [ 237.305332] nix-daemon[877]: accepted connection from pid 2231, user nix-grpc-daemon (trusted) worker2 # [ 237.318346] nix-daemon[877]: reaped child process 2234, status = succeeded lb # [ 237.343293] niks3-server[1194]: 2026/09/22 11:25:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 237.342112] nix-grpc-daemon[2120]: time=2026-09-22T11:25:21.412Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 237.343826] nix-grpc-daemon[2120]: time=2026-09-22T11:25:21.414Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 237.385630] niks3-server[1194]: 2026/09/22 11:25:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign lb # [ 237.392127] niks3-server[1194]: 2026/09/22 11:25:20 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 237.397871] niks3-server[1194]: 2026/09/22 11:25:20 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 237.394031] nix-grpc-daemon[2120]: time=2026-09-22T11:25:21.464Z level=INFO msg="Uploading 1 narinfos" lb # [ 237.404144] niks3-server[1194]: 2026/09/22 11:25:20 INFO Signed narinfos id=85 count=1 lb # [ 237.414544] niks3-server[1194]: 2026/09/22 11:25:20 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 237.419616] niks3-server[1194]: 2026/09/22 11:25:20 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete worker2 # [ 237.415757] nix-grpc-daemon[2120]: time=2026-09-22T11:25:21.486Z level=INFO msg="Upload complete. (256ms)" lb # [ 237.425814] niks3-server[1194]: 2026/09/22 11:25:20 INFO Completed upload id=85 worker2 # [ 237.418488] nix-grpc-daemon[2060]: ts=2026-09-22T11:25:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33654 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 lb # [ 237.430280] niks3-server[1194]: 2026/09/22 11:25:20 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 237.425746] nix-daemon[877]: reaped child process 2213, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 7.13 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.20 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 238.418260] nix-grpc-daemon[1597]: ts=2026-09-22T11:25:21Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.69 seconds) (finished: run the VM test script, in 239.85 seconds) test script finished in 240.11s cleanup kill QemuMachine (pid 50) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 49) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 0.93 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh