tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) lb: QEMU running (pid 50) lb # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.W8gIhQ60wj', fmt=raw size=1073741824 lb # Formatting '/build/vm-state-lb/tmp.prbQ5G8nCh', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) worker2 # Disk image does not exist, creating the virtualisation disk image... lb # mke2fs 1.47.4 (6-Mar-2025) worker2: QEMU running (pid 52) client # Discarding device blocks: 0/262144 done worker2 # Formatting '/build/vm-state-worker2/tmp.lwfrubCPtC', fmt=raw size=1073741824 client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done client # Filesystem UUID: 32a4384f-20d0-4c8b-81c0-23959cae1982 worker2 # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # Superblock backups stored on blocks: worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: 4b5c44a8-1016-48de-acff-1e08138bfec2 client # 32768, 98304, 163840, 229376 worker2 # Filesystem UUID: 4c72d6b6-e693-42f5-bd7a-183f76c1c576 lb # Superblock backups stored on blocks: client # worker2 # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 client # Allocating group tables: 0/8 done worker2 # 32768, 98304, 163840, 229376 lb # client # Writing inode tables: 0/8 done worker2 # lb # Allocating group tables: 0/8 done client # Creating journal (8192 blocks): done worker2 # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done client # worker2 # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done client # Virtualisation disk image created. worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) worker2 # lb # Virtualisation disk image created. worker2 # Virtualisation disk image created. worker1 # Formatting '/build/vm-state-worker1/tmp.HpumQfM74j', fmt=raw size=1073741824 (finished: start all VMs, in 0.18 seconds) worker1 # mke2fs 1.47.4 (6-Mar-2025) client: waiting for unit network-addresses-eth1.service worker1 # Discarding device blocks: 0/262144 done client: waiting for the VM to finish booting worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 6a7249ba-1da5-4fd6-a67d-b968cb127ad3 worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # client # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # lb # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:08.0)... client # client # worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker1 # worker1 # lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)... lb # lb # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker2 # worker2 # client # Booting from ROM... worker1 # Booting from ROM... lb # Booting from ROM... worker2 # Booting from ROM... client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test/init regInfo=/nix/store/b8ampkhjhkxcfp3s6f3zcp422b7lvzsc-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8mvx6cn1l6frdr55gdj0p01an8nxnxzn-nixos-system-lb-test/init regInfo=/nix/store/0a2f35z8lm3xm6ffdv71jfscn9vyk5l1-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j7glxpj3rbb8k7aikb154lhfz7amnd7b-nixos-system-worker2-test/init regInfo=/nix/store/6wyi8ra5v5p7s9q73i0ykg14mn0bn7gx-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] kvm-clock: using sched offset of 464702886 cycles lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6iych1bhd6jkvv72xp98ahp6dmm92z7r-nixos-system-worker1-test/init regInfo=/nix/store/sncm61przda863m2mj9d0pcd8iyhxwx4-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] Hypervisor detected: KVM client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000006] tsc: Detected 2400.012 MHz processor worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] kvm-clock: using sched offset of 466856155 cycles client # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000846] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002745] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.002760] Using GB pages for direct mapping lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002865] RAMDISK: [mem 0x5e366000-0x5ffcffff] worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002876] ACPI: Early table checksum verification disabled worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] APIC: Static calls initialized client # [ 0.002880] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.002884] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002744] Using GB pages for direct mapping worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.002855] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.002888] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000000] APIC: Static calls initialized lb # [ 0.002863] ACPI: Early table checksum verification disabled client # [ 0.002897] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002899] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.002865] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.002869] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] kvm-clock: using sched offset of 479895990 cycles worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.002901] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.002872] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.002902] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.002879] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002904] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002881] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] kvm-clock: using sched offset of 476665986 cycles client # [ 0.002905] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002882] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002906] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.002884] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor worker2 # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.002907] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.002885] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002751] Using GB pages for direct mapping worker1 # [ 0.000822] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002908] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.002900] RAMDISK: [mem 0x5e367000-0x5ffcffff] lb # [ 0.002887] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000850] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002908] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.002908] ACPI: Early table checksum verification disabled lb # [ 0.002888] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.000853] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002909] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002911] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002759] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002889] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.002909] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.002915] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002773] Using GB pages for direct mapping worker1 # [ 0.002862] RAMDISK: [mem 0x5e367000-0x5ffcffff] lb # [ 0.002890] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002910] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002919] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003145] No NUMA configuration found worker1 # [ 0.002871] ACPI: Early table checksum verification disabled lb # [ 0.002890] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.003146] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.002875] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002925] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002891] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.003149] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.002927] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002880] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005555] Zone ranges: lb # [ 0.002891] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.002929] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005556] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.002892] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.002884] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003120] No NUMA configuration found client # [ 0.005558] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.002930] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005559] Normal empty worker1 # [ 0.002892] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005560] Device empty lb # [ 0.003121] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.002932] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005560] Movable zone start for each node worker1 # [ 0.002894] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.003123] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005449] Zone ranges: client # [ 0.005561] Early memory node ranges worker2 # [ 0.002934] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002896] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005562] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.005449] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002935] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.005563] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.002897] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005451] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.005452] Normal empty worker2 # [ 0.002936] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.005453] Device empty client # [ 0.005564] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.002899] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005453] Movable zone start for each node client # [ 0.005584] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.002936] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.005454] Early memory node ranges worker1 # [ 0.002900] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005912] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002937] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.005454] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.002902] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.034027] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.005455] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.002937] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.034503] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.002903] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002938] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.005456] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.034516] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.002903] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.005476] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.002938] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.034545] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.003164] No NUMA configuration found worker1 # [ 0.002904] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.005748] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.034548] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.003165] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.032942] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.002904] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.034550] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.033397] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.003168] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.002905] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.005499] Zone ranges: client # [ 0.034552] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.033408] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.002905] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.005500] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.034553] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.033434] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.003139] No NUMA configuration found worker2 # [ 0.005502] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.034553] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.033437] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.005503] Normal empty worker1 # [ 0.003140] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.005504] Device empty client # [ 0.034556] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.033438] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.005505] Movable zone start for each node worker1 # [ 0.003143] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.034557] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.005505] Early memory node ranges worker1 # [ 0.005835] Zone ranges: lb # [ 0.033439] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.034562] TSC deadline timer available worker1 # [ 0.005836] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.005506] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.034566] CPU topo: Max. logical packages: 1 lb # [ 0.033440] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.005838] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.005507] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.034567] CPU topo: Max. logical dies: 1 worker1 # [ 0.005839] Normal empty lb # [ 0.033441] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.034567] CPU topo: Max. dies per package: 1 worker1 # [ 0.005840] Device empty worker2 # [ 0.005508] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.033444] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.034571] CPU topo: Max. threads per core: 1 worker1 # [ 0.005841] Movable zone start for each node worker2 # [ 0.005528] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.005842] Early memory node ranges client # [ 0.034571] CPU topo: Num. cores per package: 1 lb # [ 0.033445] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.033448] TSC deadline timer available worker1 # [ 0.005842] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.005803] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.034572] CPU topo: Num. threads per package: 1 lb # [ 0.033452] CPU topo: Max. logical packages: 1 worker2 # [ 0.033116] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.034572] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.005843] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.033453] CPU topo: Max. logical dies: 1 worker2 # [ 0.033573] ACPI: PM-Timer IO Port: 0x608 client # [ 0.034595] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.033453] CPU topo: Max. dies per package: 1 worker1 # [ 0.005844] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.033585] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.033459] CPU topo: Max. threads per core: 1 worker1 # [ 0.005868] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.034630] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.033616] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.033459] CPU topo: Num. cores per package: 1 worker1 # [ 0.006140] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.034632] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.033460] CPU topo: Num. threads per package: 1 worker2 # [ 0.033619] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.033614] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.033460] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.034633] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.033621] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.034130] ACPI: PM-Timer IO Port: 0x608 client # [ 0.034635] Booting paravirtualized kernel on KVM worker1 # [ 0.034145] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.033477] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.033622] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.034175] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.033623] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.033508] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.034639] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.034178] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.033623] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.033509] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.039118] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.034180] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.033626] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.033511] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.041451] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.033627] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.033512] Booting paravirtualized kernel on KVM worker1 # [ 0.034181] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.041498] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.033631] TSC deadline timer available worker1 # [ 0.034182] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.033636] CPU topo: Max. logical packages: 1 lb # [ 0.033515] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.033636] CPU topo: Max. logical dies: 1 worker1 # [ 0.034183] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.033637] CPU topo: Max. dies per package: 1 lb # [ 0.037950] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.034185] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.033640] CPU topo: Max. threads per core: 1 lb # [ 0.040416] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.034186] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.033641] CPU topo: Num. cores per package: 1 worker1 # [ 0.034190] TSC deadline timer available lb # [ 0.040460] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.033641] CPU topo: Num. threads per package: 1 client # [ 0.041499] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test/init regInfo=/nix/store/b8ampkhjhkxcfp3s6f3zcp422b7lvzsc-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.034194] CPU topo: Max. logical packages: 1 worker2 # [ 0.033641] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.034195] CPU topo: Max. logical dies: 1 worker1 # [ 0.034196] CPU topo: Max. dies per package: 1 worker2 # [ 0.033659] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.041599] Unknown kernel command line parameters "regInfo=/nix/store/b8ampkhjhkxcfp3s6f3zcp422b7lvzsc-closure-info/registration", will be passed to user space. worker1 # [ 0.034199] CPU topo: Max. threads per core: 1 client # [ 0.041612] random: crng init done worker2 # [ 0.033689] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.034200] CPU topo: Num. cores per package: 1 worker1 # [ 0.034200] CPU topo: Num. threads per package: 1 client # [ 0.041613] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.033691] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.040461] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8mvx6cn1l6frdr55gdj0p01an8nxnxzn-nixos-system-lb-test/init regInfo=/nix/store/0a2f35z8lm3xm6ffdv71jfscn9vyk5l1-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.034200] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.033692] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.043705] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.034221] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.033694] Booting paravirtualized kernel on KVM client # [ 0.044755] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.040553] Unknown kernel command line parameters "regInfo=/nix/store/0a2f35z8lm3xm6ffdv71jfscn9vyk5l1-closure-info/registration", will be passed to user space. client # [ 0.044793] Fallback order for Node 0: 0 worker1 # [ 0.034256] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.040565] random: crng init done worker2 # [ 0.033697] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.044797] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.040566] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.034257] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.038146] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.044798] Policy zone: DMA32 worker1 # [ 0.034259] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.042743] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.047250] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.040358] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.034261] Booting paravirtualized kernel on KVM worker2 # [ 0.040400] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.050672] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.043831] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.043861] Fallback order for Node 0: 0 client # [ 0.054106] allocated 3145728 bytes of page_ext worker1 # [ 0.034264] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.064211] ftrace: allocating 48731 entries in 192 pages lb # [ 0.043864] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.038802] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.043865] Policy zone: DMA32 client # [ 0.064213] ftrace: allocated 192 pages with 2 groups client # [ 0.065125] Dynamic Preempt: lazy worker1 # [ 0.040966] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.046422] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.065314] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.041008] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.049518] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.065315] rcu: RCU event tracing is enabled. worker2 # [ 0.040402] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j7glxpj3rbb8k7aikb154lhfz7amnd7b-nixos-system-worker2-test/init regInfo=/nix/store/6wyi8ra5v5p7s9q73i0ykg14mn0bn7gx-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.053170] allocated 3145728 bytes of page_ext client # [ 0.065316] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.063004] ftrace: allocating 48731 entries in 192 pages client # [ 0.065318] Trampoline variant of Tasks RCU enabled. lb # [ 0.063005] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.040493] Unknown kernel command line parameters "regInfo=/nix/store/6wyi8ra5v5p7s9q73i0ykg14mn0bn7gx-closure-info/registration", will be passed to user space. client # [ 0.065318] Rude variant of Tasks RCU enabled. lb # [ 0.063849] Dynamic Preempt: lazy worker2 # [ 0.040506] random: crng init done client # [ 0.065318] Tracing variant of Tasks RCU enabled. lb # [ 0.064030] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.040507] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.064030] rcu: RCU event tracing is enabled. client # [ 0.065319] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.041010] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6iych1bhd6jkvv72xp98ahp6dmm92z7r-nixos-system-worker1-test/init regInfo=/nix/store/sncm61przda863m2mj9d0pcd8iyhxwx4-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.064031] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.042013] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.065320] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.064033] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.043094] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.041111] Unknown kernel command line parameters "regInfo=/nix/store/sncm61przda863m2mj9d0pcd8iyhxwx4-closure-info/registration", will be passed to user space. client # [ 0.065337] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.064033] Rude variant of Tasks RCU enabled. worker1 # [ 0.041124] random: crng init done worker2 # [ 0.043120] Fallback order for Node 0: 0 lb # [ 0.064034] Tracing variant of Tasks RCU enabled. client # [ 0.065339] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.043123] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.041125] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.043124] Policy zone: DMA32 lb # [ 0.064034] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.043284] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.065340] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.045406] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.064035] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.069708] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.044359] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.048913] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.064049] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.044394] Fallback order for Node 0: 0 worker2 # [ 0.052264] allocated 3145728 bytes of page_ext client # [ 0.069988] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.044397] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.061912] ftrace: allocating 48731 entries in 192 pages lb # [ 0.064051] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.044398] Policy zone: DMA32 client # [ 0.069996] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.061913] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.062747] Dynamic Preempt: lazy worker1 # [ 0.047053] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.064052] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.062878] rcu: Preemptible hierarchical RCU implementation. client # [ 0.070105] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.068438] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.050496] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.073647] Console: colour VGA+ 80x25 worker2 # [ 0.062879] rcu: RCU event tracing is enabled. worker1 # [ 0.053832] allocated 3145728 bytes of page_ext lb # [ 0.068705] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.073650] printk: legacy console [tty0] enabled worker2 # [ 0.062879] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.063840] ftrace: allocating 48731 entries in 192 pages client # [ 0.103019] printk: legacy console [ttyS0] enabled worker2 # [ 0.062881] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.063843] ftrace: allocated 192 pages with 2 groups lb # [ 0.068711] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.064758] Dynamic Preempt: lazy client # [ 0.198894] ACPI: Core revision 20250807 worker2 # [ 0.062881] Rude variant of Tasks RCU enabled. worker2 # [ 0.062881] Tracing variant of Tasks RCU enabled. worker1 # [ 0.064934] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.068814] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.064934] rcu: RCU event tracing is enabled. lb # [ 0.072329] Console: colour VGA+ 80x25 worker2 # [ 0.062882] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.199794] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.072331] printk: legacy console [tty0] enabled worker1 # [ 0.064935] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.062883] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.201305] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.064937] Trampoline variant of Tasks RCU enabled. lb # [ 0.104403] printk: legacy console [ttyS0] enabled worker1 # [ 0.064937] Rude variant of Tasks RCU enabled. client # [ 0.202255] x2apic enabled lb # [ 0.200436] ACPI: Core revision 20250807 worker2 # [ 0.062938] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.064938] Tracing variant of Tasks RCU enabled. client # [ 0.202996] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.062940] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.064938] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.201287] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.062941] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.064939] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.202792] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.067333] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.204780] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.203732] x2apic enabled worker1 # [ 0.064961] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.067612] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.204467] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.064962] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.205736] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.067618] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.064963] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.207345] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.067725] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.069501] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.206251] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.071233] Console: colour VGA+ 80x25 worker1 # [ 0.069795] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.071235] printk: legacy console [tty0] enabled client # [ 0.208431] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.100593] printk: legacy console [ttyS0] enabled lb # [ 0.207221] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.069802] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.209467] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.195523] ACPI: Core revision 20250807 client # [ 0.210343] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.069907] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.208882] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.073821] Console: colour VGA+ 80x25 worker2 # [ 0.196409] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.073824] printk: legacy console [tty0] enabled lb # [ 0.209967] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.105461] printk: legacy console [ttyS0] enabled client # [ 0.211346] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.197960] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.200737] ACPI: Core revision 20250807 worker2 # [ 0.198893] x2apic enabled lb # [ 0.211074] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.212348] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.211881] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.199629] APIC: Switched APIC routing to: physical x2apic client # [ 0.213342] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.201660] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.214342] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.203200] APIC: Switch to symmetric I/O mode setup lb # [ 0.212883] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.201419] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.204130] x2apic enabled client # [ 0.215342] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.214880] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.204891] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.202373] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.215880] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.204082] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.217639] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.206672] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.218566] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.205166] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.216342] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.207613] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.218350] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.206219] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.209197] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.207080] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.219059] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.220343] active return thunk: srso_alias_return_thunk worker1 # [ 0.210280] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.208083] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.218880] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.211337] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.221363] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.220887] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.209080] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.212194] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.222342] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.210080] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.221881] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.223342] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.213198] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.222880] active return thunk: srso_alias_return_thunk worker2 # [ 0.211079] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.224342] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.212080] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.223901] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.214194] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.225342] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.224880] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.215194] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.226342] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.216193] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.226630] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.227342] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.217194] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.227651] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.228342] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.213079] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.228626] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.229342] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.215087] Spectre V2 : Enabling IBPB for BPF lb # [ 0.229610] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.230342] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.215797] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.231342] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.230674] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.217080] active return thunk: srso_alias_return_thunk worker1 # [ 0.218193] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.232342] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.231880] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.220201] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.218100] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.232880] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.233342] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.219079] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.220912] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.233799] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.220079] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.222194] active return thunk: srso_alias_return_thunk lb # [ 0.234583] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.221079] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.223214] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.235619] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.222079] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.224194] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.236607] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.223079] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.225193] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.224079] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.226193] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.225080] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.227193] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.226079] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.228194] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.227079] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.229193] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.228079] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.230194] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.229079] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.231193] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.230079] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.232193] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.233193] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.234193] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.235193] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.268042] Freeing SMP alternatives memory: 44K client # [ 0.268345] pid_max: default: 32768 minimum: 301 client # [ 0.269433] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.270447] landlock: Up and running. client # [ 0.271343] Yama: becoming mindful. lb # [ 0.271322] Freeing SMP alternatives memory: 44K client # [ 0.272143] LSM support for eBPF active lb # [ 0.271883] pid_max: default: 32768 minimum: 301 client # [ 0.272922] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.272967] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.273980] landlock: Up and running. client # [ 0.273382] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.274660] Yama: becoming mindful. lb # [ 0.275528] LSM support for eBPF active client # [ 0.276764] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.276007] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.264019] Freeing SMP alternatives memory: 44K lb # [ 0.276922] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.277954] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.264647] pid_max: default: 32768 minimum: 301 client # [ 0.278351] ... version: 2 worker2 # [ 0.265173] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.279121] ... bit width: 48 worker2 # [ 0.266172] landlock: Up and running. lb # [ 0.280042] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.279344] ... generic counters: 6 worker2 # [ 0.267080] Yama: becoming mindful. client # [ 0.280016] ... generic bitmap: 000000000000003f worker2 # [ 0.268120] LSM support for eBPF active lb # [ 0.281456] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.280344] ... fixed-purpose counters: 0 worker1 # [ 0.270555] Freeing SMP alternatives memory: 44K lb # [ 0.281888] ... version: 2 client # [ 0.281053] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.268865] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.271198] pid_max: default: 32768 minimum: 301 lb # [ 0.282563] ... bit width: 48 client # [ 0.281344] ... value mask: 0000ffffffffffff lb # [ 0.282882] ... generic counters: 6 worker1 # [ 0.272005] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.269968] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.282206] ... max period: 00007fffffffffff worker1 # [ 0.273004] landlock: Up and running. lb # [ 0.283581] ... generic bitmap: 000000000000003f client # [ 0.283030] ... global_ctrl mask: 000000000000003f worker1 # [ 0.273702] Yama: becoming mindful. lb # [ 0.283882] ... fixed-purpose counters: 0 client # [ 0.283458] signal: max sigframe size: 3376 worker1 # [ 0.274418] LSM support for eBPF active lb # [ 0.284588] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.272312] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.284219] rcu: Hierarchical SRCU implementation. lb # [ 0.284882] ... value mask: 0000ffffffffffff worker1 # [ 0.275325] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.284913] rcu: Max phase no-delay instances is 400. worker2 # [ 0.273655] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.285762] ... max period: 00007fffffffffff worker1 # [ 0.276241] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.274088] ... version: 2 lb # [ 0.286526] ... global_ctrl mask: 000000000000003f worker2 # [ 0.274769] ... bit width: 48 lb # [ 0.286978] signal: max sigframe size: 3376 worker2 # [ 0.275082] ... generic counters: 6 lb # [ 0.287788] rcu: Hierarchical SRCU implementation. worker2 # [ 0.275777] ... generic bitmap: 000000000000003f worker1 # [ 0.278924] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.288465] rcu: Max phase no-delay instances is 400. worker2 # [ 0.276082] ... fixed-purpose counters: 0 worker2 # [ 0.276766] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.279794] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.289904] smp: Bringing up secondary CPUs ... worker2 # [ 0.277082] ... value mask: 0000ffffffffffff worker1 # [ 0.280199] ... version: 2 client # [ 0.290359] smp: Brought up 1 node, 1 CPU worker1 # [ 0.280878] ... bit width: 48 worker2 # [ 0.277935] ... max period: 00007fffffffffff worker1 # [ 0.281196] ... generic counters: 6 client # [ 0.291020] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.278740] ... global_ctrl mask: 000000000000003f worker1 # [ 0.281877] ... generic bitmap: 000000000000003f worker2 # [ 0.279191] signal: max sigframe size: 3376 worker1 # [ 0.282208] ... fixed-purpose counters: 0 lb # [ 0.293369] smp: Bringing up secondary CPUs ... worker2 # [ 0.279959] rcu: Hierarchical SRCU implementation. client # [ 0.291536] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109352K reserved, 0K cma-reserved) worker1 # [ 0.282880] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.293897] smp: Brought up 1 node, 1 CPU worker2 # [ 0.280637] rcu: Max phase no-delay instances is 400. client # [ 0.292591] devtmpfs: initialized worker1 # [ 0.283196] ... value mask: 0000ffffffffffff lb # [ 0.294524] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.293377] x86/mm: Memory block size: 128MB worker1 # [ 0.284046] ... max period: 00007fffffffffff worker1 # [ 0.284836] ... global_ctrl mask: 000000000000003f worker1 # [ 0.285312] signal: max sigframe size: 3376 lb # [ 0.295009] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) client # [ 0.295153] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.286078] rcu: Hierarchical SRCU implementation. lb # [ 0.296101] devtmpfs: initialized worker1 # [ 0.286764] rcu: Max phase no-delay instances is 400. lb # [ 0.296976] x86/mm: Memory block size: 128MB client # [ 0.296282] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.285939] smp: Bringing up secondary CPUs ... client # [ 0.297419] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.286639] smp: Brought up 1 node, 1 CPU client # [ 0.298516] PM: RTC time: 10:55:11, date: 2026-09-22 lb # [ 0.298692] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.287083] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.299831] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.288275] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) lb # [ 0.300966] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.291791] smp: Bringing up secondary CPUs ... worker2 # [ 0.289323] devtmpfs: initialized worker1 # [ 0.292210] smp: Brought up 1 node, 1 CPU lb # [ 0.302220] PM: RTC time: 10:55:11, date: 2026-09-22 client # [ 0.302499] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.290107] x86/mm: Memory block size: 128MB worker1 # [ 0.292867] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.303862] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.291895] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.293451] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) client # [ 0.304369] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.305620] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.294468] devtmpfs: initialized worker2 # [ 0.292957] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.305626] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.295271] x86/mm: Memory block size: 128MB worker2 # [ 0.294169] pinctrl core: initialized pinctrl subsystem lb # [ 0.306404] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.306355] audit: initializing netlink subsys (disabled) worker2 # [ 0.295295] PM: RTC time: 10:55:11, date: 2026-09-22 lb # [ 0.306905] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.307535] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.297036] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.307537] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.308491] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.298064] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.308346] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.308893] audit: initializing netlink subsys (disabled) worker1 # [ 0.299273] pinctrl core: initialized pinctrl subsystem client # [ 0.309304] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.298923] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.300301] PM: RTC time: 10:55:11, date: 2026-09-22 lb # [ 0.309985] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.310081] audit: type=2000 audit(1790074512.054:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.300303] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.309987] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.311347] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.310883] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.301104] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.311361] cpuidle: using governor menu lb # [ 0.311801] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.303983] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.302382] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.313618] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.312613] audit: type=2000 audit(1790074512.055:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.303091] audit: initializing netlink subsys (disabled) lb # [ 0.313885] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.305415] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.314597] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.304196] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.313898] cpuidle: using governor menu worker1 # [ 0.306220] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.315348] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.304198] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.316089] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.316356] PCI: Using configuration type 1 for base access worker2 # [ 0.305083] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.307487] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.305983] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.308208] audit: initializing netlink subsys (disabled) lb # [ 0.317146] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.317436] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.306768] audit: type=2000 audit(1790074512.066:1): state=initialized audit_enabled=0 res=1 lb # [ 0.317885] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.309293] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.308085] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.318893] PCI: Using configuration type 1 for base access worker1 # [ 0.309296] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.308100] cpuidle: using governor menu worker1 # [ 0.310197] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.320025] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.311138] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.310294] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.311895] audit: type=2000 audit(1790074512.066:1): state=initialized audit_enabled=0 res=1 client # [ 0.322479] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.311333] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.313198] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.323346] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.312085] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.313211] cpuidle: using governor menu worker2 # [ 0.313095] PCI: Using configuration type 1 for base access worker1 # [ 0.315217] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.325153] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.314148] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.316465] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.325884] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.317199] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.328346] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.318209] PCI: Using configuration type 1 for base access client # [ 0.329345] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.319272] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.319367] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.330884] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.320084] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.331883] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.325083] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.326429] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.326082] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.327197] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.339740] ACPI: Added _OSI(Module Device) client # [ 0.340346] ACPI: Added _OSI(Processor Device) client # [ 0.341116] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.342265] ACPI: Added _OSI(Module Device) worker1 # [ 0.328191] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.342884] ACPI: Added _OSI(Processor Device) worker1 # [ 0.333197] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.343677] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.336478] ACPI: Added _OSI(Module Device) worker2 # [ 0.337084] ACPI: Added _OSI(Processor Device) worker2 # [ 0.337787] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.349651] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.341836] ACPI: Added _OSI(Module Device) worker1 # [ 0.342198] ACPI: Added _OSI(Processor Device) lb # [ 0.353122] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.342900] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.353752] ACPI: Interpreter enabled client # [ 0.354361] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.355169] ACPI: Using IOAPIC for interrupt routing lb # [ 0.356859] ACPI: Interpreter enabled lb # [ 0.357388] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.357883] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.346652] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.358417] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.358739] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.359345] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.349760] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.350487] ACPI: Interpreter enabled client # [ 0.362483] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.351098] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.351783] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.353170] ACPI: Interpreter enabled lb # [ 0.363883] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.353639] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.352143] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.364999] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.354197] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.353082] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.355066] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.356145] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.369725] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.370351] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.360197] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.361244] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.371424] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.372656] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.372470] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.373672] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.373705] PCI host bridge to bus 0000:00 lb # [ 0.374975] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.374349] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.376009] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.375345] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.364803] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.377240] PCI host bridge to bus 0000:00 client # [ 0.376345] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.365088] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.377887] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.377345] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.378883] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.366642] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.378344] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.369836] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.379882] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.367203] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.379350] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.380882] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.368452] PCI host bridge to bus 0000:00 client # [ 0.380345] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.370789] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.369087] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.381882] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.381293] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.371275] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.370082] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.382883] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.372318] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.383883] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.371082] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.382794] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.373572] PCI host bridge to bus 0000:00 worker2 # [ 0.372083] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.384799] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.374200] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.373082] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.375196] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.386297] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.374082] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.376196] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.375082] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.377197] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.376006] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.378196] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.379196] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.377523] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.380197] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.385410] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.381109] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.386357] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.387331] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.382600] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.389063] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.388426] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.389896] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.390869] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.390069] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.392204] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.380166] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.381095] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.393373] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.382044] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.393599] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.394190] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.383035] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.385335] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.395171] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.386208] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.395914] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.396144] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.387122] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.396786] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.384802] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.397607] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.397767] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.388076] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.397888] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.388116] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.399372] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.389955] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.388964] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.399766] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.400219] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.389817] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.401073] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.390088] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.392224] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.401924] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.393043] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.401884] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.402818] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.393913] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.391807] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.403636] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.394202] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.404439] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.404458] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.395112] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.395895] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.405351] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.395930] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.406291] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.396787] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.398224] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.399066] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.407473] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.407738] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.397654] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.407889] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.399909] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.409373] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] lb # [ 0.408905] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.400820] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.410240] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.410467] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.411116] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.400370] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.401706] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.411914] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] client # [ 0.412877] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.403225] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.402104] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.412761] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.404203] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.413598] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.414352] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker1 # [ 0.405144] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.403649] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.415194] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.416118] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.414416] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.406544] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.405830] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] client # [ 0.417784] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.406089] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.416890] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker1 # [ 0.408225] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker2 # [ 0.407038] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.417810] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.409134] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.418629] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.409926] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.420372] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.408477] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.419484] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.421353] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.410747] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.422320] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.411879] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker1 # [ 0.412231] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] lb # [ 0.421844] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.412695] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.423797] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.413075] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.413104] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.422532] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.413970] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.425383] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] lb # [ 0.423659] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.426237] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.414667] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.415605] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.427060] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.425336] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.427350] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.426920] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker1 # [ 0.418189] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.417115] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.427805] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.428933] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.418089] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.419028] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.428630] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.419023] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.420218] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.431191] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.428889] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.432068] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.420477] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.421798] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.430398] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.432907] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.423204] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker2 # [ 0.422832] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] lb # [ 0.431654] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.424049] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.423089] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.434353] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] lb # [ 0.431905] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.424915] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.435186] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.424025] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.425202] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.424905] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.433447] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.436078] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.426679] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.434890] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] client # [ 0.436940] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.426978] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.435709] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.428072] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.438373] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] lb # [ 0.436626] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.428930] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.429095] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.439213] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.430034] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.429748] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.440128] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.438691] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.431460] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.441782] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.431205] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] lb # [ 0.440917] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker1 # [ 0.432036] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.441794] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.442920] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.433121] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker1 # [ 0.432923] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.442628] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.433968] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.443542] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.443434] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.435104] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.433765] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.445908] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] lb # [ 0.444407] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.436639] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.436224] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker1 # [ 0.437067] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.445079] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.437923] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.438089] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] lb # [ 0.446441] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.438922] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.438760] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.439810] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.439797] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.440670] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.440397] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.442553] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker1 # [ 0.442245] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.443282] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.446547] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.444772] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] client # [ 0.448893] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] client # [ 0.449616] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.450879] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.447082] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.449451] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] client # [ 0.451862] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.450115] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.452678] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.451389] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.453609] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.443305] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.455165] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] lb # [ 0.452488] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.445745] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] client # [ 0.455998] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.453168] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.445280] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.446434] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.456663] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.454128] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.447842] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker1 # [ 0.447705] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.457902] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.455690] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker2 # [ 0.448331] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.448466] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.456521] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.449749] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.449483] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.457198] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.461324] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.450448] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.450355] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.458428] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.462178] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.452021] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker2 # [ 0.451397] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.463201] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.452819] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.464172] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.452340] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.465191] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.453520] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.462098] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.466200] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.454133] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker1 # [ 0.454786] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.463004] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.467182] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.454992] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.463999] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.468328] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.464979] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.469227] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.456143] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.465979] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.470094] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.458495] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.466999] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.458884] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.470359] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.459303] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.471297] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.467983] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.460298] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.472108] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.468999] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.461292] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.472357] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.469921] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.462297] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.473312] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.462735] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.470898] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.474056] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.463295] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.463187] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.471846] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.464295] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.464185] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.472623] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.475479] iommu: Default domain type: Translated worker1 # [ 0.465293] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.465195] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.472898] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.476270] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.466229] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.473842] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.466182] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.477395] ACPI: bus type USB registered worker1 # [ 0.467215] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.474637] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.467184] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.478156] usbcore: registered new interface driver usbfs worker1 # [ 0.468202] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.474901] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.468192] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.479042] usbcore: registered new interface driver hub worker1 # [ 0.469163] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.479364] usbcore: registered new device driver usb worker2 # [ 0.469188] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.469934] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.476868] iommu: Default domain type: Translated worker1 # [ 0.470212] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.470118] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.477479] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.481032] NetLabel: Initializing client # [ 0.481346] NetLabel: domain hash size = 128 worker1 # [ 0.471145] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.471094] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.478135] ACPI: bus type USB registered client # [ 0.482046] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.472045] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.471913] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.478868] usbcore: registered new interface driver usbfs client # [ 0.482395] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.472806] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.479559] usbcore: registered new interface driver hub client # [ 0.483253] PCI: Using ACPI for IRQ routing lb # [ 0.479899] usbcore: registered new device driver usb worker2 # [ 0.473097] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.473305] iommu: Default domain type: Translated worker2 # [ 0.474036] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.474076] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.481562] NetLabel: Initializing worker1 # [ 0.475231] ACPI: bus type USB registered lb # [ 0.481884] NetLabel: domain hash size = 128 worker2 # [ 0.474854] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.475956] usbcore: registered new interface driver usbfs lb # [ 0.482584] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.476020] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.476214] usbcore: registered new interface driver hub lb # [ 0.482965] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.477068] usbcore: registered new device driver usb lb # [ 0.483870] PCI: Using ACPI for IRQ routing worker2 # [ 0.477947] iommu: Default domain type: Translated worker1 # [ 0.478677] NetLabel: Initializing worker2 # [ 0.478699] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.479197] NetLabel: domain hash size = 128 worker2 # [ 0.479362] ACPI: bus type USB registered worker1 # [ 0.479922] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.480130] usbcore: registered new interface driver usbfs worker1 # [ 0.480260] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.481238] usbcore: registered new interface driver hub worker1 # [ 0.481130] PCI: Using ACPI for IRQ routing worker2 # [ 0.482093] usbcore: registered new device driver usb worker2 # [ 0.483893] NetLabel: Initializing worker2 # [ 0.484652] NetLabel: domain hash size = 128 worker2 # [ 0.485082] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.486115] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.487094] PCI: Using ACPI for IRQ routing client # [ 0.527389] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.528341] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.528341] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.528351] vgaarb: loaded client # [ 0.529104] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.529346] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.528263] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.528879] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.528879] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.528888] vgaarb: loaded worker1 # [ 0.525338] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.529631] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.526192] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.534434] clocksource: Switched to clocksource kvm-clock lb # [ 0.529884] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.526192] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.526200] vgaarb: loaded worker1 # [ 0.526940] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.537992] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.527198] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.532971] clocksource: Switched to clocksource kvm-clock client # [ 0.538763] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.540164] pnp: PnP ACPI init worker2 # [ 0.532054] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.540996] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.532078] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.531284] clocksource: Switched to clocksource kvm-clock lb # [ 0.536546] VFS: Disk quotas dquot_6.6.0 client # [ 0.542004] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.532078] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.532086] vgaarb: loaded lb # [ 0.537279] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.543540] pnp: PnP ACPI: found 6 devices worker1 # [ 0.533127] VFS: Disk quotas dquot_6.6.0 lb # [ 0.538598] pnp: PnP ACPI init worker2 # [ 0.532791] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.539420] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.533082] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.535648] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.540434] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.537189] pnp: PnP ACPI init lb # [ 0.541989] pnp: PnP ACPI: found 6 devices worker1 # [ 0.538046] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.539144] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.537172] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.540770] pnp: PnP ACPI: found 6 devices client # [ 0.551125] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.552678] clocksource: Switched to clocksource acpi_pm client # [ 0.553748] NET: Registered PF_INET protocol family worker2 # [ 0.541017] VFS: Disk quotas dquot_6.6.0 client # [ 0.554940] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.541812] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.549615] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.543148] pnp: PnP ACPI init lb # [ 0.551099] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.543984] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.552121] NET: Registered PF_INET protocol family worker2 # [ 0.544993] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.553361] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.548427] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.546615] pnp: PnP ACPI: found 6 devices worker1 # [ 0.549936] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.550974] NET: Registered PF_INET protocol family worker1 # [ 0.552190] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.554210] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.555734] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.556736] NET: Registered PF_INET protocol family worker2 # [ 0.557963] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.571575] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.573086] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.574514] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.575908] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.570310] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.577179] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.571762] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.578284] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.573077] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.579575] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.574424] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.580663] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.569668] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.575631] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.581834] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.571267] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.582783] NET: Registered PF_XDP protocol family lb # [ 0.576710] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.572564] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.583614] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.577931] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.584621] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.573889] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.579000] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.585671] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.575100] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.580206] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.586758] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.581137] NET: Registered PF_XDP protocol family worker1 # [ 0.576281] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.587835] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.582012] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.574443] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.577614] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.583028] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.588891] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.578727] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.575951] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.584047] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.590613] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.579919] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.577222] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.585136] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.580847] NET: Registered PF_XDP protocol family worker2 # [ 0.578526] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.586234] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.581686] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.592779] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.579747] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.582661] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.587385] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.580823] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.583639] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.589044] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.595062] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.584708] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.582066] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.585770] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.583158] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.597031] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.591659] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.586846] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.584381] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.585314] NET: Registered PF_XDP protocol family client # [ 0.598879] PCI: CLS 0 bytes, default 64 worker1 # [ 0.588554] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.593617] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.586193] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.599802] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.587203] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.595506] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.590790] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.601553] Trying to unpack rootfs image as initramfs... worker2 # [ 0.588216] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.597144] PCI: CLS 0 bytes, default 64 worker2 # [ 0.589302] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.593016] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.590481] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.598080] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.591606] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.595049] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.599898] Trying to unpack rootfs image as initramfs... worker2 # [ 0.593298] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.596841] PCI: CLS 0 bytes, default 64 worker1 # [ 0.597846] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.596019] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.599610] Trying to unpack rootfs image as initramfs... worker2 # [ 0.597977] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.599972] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.601737] PCI: CLS 0 bytes, default 64 worker2 # [ 0.602634] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.604412] Trying to unpack rootfs image as initramfs... client # [ 0.648790] Initialise system trusted keyrings client # [ 0.649760] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.644600] Initialise system trusted keyrings lb # [ 0.645533] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.644864] Initialise system trusted keyrings worker1 # [ 0.645855] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.650613] Initialise system trusted keyrings worker2 # [ 0.653528] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.673403] Key type asymmetric registered client # [ 0.674090] Asymmetric key parser 'x509' registered lb # [ 0.669260] Key type asymmetric registered client # [ 0.674933] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.669970] Asymmetric key parser 'x509' registered lb # [ 0.670858] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.677544] io scheduler mq-deadline registered client # [ 0.678264] io scheduler kyber registered worker1 # [ 0.667784] Key type asymmetric registered worker1 # [ 0.670433] Asymmetric key parser 'x509' registered client # [ 0.680959] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.675319] io scheduler mq-deadline registered lb # [ 0.676073] io scheduler kyber registered worker1 # [ 0.671246] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.682183] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.674548] io scheduler mq-deadline registered worker1 # [ 0.675329] io scheduler kyber registered lb # [ 0.680347] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.687523] Linux agpgart interface v0.103 lb # [ 0.681645] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.688236] ACPI: bus type drm_connector registered worker2 # [ 0.675822] Key type asymmetric registered worker2 # [ 0.676562] Asymmetric key parser 'x509' registered worker1 # [ 0.679593] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.677365] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.691557] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.680853] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.692611] usbserial: USB Serial support registered for generic lb # [ 0.686989] Linux agpgart interface v0.103 lb # [ 0.687766] ACPI: bus type drm_connector registered worker2 # [ 0.680619] io scheduler mq-deadline registered worker2 # [ 0.681351] io scheduler kyber registered client # [ 0.695391] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.686181] Linux agpgart interface v0.103 client # [ 0.695391] Please enable it if your BIOS has the CPPC option. lb # [ 0.690663] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.686923] ACPI: bus type drm_connector registered lb # [ 0.691706] usbserial: USB Serial support registered for generic worker2 # [ 0.684231] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.697579] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.700535] drop_monitor: Initializing network drop monitor service worker1 # [ 0.689915] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.687490] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.701713] NET: Registered PF_INET6 protocol family worker1 # [ 0.690967] usbserial: USB Serial support registered for generic lb # [ 0.695198] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.695198] Please enable it if your BIOS has the CPPC option. lb # [ 0.697490] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.691147] Linux agpgart interface v0.103 worker2 # [ 0.691906] ACPI: bus type drm_connector registered worker1 # [ 0.694428] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.706523] Segment Routing with IPv6 worker1 # [ 0.694428] Please enable it if your BIOS has the CPPC option. client # [ 0.707199] In-situ OAM (IOAM) with IPv6 lb # [ 0.701353] drop_monitor: Initializing network drop monitor service worker1 # [ 0.696691] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.702536] NET: Registered PF_INET6 protocol family worker2 # [ 0.694909] usbcore: registered new interface driver usbserial_generic client # [ 0.709536] IPI shorthand broadcast: enabled worker2 # [ 0.695948] usbserial: USB Serial support registered for generic lb # [ 0.705632] Segment Routing with IPv6 worker1 # [ 0.700542] drop_monitor: Initializing network drop monitor service worker1 # [ 0.701769] NET: Registered PF_INET6 protocol family worker2 # [ 0.699492] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.708210] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.699492] Please enable it if your BIOS has the CPPC option. lb # [ 0.709262] IPI shorthand broadcast: enabled worker2 # [ 0.701622] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.704902] Segment Routing with IPv6 worker1 # [ 0.707444] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.704625] drop_monitor: Initializing network drop monitor service client # [ 0.717805] sched_clock: Marking stable (584016184, 133345863)->(789328523, -71966476) worker1 # [ 0.708465] IPI shorthand broadcast: enabled worker2 # [ 0.705760] NET: Registered PF_INET6 protocol family worker2 # [ 0.708925] Segment Routing with IPv6 client # [ 0.722461] registered taskstats version 1 client # [ 0.723403] Loading compiled-in X.509 certificates lb # [ 0.717470] sched_clock: Marking stable (581013862, 136167899)->(793261873, -76080112) worker2 # [ 0.711506] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.712516] IPI shorthand broadcast: enabled worker1 # [ 0.716730] sched_clock: Marking stable (581015811, 135391303)->(786242759, -69835645) lb # [ 0.722436] registered taskstats version 1 lb # [ 0.723414] Loading compiled-in X.509 certificates worker1 # [ 0.720637] registered taskstats version 1 worker1 # [ 0.721592] Loading compiled-in X.509 certificates worker2 # [ 0.720620] sched_clock: Marking stable (588014037, 132460758)->(790977715, -70502920) worker2 # [ 0.725711] registered taskstats version 1 client # [ 0.739882] Demotion targets for Node 0: null worker2 # [ 0.726632] Loading compiled-in X.509 certificates client # [ 0.743412] Key type .fscrypt registered client # [ 0.744117] Key type fscrypt-provisioning registered client # [ 0.745093] ima: No TPM chip found, activating TPM-bypass! client # [ 0.747381] ima: Allocated hash algorithm: sha1 lb # [ 0.742205] Demotion targets for Node 0: null client # [ 0.748189] ima: No architecture policies found lb # [ 0.743082] Key type .fscrypt registered lb # [ 0.743806] Key type fscrypt-provisioning registered worker1 # [ 0.739421] Demotion targets for Node 0: null client # [ 0.750373] PM: Magic number: 10:622:932 client # [ 0.752058] RAS: Correctable Errors collector initialized. lb # [ 0.746306] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.742462] Key type .fscrypt registered lb # [ 0.747222] ima: Allocated hash algorithm: sha1 worker1 # [ 0.743145] Key type fscrypt-provisioning registered lb # [ 0.748034] ima: No architecture policies found worker1 # [ 0.744104] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.743031] Demotion targets for Node 0: null worker1 # [ 0.746426] ima: Allocated hash algorithm: sha1 worker1 # [ 0.747238] ima: No architecture policies found lb # [ 0.752447] PM: Magic number: 10:622:932 worker2 # [ 0.745530] Key type .fscrypt registered worker2 # [ 0.746177] Key type fscrypt-provisioning registered lb # [ 0.754080] RAS: Correctable Errors collector initialized. worker2 # [ 0.747083] ima: No TPM chip found, activating TPM-bypass! client # [ 0.762087] clk: Disabling unused clocks worker1 # [ 0.751422] PM: Magic number: 10:622:932 worker2 # [ 0.749499] ima: Allocated hash algorithm: sha1 worker2 # [ 0.750263] ima: No architecture policies found worker1 # [ 0.753098] RAS: Correctable Errors collector initialized. client # [ 0.766388] PM: genpd: Disabling unused power domains lb # [ 0.761881] clk: Disabling unused clocks worker2 # [ 0.754489] PM: Magic number: 10:622:932 worker2 # [ 0.756033] RAS: Correctable Errors collector initialized. lb # [ 0.764198] PM: genpd: Disabling unused power domains worker1 # [ 0.765097] clk: Disabling unused clocks worker1 # [ 0.765908] PM: genpd: Disabling unused power domains worker2 # [ 0.764129] clk: Disabling unused clocks worker2 # [ 0.766493] PM: genpd: Disabling unused power domains client # [ 0.934933] Freeing initrd memory: 29096K lb # [ 0.929503] Freeing initrd memory: 29092K client # [ 0.938219] Freeing unused decrypted memory: 2028K lb # [ 0.932657] Freeing unused decrypted memory: 2028K client # [ 0.940930] Freeing unused kernel image (initmem) memory: 3644K lb # [ 0.935291] Freeing unused kernel image (initmem) memory: 3644K client # [ 0.942027] Write protecting the kernel read-only data: 32768k lb # [ 0.936373] Write protecting the kernel read-only data: 32768k client # [ 0.943925] Freeing unused kernel image (text/rodata gap) memory: 1208K lb # [ 0.938257] Freeing unused kernel image (text/rodata gap) memory: 1208K worker2 # [ 0.931211] Freeing initrd memory: 29092K client # [ 0.945501] Freeing unused kernel image (rodata/data gap) memory: 752K lb # [ 0.939748] Freeing unused kernel image (rodata/data gap) memory: 752K worker2 # [ 0.934307] Freeing unused decrypted memory: 2028K worker2 # [ 0.936814] Freeing unused kernel image (initmem) memory: 3644K worker2 # [ 0.937857] Write protecting the kernel read-only data: 32768k worker2 # [ 0.939697] Freeing unused kernel image (text/rodata gap) memory: 1208K worker2 # [ 0.941134] Freeing unused kernel image (rodata/data gap) memory: 752K worker1 # [ 0.975078] Freeing initrd memory: 29092K worker1 # [ 0.978338] Freeing unused decrypted memory: 2028K worker1 # [ 0.981119] Freeing unused kernel image (initmem) memory: 3644K worker1 # [ 0.982274] Write protecting the kernel read-only data: 32768k worker1 # [ 0.984213] Freeing unused kernel image (text/rodata gap) memory: 1208K worker1 # [ 0.985774] Freeing unused kernel image (rodata/data gap) memory: 752K client # [ 0.996667] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.990947] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.997704] Run /init as init process lb # [ 0.991987] Run /init as init process worker2 # [ 0.992366] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.993413] Run /init as init process client # [ 1.007962] systemd[1]: Inserted module 'autofs4' lb # [ 1.002133] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.004107] systemd[1]: Inserted module 'autofs4' client # [ 1.024248] fuse: init (API version 7.45) lb # [ 1.018489] fuse: init (API version 7.45) client # [ 1.030006] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.024318] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.032456] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.026865] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.020352] fuse: init (API version 7.45) client # [ 1.035220] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.030704] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.037482] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.033233] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.026130] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.028842] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.031957] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.034401] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.036925] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.038053] Run /init as init process worker1 # [ 1.048685] systemd[1]: Inserted module 'autofs4' client # [ 1.064159] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.061001] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.065114] fuse: init (API version 7.45) worker2 # [ 1.062352] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.070891] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.073369] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.076341] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.078649] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.105224] systemd[1]: Successfully made /usr/ read-only. client # [ 1.399718] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.404457] systemd[1]: Detected virtualization kvm. client # [ 1.405257] systemd[1]: Detected architecture x86-64. client # [ 1.406092] systemd[1]: Running in initrd. client # [ 1.407162] systemd[1]: Initializing machine ID from random generator. lb # [ 1.396753] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.408283] systemd[1]: Hostname set to . lb # [ 1.402674] systemd[1]: Detected virtualization kvm. lb # [ 1.403750] systemd[1]: Detected architecture x86-64. lb # [ 1.404859] systemd[1]: Running in initrd. lb # [ 1.406292] systemd[1]: Initializing machine ID from random generator. lb # [ 1.407741] systemd[1]: Hostname set to . worker2 # [ 1.397841] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.402758] systemd[1]: Detected virtualization kvm. worker2 # [ 1.403624] systemd[1]: Detected architecture x86-64. worker2 # [ 1.404430] systemd[1]: Running in initrd. worker2 # [ 1.405546] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.406738] systemd[1]: Hostname set to . worker1 # [ 1.441718] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.453838] systemd[1]: Detected virtualization kvm. worker1 # [ 1.455920] systemd[1]: Detected architecture x86-64. worker1 # [ 1.458041] systemd[1]: Running in initrd. worker1 # [ 1.460651] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.463584] systemd[1]: Hostname set to . worker2 # [ 1.594628] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.611089] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.624514] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.632593] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.635770] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.636911] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.638260] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.639296] systemd[1]: Reached target Path Units. worker2 # [ 1.640132] systemd[1]: Reached target Slice Units. worker2 # [ 1.640973] systemd[1]: Reached target Swaps. worker2 # [ 1.641748] systemd[1]: Reached target Timer Units. worker2 # [ 1.642683] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.643836] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.644993] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.646057] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.647048] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.647985] systemd[1]: Reached target Socket Units. worker2 # [ 1.649786] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.664144] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.653301] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.668682] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.669879] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.671312] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.672479] systemd[1]: Reached target Path Units. client # [ 1.673328] systemd[1]: Reached target Slice Units. worker2 # [ 1.660154] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.674239] systemd[1]: Reached target Swaps. client # [ 1.675033] systemd[1]: Reached target Timer Units. client # [ 1.676024] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.677262] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.678454] systemd[1]: Listening on Journal Sockets. lb # [ 1.672289] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.679420] systemd[1]: Listening on udev Control Socket. client # [ 1.680454] systemd[1]: Listening on udev Kernel Socket. client # [ 1.681439] systemd[1]: Reached target Socket Units. lb # [ 1.675513] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.676734] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.683178] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.678133] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.679281] systemd[1]: Reached target Path Units. lb # [ 1.680144] systemd[1]: Reached target Slice Units. lb # [ 1.681043] systemd[1]: Reached target Swaps. client # [ 1.687432] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.681854] systemd[1]: Reached target Timer Units. lb # [ 1.682799] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.675693] systemd[1]: Starting Journal Service... lb # [ 1.684079] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.685262] systemd[1]: Listening on Journal Sockets. lb # [ 1.686305] systemd[1]: Listening on udev Control Socket. lb # [ 1.687395] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.688386] systemd[1]: Reached target Socket Units. client # [ 1.695465] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.690228] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.685253] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.694005] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.689580] systemd[1]: Starting Load Kernel Modules... lb # [ 1.700748] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.709684] systemd[1]: Starting Journal Service... client # [ 1.718627] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.694545] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.714367] systemd[1]: Starting Journal Service... worker2 # [ 1.710390] netfs: FS-Cache loaded worker2 # [ 1.715081] 9pnet: Installing 9P2000 support lb # [ 1.728268] systemd[1]: Starting Load Kernel Modules... client # [ 1.726441] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.727576] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.743810] netfs: FS-Cache loaded client # [ 1.748464] 9pnet: Installing 9P2000 support worker1 # [ 1.739628] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.735260] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.743738] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.742624] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.744959] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.751497] netfs: FS-Cache loaded worker1 # [ 1.746445] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.747582] systemd[1]: Reached target Path Units. worker1 # [ 1.748527] systemd[1]: Reached target Slice Units. worker1 # [ 1.749490] systemd[1]: Reached target Swaps. client # [ 1.760563] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.750324] systemd[1]: Reached target Timer Units. lb # [ 1.756247] 9pnet: Installing 9P2000 support worker1 # [ 1.751308] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.752574] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.750176] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.753765] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.754807] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.755896] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.756875] systemd[1]: Reached target Socket Units. worker1 # [ 1.758687] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.764967] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.757925] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.762480] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.774033] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.762926] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.778964] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.765803] systemd-journald[67]: Collecting audit messages is disabled. worker1 # [ 1.771608] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.770895] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.787424] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.782268] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.775992] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.792325] systemd-journald[67]: Collecting audit messages is disabled. worker2 # [ 1.779398] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.793923] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.788012] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.788489] systemd[1]: Starting Journal Service... worker2 # [ 1.787705] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.801755] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.797127] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.790678] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.805854] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.808286] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.805728] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.802488] systemd[1]: Starting Load Kernel Modules... lb # [ 1.809518] systemd-journald[67]: Collecting audit messages is disabled. client # [ 1.815234] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.812675] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.819450] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.818729] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.808468] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.824793] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.823365] netfs: FS-Cache loaded worker2 # [ 1.820739] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.828160] 9pnet: Installing 9P2000 support lb # [ 1.833377] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.836279] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.829702] systemd[1]: Starting Apply Kernel Variables... client # [ 1.845044] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.837217] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.839643] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.853598] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.852546] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.850911] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.857180] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.864695] systemd[1]: Finished Load Kernel Modules. client # [ 1.871712] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.863852] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.872383] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.870072] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.873913] systemd-journald[67]: Collecting audit messages is disabled. client # [ 1.885463] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.873105] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.876774] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.882327] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.894457] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.882904] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.883494] systemd[1]: Started Journal Service. lb # [ 1.891641] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.887998] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.754210] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.756460] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.758271] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.894471] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.760325] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.907480] systemd[1]: Started Journal Service. worker2 # [ 1.762359] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.897576] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.772732] systemd-modules-load[68]: Inserted module 'dm_mod' client # [ 1.776949] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.765215] systemd[1]: Reached target Local File Systems. client # [ 1.778302] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.768067] systemd[1]: Starting Create System Files and Directories... lb # [ 1.911253] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.773066] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.792126] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.793079] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.795069] systemd[1]: Reached target Local File Systems. client # [ 1.796659] systemd[1]: Starting Create System Files and Directories... lb # [ 1.925730] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.792682] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.931363] systemd[1]: Started Journal Service. lb # lb # [ 1.796281] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.805070] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.797370] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.929934] systemd[1]: Finished Load Kernel Modules. lb # [ 1.799255] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.801347] systemd[1]: Reached target Local File Systems. worker1 # [ 1.935598] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.806064] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.805242] systemd[1]: Finished Create System Files and Directories. lb # [ 1.811136] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.946004] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.828546] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.957024] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.830428] systemd-udevd[78]: Using default interface naming scheme 'v261'. lb # [ 1.840527] systemd[1]: Finished Create System Files and Directories. client # [ 1.854464] systemd-udevd[83]: Using default interface naming scheme 'v261'. worker1 # [ 1.980089] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.855122] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.857301] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.993879] systemd[1]: Started Journal Service. worker1 # lb # [ 1.864177] systemd-udevd[77]: Using default interface naming scheme 'v261'. worker1 # [ 1.860383] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.862496] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.881371] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.870077] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.875067] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.877086] systemd[1]: Reached target Local File Systems. worker1 # [ 1.880072] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.885075] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.891323] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.903068] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.905424] systemd[1]: Reached target System Initialization. worker2 # [ 1.906265] systemd[1]: Reached target Basic System. client # [ 1.924723] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.914462] systemd[1]: Finished Create System Files and Directories. client # [ 1.927761] systemd[1]: Reached target System Initialization. client # [ 1.928641] systemd[1]: Reached target Basic System. lb # [ 1.936113] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.934147] systemd-udevd[83]: Using default interface naming scheme 'v261'. lb # [ 1.938421] systemd[1]: Reached target System Initialization. lb # [ 1.939280] systemd[1]: Reached target Basic System. worker1 # [ 1.958569] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.019755] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.020679] systemd[1]: Reached target System Initialization. worker1 # [ 2.022149] systemd[1]: Reached target Basic System. worker2 # [ 2.225867] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.240168] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.231259] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 2.247654] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.250039] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.253175] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.254485] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.269159] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.264465] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 2.262366] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.276032] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.270392] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.284056] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.271146] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.272876] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.280893] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.280568] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.288439] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.281425] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.282563] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.297941] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.284810] usb usb1: Product: EHCI Host Controller client # [ 2.298743] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.286494] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd lb # [ 2.294191] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.287218] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.290000] hub 1-0:1.0: USB hub found client # [ 2.303147] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.291500] hub 1-0:1.0: 6 ports detected lb # [ 2.302885] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.309404] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.303758] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.305519] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.312317] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.299440] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.300198] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.314806] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.317365] usb usb1: Product: EHCI Host Controller client # [ 2.318030] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd lb # [ 2.313203] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.320324] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.321547] hub 1-0:1.0: USB hub found lb # [ 2.315503] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.316639] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.322986] hub 1-0:1.0: 6 ports detected worker2 # [ 2.311610] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.319553] usb usb1: Product: EHCI Host Controller client # [ 2.325439] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.312373] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.326129] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.321140] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd lb # [ 2.322891] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.324707] hub 1-0:1.0: USB hub found lb # [ 2.327206] hub 1-0:1.0: 6 ports detected client # [ 2.333406] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.334227] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 lb # [ 2.332221] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.332962] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.329254] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.330373] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.343820] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.344949] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.343029] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.344132] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 lb # [ 2.349268] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.350398] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.348322] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.346225] usb usb2: Product: UHCI Host Controller client # [ 2.361738] usb usb2: Product: UHCI Host Controller worker1 # [ 2.351709] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 2.349529] SCSI subsystem initialized worker2 # [ 2.219250] systemd[1]: Starting Virtual Console Setup... client # [ 2.367996] SCSI subsystem initialized worker2 # [ 2.354648] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.370717] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.227671] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.368019] usb usb2: Product: UHCI Host Controller lb # [ 2.369203] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.369963] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.378189] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.383088] hub 2-0:1.0: USB hub found worker1 # [ 2.372230] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.375143] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.375848] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.387020] hub 2-0:1.0: 2 ports detected client # [ 2.254558] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.374748] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.382612] hub 2-0:1.0: USB hub found lb # [ 2.387841] SCSI subsystem initialized worker1 # [ 2.384078] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.389649] hub 2-0:1.0: 2 ports detected worker1 # [ 2.384828] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.386622] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.263836] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.257374] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.254990] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.256684] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.393587] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.258236] (udev-worker)[89]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.264116] systemd[1]: Starting Virtual Console Setup... client # [ 2.272857] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.260667] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.396117] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.397218] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.398196] usb usb1: Product: EHCI Host Controller client # [ 2.408628] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.277225] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.398102] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.401671] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker2 # [ 2.400136] hub 2-0:1.0: USB hub found worker1 # [ 2.404413] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.405304] hub 1-0:1.0: USB hub found worker2 # [ 2.403480] hub 2-0:1.0: 2 ports detected lb # [ 2.410953] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.409498] hub 1-0:1.0: 6 ports detected client # [ 2.423171] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.424041] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.413835] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.414678] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.298603] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.421936] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.424346] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker2 # [ 2.423501] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.426440] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.304492] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.424220] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.427580] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.434068] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.427557] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.434864] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.428331] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 lb # [ 2.301386] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.304073] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.433567] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.437263] SCSI subsystem initialized worker2 # [ 2.434704] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.305843] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.308326] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.305141] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.306759] systemd[1]: Reached target Initrd Root Device. client # [ 2.454389] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.443783] usb usb2: Product: UHCI Host Controller client # [ 2.455174] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker2 # [ 2.311067] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.445486] usb usb3: Product: UHCI Host Controller worker2 # [ 2.446157] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.455257] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.450684] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.461423] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.462572] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.452509] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.457999] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.463421] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 client # [ 2.337076] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.457565] hub 3-0:1.0: USB hub found client # [ 2.337908] systemd[1]: Reached target Initrd Root Device. client # [ 2.472371] usb usb3: Product: UHCI Host Controller worker2 # [ 2.459487] hub 3-0:1.0: 2 ports detected client # [ 2.473042] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.341161] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.469112] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.464364] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.467497] hub 2-0:1.0: USB hub found worker2 # [ 2.466594] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.480380] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.481858] hub 3-0:1.0: USB hub found worker1 # [ 2.471431] hub 2-0:1.0: 2 ports detected client # [ 2.482618] hub 3-0:1.0: 2 ports detected lb # [ 2.476262] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.472499] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.343835] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.473257] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 lb # [ 2.347074] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.344082] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.348243] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.485707] usb usb3: Product: UHCI Host Controller client # [ 2.492489] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.487320] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.493184] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.347944] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.482894] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.487102] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.484589] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.492632] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.487839] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.485729] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.499731] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.494122] hub 3-0:1.0: USB hub found worker2 # [ 2.488644] usb usb4: Product: UHCI Host Controller worker2 # [ 2.489330] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.356746] systemd[1]: Starting Virtual Console Setup... lb # [ 2.498228] hub 3-0:1.0: 2 ports detected worker2 # [ 2.492545] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.493966] hub 4-0:1.0: USB hub found client # [ 2.374575] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.495077] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.509545] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker1 # [ 2.363968] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.497382] hub 4-0:1.0: 2 ports detected lb # [ 2.506483] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.500731] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.380859] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.517313] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.370692] (udev-worker)[89]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.512244] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.519114] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.373686] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.521023] usb usb4: Product: UHCI Host Controller lb # [ 2.515300] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.508439] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.523928] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.518270] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 client # [ 2.524748] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.529268] hub 4-0:1.0: USB hub found client # [ 2.531285] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.532803] hub 4-0:1.0: 2 ports detected lb # [ 2.390451] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.520511] scsi host0: ahci client # [ 2.535756] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.522990] scsi host1: ahci client # [ 2.536718] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.395820] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.533104] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.393274] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.527753] scsi host2: ahci worker2 # [ 2.528500] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.536911] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.398594] systemd[1]: Finished Virtual Console Setup. lb # [ 2.538939] usb usb4: Product: UHCI Host Controller lb # [ 2.540496] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.534551] scsi host3: ahci lb # [ 2.542725] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.537779] scsi host4: ahci lb # [ 2.546626] hub 4-0:1.0: USB hub found lb # [ 2.547658] hub 4-0:1.0: 2 ports detected worker2 # [ 2.540525] scsi host5: ahci worker1 # [ 2.544101] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.541128] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 client # [ 2.558146] scsi host0: ahci worker2 # [ 2.544551] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker1 # [ 2.548962] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 lb # [ 2.553633] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.546377] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 client # [ 2.561494] scsi host1: ahci worker2 # [ 2.547579] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker2 # [ 2.548738] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker1 # [ 2.552289] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.563386] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.549883] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker1 # [ 2.556165] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.557373] usb usb3: Product: UHCI Host Controller client # [ 2.568962] scsi host2: ahci worker1 # [ 2.559414] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.564308] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.560192] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.571700] scsi host3: ahci lb # [ 2.565462] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.564069] hub 3-0:1.0: USB hub found client # [ 2.575430] scsi host4: ahci client # [ 2.577221] scsi host5: ahci worker1 # [ 2.566673] hub 3-0:1.0: 2 ports detected lb # [ 2.571258] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.578247] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 client # [ 2.579970] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 client # [ 2.581168] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker1 # [ 2.435725] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.582327] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker1 # [ 2.437172] systemd[1]: Reached target Initrd Root Device. client # [ 2.583522] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 client # [ 2.584703] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 lb # [ 2.582315] scsi host0: ahci worker1 # [ 2.442085] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.579439] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.580195] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.585727] scsi host1: ahci worker1 # [ 2.583638] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.590133] scsi host2: ahci lb # [ 2.594511] scsi host3: ahci worker1 # [ 2.591747] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 lb # [ 2.599226] scsi host4: ahci lb # [ 2.601644] scsi host5: ahci worker1 # [ 2.597609] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.602907] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 2.598817] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.604303] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 lb # [ 2.605518] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 lb # [ 2.606733] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 lb # [ 2.607900] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 lb # [ 2.609088] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker1 # [ 2.604690] usb usb4: Product: UHCI Host Controller worker1 # [ 2.607431] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.608244] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.609845] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.476060] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.613042] hub 4-0:1.0: USB hub found worker1 # [ 2.615753] hub 4-0:1.0: 2 ports detected worker1 # [ 2.481902] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.619207] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.620106] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.637486] scsi host0: ahci worker1 # [ 2.639490] scsi host1: ahci worker1 # [ 2.640772] scsi host2: ahci worker1 # [ 2.642470] scsi host3: ahci worker1 # [ 2.643749] scsi host4: ahci worker1 # [ 2.645425] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.651033] scsi host5: ahci worker1 # [ 2.654574] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 2.660731] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker2 # [ 2.658423] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.659567] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.660837] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.661551] usb 1-1: Manufacturer: QEMU worker2 # [ 2.662100] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.664738] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker1 # [ 2.665899] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker1 # [ 2.667980] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker1 # [ 2.669272] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker2 # [ 2.674083] hid: raw HID events driver (C) Jiri Kosina client # [ 2.692576] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.693717] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.695071] usb 1-1: Product: QEMU USB Tablet client # [ 2.695796] usb 1-1: Manufacturer: QEMU client # [ 2.696428] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.695304] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.696428] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.697677] usb 1-1: Product: QEMU USB Tablet lb # [ 2.698390] usb 1-1: Manufacturer: QEMU lb # [ 2.698992] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.709205] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.712995] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.604326] systemd[1]: Mounting /sysroot... client # [ 2.636463] systemd[1]: Mounting /sysroot... lb # [ 2.640951] systemd[1]: Mounting /sysroot... worker1 # [ 2.775661] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.778483] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.781563] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.783345] usb 1-1: Manufacturer: QEMU worker1 # [ 2.784994] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.813076] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.711066] systemd[1]: Mounting /sysroot... worker2 # [ 2.863431] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.864367] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.865200] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.866038] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.866901] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.867765] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.868718] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.870026] ata3.00: applying bridge limits worker2 # [ 2.870806] ata3.00: configured for UDMA/100 worker2 # [ 2.871773] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.898592] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.900779] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.903622] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.905793] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.908252] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.910664] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.912970] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.915164] ata3.00: applying bridge limits client # [ 2.917012] ata3.00: configured for UDMA/100 lb # [ 2.915283] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.920433] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.923846] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.926045] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.921152] usbcore: registered new interface driver usbhid lb # [ 2.928553] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.930930] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.933298] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.935623] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.929919] usbhid: USB HID core driver lb # [ 2.937824] ata3.00: applying bridge limits lb # [ 2.939639] ata3.00: configured for UDMA/100 lb # [ 2.941913] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.952885] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.954698] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.958420] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.968483] EXT4-fs (vda): mounted filesystem 4c72d6b6-e693-42f5-bd7a-183f76c1c576 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.972387] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.842317] systemd[1]: Mounted /sysroot. client # [ 2.988153] usbcore: registered new interface driver usbhid worker2 # [ 2.842951] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.980136] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.992370] usbhid: USB HID core driver worker1 # [ 2.982438] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.848875] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 2.984996] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.852763] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 2.987340] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.989930] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.992017] ata3.00: applying bridge limits worker1 # [ 2.993900] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.862143] systemd[1]: Mounting /sysroot/run... worker1 # [ 2.996176] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.998371] ata3.00: configured for UDMA/100 worker1 # [ 3.000743] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.868142] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.012502] usbcore: registered new interface driver usbhid client # [ 3.018693] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.874063] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.020700] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 3.017497] usbhid: USB HID core driver client # [ 3.024555] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.879876] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.032452] EXT4-fs (vda): mounted filesystem 32a4384f-20d0-4c8b-81c0-23959cae1982 r/w with ordered data mode. Quota mode: none. client # [ 2.905872] systemd[1]: Mounted /sysroot. client # [ 2.906564] systemd[1]: Reached target Initrd Root File System. client # [ 3.040940] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.036785] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.910280] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.041818] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.915883] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 2.918762] systemd[1]: Mounting /sysroot/run... lb # [ 3.050414] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 3.057305] EXT4-fs (vda): mounted filesystem 4b5c44a8-1016-48de-acff-1e08138bfec2 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.054034] usbcore: registered new interface driver usbhid client # [ 2.931766] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.060568] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.934148] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 2.925973] systemd[1]: Mounted /sysroot. lb # [ 2.928071] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.056737] 9p: Installing v9fs 9p2000 file system support worker1 # [ 3.060417] usbhid: USB HID core driver worker2 # [ 2.927073] systemd-sysroot-fstab-check[146]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.933334] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.944141] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.935147] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 2.935918] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 2.936650] systemd[1]: Mounted /sysroot/run. worker2 # [ 2.937283] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 2.942083] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 2.948596] systemd-sysroot-fstab-check[141]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.080917] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.946799] systemd[1]: Reload requested from client PID 146 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.951296] systemd[1]: Reload requested from client PID 141 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.949163] systemd[1]: Reloading... lb # [ 2.954136] systemd[1]: Reloading... worker1 # [ 3.085639] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.965602] systemd-sysroot-fstab-check[146]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.094625] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 3.099302] EXT4-fs (vda): mounted filesystem 6a7249ba-1da5-4fd6-a67d-b968cb127ad3 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.969674] systemd[1]: Mounted /sysroot. worker1 # [ 2.970715] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.106950] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.975077] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.123243] 9p: Installing v9fs 9p2000 file system support client # [ 3.003152] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.005684] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.007077] systemd[1]: Mounted /sysroot/run. worker1 # [ 2.994246] systemd-sysroot-fstab-check[142]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.007703] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.008458] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 2.996080] systemd[1]: Reload requested from client PID 142 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.997495] systemd[1]: Reloading... client # [ 3.014093] systemd[1]: Reload requested from client PID 146 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.015499] systemd[1]: Reloading... worker2 # [ 3.017192] systemd[1]: Reloading finished in 68 ms. worker2 # [ 3.026108] systemd-sysroot-fstab-check[146]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.030138] systemd-sysroot-fstab-check[146]: Requesting swap.target/start/replace... worker2 # [ 3.031782] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.037170] systemd[1]: Reloading finished in 83 ms. worker2 # [ 3.035470] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.037122] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.038251] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.044764] systemd-sysroot-fstab-check[141]: Requesting initrd-fs.target/start/replace... lb # [ 3.049180] systemd-sysroot-fstab-check[141]: Requesting swap.target/start/replace... worker2 # [ 3.048919] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.053168] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.050114] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.054210] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.055297] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.057391] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.082988] systemd[1]: Reloading finished in 69 ms. client # [ 3.092257] systemd-sysroot-fstab-check[146]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.080847] systemd[1]: Reloading finished in 82 ms. client # [ 3.095126] systemd-sysroot-fstab-check[146]: Requesting swap.target/start/replace... client # [ 3.099058] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.100423] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.101438] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.089444] systemd-sysroot-fstab-check[142]: Requesting initrd-fs.target/start/replace... client # [ 3.103604] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.092160] systemd-sysroot-fstab-check[142]: Requesting swap.target/start/replace... worker1 # [ 3.096479] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 3.099839] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.101445] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.114533] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.102437] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.115975] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.603244] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.624804] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.626264] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.627859] systemd[1]: Starting Find NixOS closure... client # [ 3.637867] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.630666] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.642494] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.645141] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.650775] systemd[1]: Mounting /sysroot/run... lb # [ 3.652132] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.649647] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.653079] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 3.660149] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.658964] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.660371] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.662125] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.682927] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.686165] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.675162] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.676195] systemd[1]: Stopped target Basic System. worker2 # [ 3.677056] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.816914] 9p: Installing v9fs 9p2000 file system support worker2 # [ 3.677943] systemd[1]: Stopped target Path Units. client # [ 3.691166] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.680063] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.681057] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.682036] systemd[1]: Stopped target Slice Units. worker2 # [ 3.682686] systemd[1]: Stopped target Socket Units. lb # [ 3.686649] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.683588] systemd[1]: Stopped target System Initialization. client # [ 3.695257] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.684397] systemd[1]: Stopped target Swaps. worker2 # [ 3.685034] systemd[1]: Stopped target Timer Units. worker2 # [ 3.685698] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.686518] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.687402] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.691723] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.689063] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.689730] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.694807] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.691630] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.695718] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.693168] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.694301] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.695286] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.699549] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.696481] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.697472] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.702847] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.699116] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.700304] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.701517] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.702750] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.704270] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.705390] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.706528] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.721243] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.709189] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.713227] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.710196] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.714732] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.711500] systemd[1]: Stopped Virtual Console Setup. client # [ 3.723504] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 3.712109] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.716707] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.715444] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.730968] systemd[1]: Finished Find NixOS closure. client # [ 3.732215] systemd[1]: Reached target Initrd Default Target. worker1 # [ 3.720159] systemd[1]: Mounting /sysroot/run... client # [ 3.733763] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.721700] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.725075] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.726170] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.728597] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.730789] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.734982] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.731813] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.735963] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.732174] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.732913] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.737557] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.734585] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.747485] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.736651] systemd[1]: Closed udev Control Socket. client # [ 3.750071] systemd[1]: Stopped target Basic System. worker2 # [ 3.737634] systemd[1]: Starting Cleanup udev Database... lb # [ 3.741232] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.750770] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.738476] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.751537] systemd[1]: Stopped target Path Units. worker2 # [ 3.739574] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.752214] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.753175] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.741218] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.754163] systemd[1]: Stopped target Slice Units. client # [ 3.754818] systemd[1]: Stopped target Socket Units. worker2 # [ 3.742381] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.755770] systemd[1]: Stopped target System Initialization. worker2 # [ 3.743480] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.756569] systemd[1]: Stopped target Swaps. worker2 # [ 3.744478] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.757205] systemd[1]: Stopped target Timer Units. client # [ 3.757860] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.759113] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.759953] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.761163] systemd[1]: Stopped Find NixOS closure. client # [ 3.761989] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.763910] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.756169] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.765142] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.766117] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.767180] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.769246] systemd[1]: Stopped Load Kernel Modules. client # [ 3.770191] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.771423] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.759991] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.772668] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.764344] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.761603] systemd[1]: Finished Cleanup udev Database. client # [ 3.774223] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.766062] systemd[1]: Reached target Initrd Default Target. client # [ 3.775141] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.762669] systemd[1]: Reached target Switch Root. worker1 # [ 3.762822] systemd[1]: Mounted /sysroot/run. lb # [ 3.767131] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.775969] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.777121] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.765232] systemd[1]: Starting NixOS Activation... client # [ 3.779114] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.901656] 9p: Installing v9fs 9p2000 file system support client # [ 3.780340] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.768614] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.781473] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.783254] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.780579] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.776783] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.777801] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.790847] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.778793] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.783257] systemd[1]: Stopped target Basic System. lb # [ 3.784045] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.784852] systemd[1]: Stopped target Path Units. lb # [ 3.785575] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.782338] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.795084] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.786611] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.787591] systemd[1]: Stopped target Slice Units. lb # [ 3.788336] systemd[1]: Stopped target Socket Units. lb # [ 3.789133] systemd[1]: Stopped target System Initialization. lb # [ 3.789961] systemd[1]: Stopped target Swaps. lb # [ 3.790712] systemd[1]: Stopped target Timer Units. client # [ 3.800181] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.791635] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.793151] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.794042] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.803097] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.795088] systemd[1]: Stopped Find NixOS closure. client # [ 3.804137] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.805118] systemd[1]: Closed udev Control Socket. lb # [ 3.795805] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 3.793369] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.807066] systemd[1]: Starting Cleanup udev Database... lb # [ 3.798340] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.794825] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.807837] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.799338] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.808916] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.800505] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.797090] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.810219] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.802132] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.811376] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.803088] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.803918] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.813145] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.804975] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.814174] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.806019] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.814965] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.808093] systemd[1]: Stopped Create System Files and Directories. client # [ 3.817115] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.808978] systemd[1]: Stopped target Local File Systems. lb # [ 3.809783] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.810714] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.811642] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.812885] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.815128] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.816578] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.817822] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.818934] systemd[1]: Reached target Initrd File Systems. client # [ 3.831637] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.833113] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.820536] systemd[1]: Starting Find NixOS closure... lb # [ 3.824667] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.834575] systemd[1]: Reached target Switch Root. client # [ 3.836559] systemd[1]: Starting NixOS Activation... lb # [ 3.827782] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.824237] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.834456] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.836142] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.837933] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.839102] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.840647] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.842100] systemd[1]: Closed udev Control Socket. lb # [ 3.843956] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.839834] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.844766] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.845791] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.846687] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.848128] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.849127] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.851121] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.847626] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.849159] systemd[1]: Reached target Initrd Default Target. worker1 # [ 3.850495] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.865675] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.867407] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.863358] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.864297] systemd[1]: Stopped target Basic System. lb # [ 3.868671] systemd[1]: Reached target Switch Root. worker1 # [ 3.865237] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.866307] systemd[1]: Stopped target Path Units. lb # [ 3.870475] systemd[1]: Starting NixOS Activation... worker1 # [ 3.868108] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.869201] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.870290] systemd[1]: Stopped target Slice Units. worker1 # [ 3.871195] systemd[1]: Stopped target Socket Units. worker1 # [ 3.871941] systemd[1]: Stopped target System Initialization. worker1 # [ 3.872789] systemd[1]: Stopped target Swaps. worker1 # [ 3.873489] systemd[1]: Stopped target Timer Units. worker1 # [ 3.874526] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 3.875778] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.877116] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.878217] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.879233] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 3.881525] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.883133] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.884198] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.885229] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.886352] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.887803] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.888875] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.890599] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.891595] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.894495] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.895321] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.896225] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.898138] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.899594] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.900828] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.903278] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.907357] initrd-nixos-activation-start[193]: booting system configuration /nix/store/j7glxpj3rbb8k7aikb154lhfz7amnd7b-nixos-system-worker2-test worker1 # [ 3.907895] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.912166] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.914630] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.918085] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.921039] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.923088] systemd[1]: Closed udev Control Socket. worker1 # [ 3.924556] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.926149] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.927243] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.928154] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.929287] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.930307] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.932117] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.933043] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.935114] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.950594] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.951780] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.953189] systemd[1]: Reached target Switch Root. worker1 # [ 3.954737] systemd[1]: Starting NixOS Activation... client # [ 3.977304] initrd-nixos-activation-start[194]: booting system configuration /nix/store/32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test worker2 # [ 3.965603] initrd-nixos-activation-start[193]: running activation script... client # [ 4.028714] initrd-nixos-activation-start[194]: running activation script... lb # [ 4.020486] initrd-nixos-activation-start[194]: booting system configuration /nix/store/8mvx6cn1l6frdr55gdj0p01an8nxnxzn-nixos-system-lb-test lb # [ 4.081826] initrd-nixos-activation-start[194]: running activation script... worker1 # [ 4.080282] initrd-nixos-activation-start[196]: booting system configuration /nix/store/6iych1bhd6jkvv72xp98ahp6dmm92z7r-nixos-system-worker1-test worker1 # [ 4.135709] initrd-nixos-activation-start[196]: running activation script... client # [ 4.337904] initrd-nixos-activation-start[217]: setting up /etc... worker2 # [ 4.335410] initrd-nixos-activation-start[216]: setting up /etc... worker1 # [ 4.484851] initrd-nixos-activation-start[219]: setting up /etc... lb # [ 4.514957] initrd-nixos-activation-start[217]: setting up /etc... client # [ 4.569762] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.557420] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.559144] systemd[1]: Finished NixOS Activation. client # [ 4.572172] systemd[1]: Finished NixOS Activation. client # [ 4.573209] systemd[1]: Starting Switch Root... worker2 # [ 4.560786] systemd[1]: Starting Switch Root... worker2 # [ 4.574281] systemd[1]: Switching root. client # [ 4.586870] systemd[1]: Switching root. lb # [ 4.692131] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.693280] systemd[1]: Finished NixOS Activation. worker1 # [ 4.690271] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.694809] systemd[1]: Starting Switch Root... worker1 # [ 4.692419] systemd[1]: Finished NixOS Activation. worker1 # [ 4.693392] systemd[1]: Starting Switch Root... client # [ 4.848826] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.707129] systemd[1]: Switching root. lb # [ 4.711294] systemd[1]: Switching root. worker2 # [ 4.844008] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). client # [ 4.976375] NET: Registered PF_VSOCK protocol family worker1 # [ 4.973949] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). lb # [ 4.982966] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.981977] NET: Registered PF_VSOCK protocol family lb # [ 5.129998] NET: Registered PF_VSOCK protocol family worker1 # [ 5.127580] NET: Registered PF_VSOCK protocol family client # [ 5.349476] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.359195] systemd[1]: Detected virtualization kvm. client # [ 5.361068] systemd[1]: Detected architecture x86-64. client # [ 5.363084] systemd[1]: Detected first boot. client # [ 5.369952] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.362825] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.367172] systemd[1]: Detected virtualization kvm. worker2 # [ 5.368025] systemd[1]: Detected architecture x86-64. worker2 # [ 5.369046] systemd[1]: Detected first boot. worker2 # [ 5.374096] systemd[1]: Initializing machine ID from random generator. client # [ 5.502613] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.515719] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.519726] systemd[1]: Detected virtualization kvm. worker1 # [ 5.511819] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.520411] systemd[1]: Detected architecture x86-64. worker1 # [ 5.515938] systemd[1]: Detected virtualization kvm. lb # [ 5.521239] systemd[1]: Detected first boot. worker1 # [ 5.516675] systemd[1]: Detected architecture x86-64. worker1 # [ 5.517476] systemd[1]: Detected first boot. lb # [ 5.524916] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.520963] systemd[1]: Initializing machine ID from random generator. client # [ 5.616015] systemd[1]: Applying preset policy. worker2 # [ 5.603184] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.717693] systemd[1]: Applying preset policy. worker1 # [ 5.752217] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.757769] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.861235] systemd[1]: Applying preset policy. lb # [ 5.886882] systemd[1]: Applying preset policy. client # [ 5.975796] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.080984] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.258913] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.304923] systemd[1]: Populated /etc with preset unit settings. client # [ 6.313522] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.314839] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.317473] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.319540] systemd[1]: Created slice Slice /system/getty. client # [ 6.320824] systemd[1]: Created slice User and Session Slice. client # [ 6.321755] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.322941] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.324066] systemd[1]: Expecting device /dev/hvc0... client # [ 6.324809] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.325565] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.326382] systemd[1]: Stopped target initrd-fs.target. client # [ 6.327097] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.327889] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.328739] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.329657] systemd[1]: Reached target Path Units. client # [ 6.330342] systemd[1]: Reached target Remote File Systems. client # [ 6.331095] systemd[1]: Reached target Slice Units. client # [ 6.331823] systemd[1]: Reached target Swaps. client # [ 6.346264] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.349906] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.352523] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.355063] systemd[1]: Listening on Factory Reset Management. client # [ 6.356090] systemd[1]: Listening on Hostname Service Socket. client # [ 6.359748] systemd[1]: Starting Journal Log Access Socket... client # [ 6.361521] systemd[1]: Listening on Journal Audit Socket. client # [ 6.364539] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.365656] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.367212] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.368629] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.376422] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.377424] systemd[1]: Listening on udev Control Socket. client # [ 6.378261] systemd[1]: Listening on udev Varlink Socket. client # [ 6.382142] systemd[1]: Mounting Huge Pages File System... client # [ 6.385074] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.390843] systemd[1]: Mounting Kernel Debug File System... client # [ 6.396269] systemd[1]: Mounting Kernel Trace File System... client # [ 6.403389] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.405596] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 6.415088] systemd[1]: Starting Load Kernel Module configfs... client # [ 6.416175] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 6.418093] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.420002] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.431400] systemd[1]: Mounting FUSE Control File System... client # [ 6.433415] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.480914] systemd[1]: Starting Journal Service... client # [ 6.492552] systemd[1]: Starting Load Kernel Modules... client # [ 6.510959] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.523624] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.533851] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.523492] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 6.524873] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 6.527412] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.529522] systemd[1]: Created slice Slice /system/getty. worker2 # [ 6.530868] systemd[1]: Created slice User and Session Slice. worker2 # [ 6.531839] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.546476] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.533032] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.534136] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 6.534884] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 6.535651] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 6.536519] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 6.537282] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 6.538092] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.538968] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 6.539897] systemd[1]: Reached target Path Units. worker2 # [ 6.540604] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.541359] systemd[1]: Reached target Slice Units. client # [ 6.557824] systemd-journald[287]: Collecting audit messages is enabled. client # [ 6.566126] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.542052] systemd[1]: Reached target Swaps. worker2 # [ 6.556203] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.572114] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.559312] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.561788] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.576001] systemd[1]: Mounted POSIX Message Queue File System. client # [ 6.580509] loop: module loaded worker2 # [ 6.566831] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.567989] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 6.571219] systemd[1]: Starting Journal Log Access Socket... client # [ 6.584878] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 6.572753] systemd[1]: Listening on Journal Audit Socket. client # [ 6.589027] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 6.575771] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.576917] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 6.578372] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.593472] systemd[1]: Started Journal Service. worker2 # [ 6.579696] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.462333] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.466113] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.586813] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 6.587886] systemd[1]: Listening on udev Control Socket. client # [ 6.468717] systemd-modules-load[288]: Inserted module 'loop' worker2 # [ 6.588808] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 6.592572] systemd[1]: Mounting Huge Pages File System... client # [ 6.472290] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.473922] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.608355] EXT4-fs (vda): re-mounted 32a4384f-20d0-4c8b-81c0-23959cae1982. worker2 # [ 6.595406] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.478251] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.482163] systemd[1]: Mounted FUSE Control File System. worker2 # [ 6.602471] systemd[1]: Mounting Kernel Debug File System... client # [ 6.483825] systemd[1]: Finished Load Kernel Modules. worker2 # [ 6.608247] systemd[1]: Mounting Kernel Trace File System... client # [ 6.490055] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.614695] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 6.619059] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 6.503091] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.629155] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.630141] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 6.511094] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 6.632265] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.515273] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 6.635729] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.518157] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.527636] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.649860] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.652792] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.539399] systemd-oomd[290]: No swap; memory pressure usage will be degraded client # [ 6.547533] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.676971] systemd[1]: Starting Journal Service... client # [ 6.560930] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.561965] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.684819] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.686153] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.563978] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.689057] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.691109] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.692590] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.693521] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.691980] systemd[1]: Starting Load Kernel Modules... worker1 # [ 6.694760] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.695903] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.696663] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.697443] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.698229] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.698964] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.699842] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.700694] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.701610] systemd[1]: Reached target Path Units. worker1 # [ 6.702282] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.699810] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 6.703056] systemd[1]: Reached target Slice Units. client # [ 6.717644] systemd-journald[287]: Received client request to flush runtime journal. worker2 # [ 6.708053] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.710920] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.703785] systemd[1]: Reached target Swaps. worker1 # [ 6.718394] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 6.721925] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.719500] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 6.724464] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.726972] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.725026] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.727948] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 6.726986] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.728987] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.731769] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.733134] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.732172] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.735942] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.734505] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.737176] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.738986] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.744099] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.745503] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.740272] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 6.738346] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 6.740662] systemd[1]: Mounted FUSE Control File System. lb # [ 6.748256] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.750324] systemd[1]: Created slice Slice /system/getty. lb # [ 6.751658] systemd[1]: Created slice User and Session Slice. lb # [ 6.752566] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.745524] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 6.748837] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.753770] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.749903] systemd[1]: Listening on udev Control Socket. lb # [ 6.754889] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.755611] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.750823] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.756387] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.757234] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.757971] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.758772] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.759599] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.755499] systemd[1]: Mounting Huge Pages File System... lb # [ 6.760474] systemd[1]: Reached target Path Units. lb # [ 6.761203] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.758491] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.765017] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.761985] systemd[1]: Reached target Slice Units. lb # [ 6.774340] systemd[1]: Reached target Swaps. worker1 # [ 6.772000] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.777560] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.772539] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 6.775959] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.781104] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.774721] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.777244] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 6.783799] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.786715] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.779541] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.787680] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.791606] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.786902] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.793036] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.789881] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.796303] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.792069] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.797671] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.799507] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.800822] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.797097] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.809068] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.810338] systemd[1]: Listening on udev Control Socket. lb # [ 6.811273] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.806400] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.805459] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.808684] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.815086] systemd[1]: Mounting Huge Pages File System... lb # [ 6.818029] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.814393] EXT4-fs (vda): re-mounted 4c72d6b6-e693-42f5-bd7a-183f76c1c576. lb # [ 6.824341] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.829828] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 6.824569] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.705614] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 6.825790] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.706543] systemd[1]: Reached target First Boot Complete. client # [ 6.707852] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.835507] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 6.827860] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.710285] systemd[1]: Finished Apply Kernel Variables. client # [ 6.712119] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.839260] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 6.834846] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.715937] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.836623] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.721737] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.849818] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.845168] systemd[1]: Starting Journal Service... lb # [ 6.850945] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.852619] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.847276] systemd-journald[286]: Collecting audit messages is enabled. lb # [ 6.854618] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.856449] systemd[1]: Starting Load Kernel Modules... lb # [ 6.861552] systemd[1]: Mounting FUSE Control File System... lb # [ 6.863526] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.868145] loop: module loaded worker1 # [ 6.873472] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 6.880963] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.879300] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.883811] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.755810] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.892024] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.890154] systemd[1]: Starting Firewall... worker2 # [ 6.761181] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.896969] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.899480] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.764438] systemd-modules-load[287]: Inserted module 'loop' worker2 # [ 6.898423] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 6.901484] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.900277] systemd[1]: Started Journal Service. worker1 # [ 6.903813] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.909553] systemd[1]: Starting Journal Service... worker1 # [ 6.906746] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.910475] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.913019] systemd[1]: Mounted FUSE Control File System. lb # [ 6.917941] systemd[1]: Starting Load Kernel Modules... client # [ 6.790714] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.792327] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.917350] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.797381] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.789209] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.939744] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 6.800116] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 6.800952] systemd[1]: Reached target First Boot Complete. client # [ 6.816431] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 6.947352] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.813087] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.949685] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 6.818306] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.954815] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.960264] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.968807] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.978788] systemd-journald[287]: Collecting audit messages is enabled. worker2 # [ 6.842900] systemd-oomd[288]: No swap; memory pressure usage will be degraded client # [ 6.856375] systemd-udevd[317]: Using default interface naming scheme 'v261'. lb # [ 6.983921] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 6.982737] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.994481] EXT4-fs (vda): re-mounted 6a7249ba-1da5-4fd6-a67d-b968cb127ad3. worker2 # [ 6.861423] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 7.003495] loop: module loaded worker2 # [ 6.996212] systemd-journald[286]: Received client request to flush runtime journal. lb # [ 7.004853] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.002213] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.003884] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.872603] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.874866] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 7.006198] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.878541] systemd-modules-load[288]: Inserted module 'loop' lb # [ 7.015944] systemd[1]: Started Journal Service. worker1 # [ 7.011494] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.012288] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.014251] systemd-journald[289]: Collecting audit messages is enabled. lb # [ 6.885838] systemd[1]: Mounted Huge Pages File System. lb # [ 6.887993] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.890288] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.892828] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.024672] loop: module loaded lb # [ 6.894134] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.897635] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 7.034895] EXT4-fs (vda): re-mounted 4b5c44a8-1016-48de-acff-1e08138bfec2. lb # [ 6.901186] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 7.032660] systemd[1]: Finished Load Kernel Modules. lb # [ 6.902111] systemd[1]: Mounted FUSE Control File System. lb # [ 6.902867] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.039960] systemd[1]: Starting Firewall... lb # [ 6.912716] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.045302] systemd[1]: Starting Apply Kernel Variables... client # [ 6.924083] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.923529] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.058429] systemd[1]: Started Journal Service. lb # [ 6.929193] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.936323] systemd[1]: Starting Firewall... worker1 # [ 6.935100] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.936635] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.941147] systemd-modules-load[290]: Inserted module 'loop' lb # [ 6.948957] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.949897] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.946578] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.961495] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.976451] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.978331] systemd-oomd[289]: No swap; memory pressure usage will be degraded worker1 # [ 6.982901] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.983783] systemd[1]: Reached target First Boot Complete. worker1 # [ 6.986137] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.989501] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.997355] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.009086] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.000703] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.001893] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.015149] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 7.017475] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 7.019380] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 7.020384] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.021708] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.159611] systemd-journald[289]: Received client request to flush runtime journal. client # [ 7.052079] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.183513] systemd-journald[287]: Received client request to flush runtime journal. client # [ 7.064381] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 7.060501] systemd-udevd[317]: Using default interface naming scheme 'v261'. client # [ 7.106626] (udev-worker)[326]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.109450] (udev-worker)[322]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.110760] (udev-worker)[326]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.167609] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 7.168911] systemd-oomd[291]: No swap; memory pressure usage will be degraded client # [ 7.184959] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.174228] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 7.180830] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.177063] systemd[1]: Finished Apply Kernel Variables. lb # [ 7.181869] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 7.179154] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.180093] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.181029] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 7.185724] systemd[1]: Reached target First Boot Complete. worker2 # [ 7.181821] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.194714] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 7.186815] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.183064] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.197048] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.189605] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 7.190841] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 7.198464] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.192147] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.200798] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.202421] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.204161] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.228153] systemd[1]: Mounted /run/wrappers. client # [ 7.229890] systemd[1]: Reached target Local File Systems. client # [ 7.233328] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.223400] systemd-udevd[322]: Using default interface naming scheme 'v261'. client # [ 7.238687] systemd[1]: Starting register-nix-paths.service... client # [ 7.241263] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.244057] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.249071] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.240731] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.241906] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.246205] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 7.396487] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.266218] systemd[1]: Starting Create System Files and Directories... client # [ 7.403875] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.305496] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.332040] systemd-udevd[327]: Using default interface naming scheme 'v261'. client # [ 7.340810] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.348237] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.348229] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 7.344699] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.361456] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 7.373245] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.397415] systemd[1]: Finished Create System Files and Directories. client # [ 7.406360] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.395513] systemd[1]: Mounting /run/wrappers... client # [ 7.412889] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.424704] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 7.437084] systemd[1]: Mounted /run/wrappers. lb # [ 7.440867] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.438983] systemd[1]: Reached target Local File Systems. worker2 # [ 7.441311] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.447216] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.450470] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.451838] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.455705] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.460080] systemd[1]: Starting Create System Files and Directories... client # [ 7.479937] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.489774] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.506749] (udev-worker)[353]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.523178] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.511290] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.524323] (udev-worker)[362]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.547285] systemd[1]: Starting Update is Completed... worker2 # [ 7.535239] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.540235] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 7.554308] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.565673] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.575885] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.589503] systemd[1]: Finished Update is Completed. client # [ 7.501277] mousedev: PS/2 mouse device common for all mice client # [ 7.501733] ACPI: button: Power Button [PWRF] client # [ 7.639704] rtc_cmos 00:04: RTC can wake from S4 worker1 # [ 7.597898] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.598684] systemd[1]: Reached target Local File Systems. client # [ 7.670056] rtc_cmos 00:04: registered as rtc0 client # [ 7.670121] rtc_cmos 00:04: setting system clock to 2026-09-22T10:55:19 UTC (1790074519) client # [ 7.670200] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.602066] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.604602] systemd[1]: Starting register-nix-paths.service... lb # [ 7.612586] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.608855] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.610260] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.611272] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.615348] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.614981] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.619399] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 7.625304] systemd[1]: Starting Create System Files and Directories... client # [ 7.713255] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 client # [ 7.718137] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 7.641244] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.647036] systemd[1]: Mounted /run/wrappers. lb # [ 7.648647] systemd[1]: Reached target Local File Systems. lb # [ 7.652151] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.657578] systemd[1]: Starting register-nix-paths.service... lb # [ 7.662633] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.663478] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.669553] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 7.718219] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 7.727097] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.683404] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.690933] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.692074] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.737951] Console: switching to colour dummy device 80x25 client # [ 7.841037] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.695282] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.841039] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.712149] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.859075] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.859776] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.865158] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.878246] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.738460] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.745527] (udev-worker)[364]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 7.749352] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 7.754187] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.751752] (udev-worker)[364]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.753227] systemd[1]: Starting Update is Completed... lb # [ 7.764239] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.767956] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.770844] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.778669] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.781548] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 7.935503] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.936891] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.805758] systemd[1]: Finished Update is Completed. worker2 # [ 7.812117] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.813782] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.816108] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.817817] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.821129] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.823221] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.825291] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.838363] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.841635] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.833699] (udev-worker)[362]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.838794] systemd[1]: Finished Create System Files and Directories. lb # [ 7.840531] (udev-worker)[362]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.849331] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.850948] (udev-worker)[372]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.857979] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 7.858201] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.012219] Console: switching to colour frame buffer device 160x50 client # [ 8.060246] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 7.919359] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.933628] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.922639] systemd[1]: Starting Update is Completed... lb # [ 7.949824] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.959604] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.962520] systemd[1]: Stopped Virtual Console Setup. client # [ 7.968533] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.980960] systemd[1]: Finished Update is Completed. lb # [ 8.001551] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 8.010260] systemd[1]: Starting Update is Completed... worker1 # [ 8.017520] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 8.019695] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.021752] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.024066] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.026233] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.028763] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.030304] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.163880] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 8.181504] ppdev: user-space parallel port driver worker2 # [ 8.173244] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.199854] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.069199] systemd[1]: Finished Update is Completed. client # [ 8.226529] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 8.112565] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.113773] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.124310] systemd[1]: Finished Firewall. client # [ 8.155365] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.158662] systemd[1]: Stopped Virtual Console Setup. client # [ 8.169653] systemd[1]: Starting Virtual Console Setup... lb # [ 8.165887] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 8.169709] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.171198] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.173527] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 8.176548] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.178912] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.180550] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.378213] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 8.250214] ACPI: button: Power Button [PWRF] worker2 # [ 8.262892] mousedev: PS/2 mouse device common for all mice client # [ 8.410827] kvm_amd: TSC scaling supported client # [ 8.411248] kvm_amd: Nested Virtualization enabled client # [ 8.412292] kvm_amd: Nested Paging enabled client # [ 8.413234] kvm_amd: LBR virtualization supported client # [ 8.414199] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.268856] systemd[1]: Finished Firewall. client # [ 8.415261] kvm_amd: Virtual GIF supported client # [ 8.416347] kvm_amd: Virtual NMI enabled worker2 # [ 8.319832] rtc_cmos 00:04: RTC can wake from S4 worker2 # [ 8.332869] rtc_cmos 00:04: registered as rtc0 worker2 # [ 8.332943] rtc_cmos 00:04: setting system clock to 2026-09-22T10:55:19 UTC (1790074519) worker1 # [ 8.275671] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.276726] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.421222] ACPI: button: Power Button [PWRF] worker2 # [ 8.333018] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 8.333832] systemd-journald[286]: Time jumped backwards, rotating. worker2 # [ 8.355038] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 8.355151] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 8.468215] EDAC MC: Ver: 3.0.0 lb # [ 8.327861] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.331117] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.462329] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.377869] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker2 # [ 8.387221] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 8.393141] Console: switching to colour dummy device 80x25 worker1 # [ 8.474707] rtc_cmos 00:04: RTC can wake from S4 worker2 # [ 8.463832] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 8.463941] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.505520] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 8.500015] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 8.500017] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 8.503629] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 8.504323] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.510708] rtc_cmos 00:04: registered as rtc0 worker1 # [ 8.517786] rtc_cmos 00:04: setting system clock to 2026-09-22T10:55:20 UTC (1790074520) worker2 # [ 8.516870] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 8.520117] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 8.517915] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.399862] systemd[1]: Finished Firewall. lb # [ 8.550494] ACPI: button: Power Button [PWRF] worker2 # [ 8.420160] systemd[1]: Starting Virtual Console Setup... lb # [ 8.577179] mousedev: PS/2 mouse device common for all mice client # [ 8.452074] systemd[1]: Finished register-nix-paths.service. lb # [ 8.603058] rtc_cmos 00:04: RTC can wake from S4 lb # [ 8.628536] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 8.637252] rtc_cmos 00:04: registered as rtc0 lb # [ 8.638065] rtc_cmos 00:04: setting system clock to 2026-09-22T10:55:20 UTC (1790074520) worker1 # [ 8.525834] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 lb # [ 8.650668] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.533280] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.539150] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.539278] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.554614] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.641460] Console: switching to colour dummy device 80x25 worker1 # [ 8.651217] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 8.557820] systemd-vconsole-setup[421]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.562179] systemd[1]: Finished Virtual Console Setup. worker2 # [ 8.681624] Console: switching to colour frame buffer device 160x50 client # [ 8.562907] systemd[1]: Reached target System Initialization. client # [ 8.564562] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.565571] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.567163] systemd[1]: Reached target Timer Units. client # [ 8.567842] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.568782] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.570277] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.571424] systemd[1]: Reached target Socket Units. client # [ 8.572272] systemd[1]: Reached target Basic System. client # [ 8.574449] systemd[1]: Started backdoor.service. client # [ 8.577140] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.651332] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 8.699172] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 8.581074] systemd[1]: Starting nftables firewall... client # [ 8.586080] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.691170] ppdev: user-space parallel port driver worker2 # [ 8.711785] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 8.592076] systemd[1]: Starting Post-Boot Actions... lb # [ 8.587094] systemd[1]: Finished register-nix-paths.service. lb # [ 8.588053] systemd[1]: Reached target System Initialization. worker1 # [ 8.699480] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 8.720241] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.589239] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 8.720243] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.591143] systemd[1]: Started niks3 garbage collection timer. worker2 # [ 8.588154] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.593169] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 8.589738] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.594119] systemd[1]: Reached target Timer Units. lb # [ 8.594850] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 8.592039] systemd[1]: Starting Virtual Console Setup... client # [ 8.608248] systemd[1]: Started Reset console on configuration changes. lb # [ 8.604735] systemd[1]: Listening on niks3 server socket. lb # [ 8.605561] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.606331] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.738211] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.607465] systemd[1]: Reached target Socket Units. worker1 # [ 8.738980] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.608187] systemd[1]: Reached target Basic System. lb # [ 8.610110] systemd[1]: Started backdoor.service. lb # [ 8.617144] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.626583] systemd[1]: Starting resolvconf update... lb # [ 8.626262] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.622319] systemd[1]: Starting Virtual Console Setup... lb # [ 8.636974] systemd[1]: Starting Post-Boot Actions... lb # [ 8.647121] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.785056] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.665698] systemd[1]: Starting D-Bus System Message Bus... client # connecting to host... client # [ 8.675895] systemd[1]: Finished Post-Boot Actions. lb # [ 8.668767] systemd[1]: Starting resolvconf update... worker2 # [ 8.812098] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.686879] systemd[1]: Started rustfs.service. client # [ 8.705500] nsncd[429]: Sep 22 10:55:20.666 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.710444] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.702039] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.714719] systemd[1]: Finished Import lastlog data into lastlog2 database. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 8.705082] systemd[1]: Stopped Virtual Console Setup. client # [ 8.717589] systemd[1]: Reached target Host and Network Name Lookups. lb # connecting to host... client # [ 8.718489] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.711990] systemd[1]: Starting rustfs-bucket.service... client # [ 8.730064] systemd[1]: Starting User Login Management... client: connected to guest root shell worker2 # [ 8.709976] systemd[1]: Starting Virtual Console Setup... client: (connecting took 9.42 seconds) lb # [ 8.741291] nsncd[524]: Sep 22 10:55:20.738 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: (finished: waiting for the VM to finish booting, in 9.42 seconds) lb # [ 8.745359] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.746270] systemd[1]: Finished Post-Boot Actions. lb # [ 8.786870] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.787870] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.798514] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.928299] ppdev: user-space parallel port driver lb # [ 8.673304] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 8.678614] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.819606] systemd[1]: Starting User Login Management... lb # [ 8.823720] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.932163] Console: switching to colour frame buffer device 160x50 worker1 # [ 8.964181] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.846569] dbus-broker-launch[440]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.973993] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.979120] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 8.980073] kvm_amd: TSC scaling supported worker2 # [ 8.980613] kvm_amd: Nested Virtualization enabled worker2 # [ 8.981127] kvm_amd: Nested Paging enabled worker2 # [ 8.981909] kvm_amd: LBR virtualization supported worker2 # [ 8.982606] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.983133] kvm_amd: Virtual GIF supported worker2 # [ 8.983750] kvm_amd: Virtual NMI enabled worker1 # [ 8.851338] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.852769] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.681695] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.868773] systemd-logind[460]: New seat seat0. worker1 # [ 8.856069] systemd[1]: Starting Virtual Console Setup... lb # [ 8.685815] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 lb # [ 8.855798] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 8.877736] systemd-logind[460]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.879777] systemd-logind[460]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 8.869907] systemd[1]: Finished register-nix-paths.service. client # [ 8.882160] systemd-logind[460]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.886479] dbus-broker-launch[440]: NSS returned no entry for 'systemd-timesync' client # [ 8.887846] dbus-broker-launch[440]: Invalid user-name in /nix/store/8rd26vjfizqw5mjnswk36af94npr87nm-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 8.891865] systemd[1]: Started User Login Management. client # [ 8.897782] systemd[1]: Starting linger-users.service... worker1 # [ 8.887938] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.890296] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.893376] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.027568] EDAC MC: Ver: 3.0.0 client # [ 8.924259] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.925219] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.925969] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.926823] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.927669] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.935346] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.938391] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.956420] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.855908] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.949347] Console: switching to colour dummy device 80x25 client # [ 8.973798] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.986542] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.991821] systemd[1]: Finished linger-users.service. client # [ 8.997326] dbus-broker-launch[440]: Ready lb # [ 8.992975] dbus-broker-launch[549]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.998875] dbus-broker-launch[549]: NSS returned no entry for 'systemd-timesync' lb # [ 9.000171] dbus-broker-launch[549]: Invalid user-name in /nix/store/4f05js9lzfgnghkwcx7gl7iad82krcww-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 9.103630] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 9.103869] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 9.144509] kvm_amd: TSC scaling supported worker1 # [ 9.144942] kvm_amd: Nested Virtualization enabled worker1 # [ 9.145714] kvm_amd: Nested Paging enabled worker1 # [ 9.146136] kvm_amd: LBR virtualization supported worker1 # [ 9.146809] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.147329] kvm_amd: Virtual GIF supported worker1 # [ 9.147928] kvm_amd: Virtual NMI enabled worker1 # [ 9.020228] systemd[1]: Finished register-nix-paths.service. client # [ 9.039476] systemd[1]: Finished resolvconf update. client # [ 9.042670] nsncd[523]: Sep 22 10:55:21.005 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.047523] systemd[1]: Starting DHCP Client... client # [ 9.049370] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.051494] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.052675] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.190676] EDAC MC: Ver: 3.0.0 lb # [ 9.218504] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 9.218506] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 9.043856] systemd[1]: Started D-Bus System Message Bus. lb # [ 9.086646] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 9.089243] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 9.092677] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 9.094602] systemd[1]: Stopping User and Group Name Lookups... lb # [ 9.095905] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 9.098235] systemd[1]: nscd.service: Deactivated successfully. lb # [ 9.100288] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 9.102684] systemd-logind[552]: New seat seat0. lb # [ 9.103424] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.107799] systemd[1]: Started User Login Management. lb # [ 9.110430] dbus-broker-launch[549]: Ready lb # [ 9.251737] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 9.122722] systemd[1]: Starting linger-users.service... worker2 # [ 9.136510] systemd-vconsole-setup[520]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 9.139932] systemd[1]: Finished Virtual Console Setup. worker2 # [ 9.141193] systemd[1]: Reached target System Initialization. lb # [ 9.281420] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 9.142558] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 9.143766] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 9.145214] systemd[1]: Reached target Timer Units. worker2 # [ 9.146222] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 9.147861] systemd[1]: Listening on Nix Daemon Socket. client # [ 9.163079] dhcpcd[554]: dhcpcd-10.3.2 starting worker2 # [ 9.150553] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 9.152630] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 9.153791] systemd[1]: Reached target Socket Units. worker2 # [ 9.154536] systemd[1]: Reached target Basic System. worker2 # [ 9.156889] systemd[1]: Started backdoor.service. client # [ 9.169904] dhcpcd[563]: dev: loaded udev worker2 # [ 9.161705] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 9.165085] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.169150] systemd[1]: Starting Post-Boot Actions... worker2 # [ 9.174408] systemd[1]: Started Reset console on configuration changes. client # [ 9.321508] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.183799] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.180124] systemd[1]: Starting resolvconf update... worker2 # [ 9.187538] systemd[1]: Starting D-Bus System Message Bus... client # [ 9.214163] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.209096] nsncd[612]: Sep 22 10:55:21.206 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.211666] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.215884] systemd[1]: Finished resolvconf update. lb # [ 9.219867] systemd[1]: Reached target Preparation for Network. lb # [ 9.226336] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.227216] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.235080] systemd[1]: Starting DHCP Client... lb # [ 9.240806] systemd[1]: Starting Address configuration of eth1... lb # [ 9.247861] systemd[1]: Starting Extra networking commands.... worker2 # [ 9.252225] systemd[1]: Finished Post-Boot Actions. lb # [ 9.263753] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.265397] systemd[1]: Finished linger-users.service. client # [ 9.414755] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # connecting to host... worker1 # [ 9.274667] systemd-vconsole-setup[523]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.280299] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.281213] systemd[1]: Reached target System Initialization. worker1 # [ 9.282206] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 9.283454] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 9.284723] systemd[1]: Reached target Timer Units. worker1 # [ 9.285517] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 9.286763] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 9.288139] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 9.288715] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.288966] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 9.290136] systemd[1]: Reached target Socket Units. worker2 # [ 9.290723] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 9.291124] systemd[1]: Reached target Basic System. client # [ 9.306439] systemd[1]: Finished nftables firewall. worker2 # [ 9.294500] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.294633] systemd[1]: Started backdoor.service. client # [ 9.308290] systemd[1]: Reached target Preparation for Network. worker1 # [ 9.297202] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 9.297534] nsncd[528]: Sep 22 10:55:20.586 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.312331] systemd[1]: Starting Address configuration of eth1... worker2 # [ 9.302120] systemd[1]: Starting User Login Management... client # [ 9.448746] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.449942] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 9.304232] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 9.304105] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 9.317794] systemd[1]: Starting Extra networking commands.... lb # [ 9.309846] systemd-logind[552]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 9.306961] systemd[1]: Starting Post-Boot Actions... lb # [ 9.311815] systemd-logind[552]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 9.454283] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.455126] cfg80211: failed to load regulatory.db worker1 # [ 9.310356] systemd[1]: Started Reset console on configuration changes. worker1 # [ 9.316316] systemd[1]: Starting resolvconf update... worker1 # [ 9.324094] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 9.348224] dbus-broker-launch[532]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 9.365121] dbus-broker-launch[532]: NSS returned no entry for 'systemd-timesync' worker2 # [ 9.366219] dbus-broker-launch[532]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 9.524983] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.393645] dhcpcd[563]: eth0: waiting for carrier client # [ 9.394887] dhcpcd[563]: eth0: carrier acquired client # [ 9.534281] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.388515] systemd[1]: Finished Post-Boot Actions. worker2 # [ 9.392822] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 9.394813] systemd[1]: Stopping Host and Network Name Lookups... client # [ 9.408191] dhcpcd[563]: DUID 00:01:00:01:32:45:1b:19:52:54:00:12:34:56 client # [ 9.409460] dhcpcd[563]: eth0: IAID 00:12:34:56 worker2 # [ 9.397097] systemd[1]: Stopped target User and Group Name Lookups. client # [ 9.410227] dhcpcd[563]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 9.397959] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 9.400874] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.402556] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.404367] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 9.419783] network-addresses-eth1-start[577]: adding address 192.168.1.1/24... done worker2 # [ 9.408635] systemd[1]: Started D-Bus System Message Bus. lb # [ 9.414740] network-addresses-eth1-start[637]: adding address 192.168.1.2/24... done worker2 # [ 9.414249] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # connecting to host... client # [ 9.432620] network-addresses-eth1-start[577]: adding address 2001:db8:1::1/64... done worker2 # [ 9.422089] systemd-logind[553]: New seat seat0. worker1 # [ 9.427489] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.428520] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 9.427776] systemd-logind[553]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 9.430497] systemd-logind[553]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.431530] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.431755] systemd-logind[553]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 9.434660] systemd[1]: Started User Login Management. worker1 # [ 9.434676] nsncd[531]: Sep 22 10:55:21.542 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.439832] network-addresses-eth1-start[637]: adding address 2001:db8:1::2/64... done client # [ 9.449287] systemd[1]: Finished Address configuration of eth1. worker1 # [ 9.438599] systemd[1]: Starting User Login Management... worker2 # [ 9.439323] systemd[1]: Starting linger-users.service... worker1 # [ 9.440233] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 9.469603] systemd[1]: Finished Extra networking commands.. client # [ 9.471416] systemd[1]: Reached target Network. client # [ 9.474638] systemd[1]: Starting Permit User Sessions... worker2 # [ 9.466929] dbus-broker-launch[532]: Ready worker2 # [ 9.491223] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.491739] dbus-broker-launch[535]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 9.492904] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.505581] systemd[1]: Finished Permit User Sessions. worker2 # [ 9.494904] nsncd[599]: Sep 22 10:55:20.790 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.509286] systemd[1]: Started Getty on tty1. worker2 # [ 9.496839] systemd[1]: Reached target User and Group Name Lookups. client # [ 9.510460] systemd[1]: Reached target Login Prompts. worker2 # [ 9.507663] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 9.508098] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync' worker2 # [ 9.508589] systemd[1]: Finished linger-users.service. worker1 # [ 9.510127] dbus-broker-launch[535]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 9.514798] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 9.517678] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 9.520090] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 9.520630] systemd[1]: Finished resolvconf update. worker1 # [ 9.520898] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 9.522727] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.523231] systemd[1]: Reached target Preparation for Network. worker1 # [ 9.524588] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.526862] systemd[1]: Starting DHCP Client... worker1 # [ 9.526210] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 9.541311] dhcpcd[563]: eth0: soliciting a DHCP lease worker2 # [ 9.529226] systemd[1]: Starting Address configuration of eth1... worker1 # [ 9.535536] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.536304] systemd[1]: Starting Extra networking commands.... lb # [ 9.645729] ppdev: user-space parallel port driver client # [ 9.693453] NET: Registered PF_PACKET protocol family client # [ 9.564467] dhcpcd[563]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 9.566115] dhcpcd[563]: eth0: probing address 10.0.2.15/24 worker1 # [ 9.562568] systemd-logind[557]: New seat seat0. worker1 # [ 9.565101] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 9.572261] systemd-logind[557]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 9.574177] systemd-logind[557]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.576305] systemd-logind[557]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 9.580224] systemd[1]: Started User Login Management. lb # [ 9.673968] Console: switching to colour frame buffer device 160x50 worker1 # [ 9.584451] systemd[1]: Starting linger-users.service... lb # [ 9.742904] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.742923] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.617507] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.618443] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 9.619296] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.621422] nsncd[601]: Sep 22 10:55:21.738 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.628507] dbus-broker-launch[535]: Ready worker2 # [ 9.638669] network-addresses-eth1-start[628]: adding address 192.168.1.4/24... done worker1 # [ 9.647070] systemd[1]: Finished resolvconf update. worker1 # [ 9.649155] systemd[1]: Reached target Preparation for Network. lb # [ 9.747808] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.653917] systemd[1]: Starting DHCP Client... worker2 # [ 9.654089] network-addresses-eth1-start[628]: adding address 2001:db8:1::4/64... done worker1 # [ 9.656227] systemd[1]: Starting Address configuration of eth1... worker1 # [ 9.660875] systemd[1]: Starting Extra networking commands.... worker1 # [ 9.661793] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 9.665454] systemd[1]: Finished linger-users.service. worker2 # [ 9.673692] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.700675] dhcpcd[635]: dhcpcd-10.3.2 starting lb # [ 9.779899] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.843932] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 9.473115] systemd[1]: Finished Address configuration of eth1. lb # [ 9.711535] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.710534] dhcpcd[691]: dev: loaded udev lb # [ 9.715386] dhcpcd[650]: dhcpcd-10.3.2 starting worker2 # [ 9.712480] systemd[1]: Finished Extra networking commands.. lb # [ 9.716426] systemd[1]: Reached target Network. worker2 # [ 9.715069] systemd[1]: Reached target Network. lb # [ 9.720752] dhcpcd[707]: dev: loaded udev worker2 # [ 9.717355] systemd[1]: Starting Permit User Sessions... lb # [ 9.721956] systemd[1]: Starting PostgreSQL Server... lb # [ 9.726123] systemd[1]: Starting Permit User Sessions... lb # [ 9.726894] systemd[1]: Finished Permit User Sessions. lb # [ 9.731044] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 9.734434] systemd[1]: Started Getty on tty1. lb # [ 9.739313] systemd[1]: Reached target Login Prompts. lb # [ 9.740229] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.869781] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.741375] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.870232] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.749103] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.746771] systemd[1]: Finished Permit User Sessions. worker2 # [ 9.751064] systemd[1]: Started Getty on tty1. worker2 # [ 9.752315] systemd[1]: Reached target Login Prompts. worker1 # [ 9.760752] network-addresses-eth1-start[630]: adding address 192.168.1.3/24... done worker2 # [ 9.768661] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.774903] network-addresses-eth1-start[630]: adding address 2001:db8:1::3/64... done worker1 # [ 9.793377] systemd[1]: Finished Address configuration of eth1. lb # [ 9.815749] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 9.955965] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.823339] dhcpcd[639]: dhcpcd-10.3.2 starting worker1 # [ 9.833418] dhcpcd[693]: dev: loaded udev lb # [ 9.846624] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.843162] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.844685] systemd[1]: Reached target Network. lb # [ 9.850260] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.848108] systemd[1]: Starting Permit User Sessions... worker2 # [ 9.982119] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 9.982828] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 9.986015] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 9.986869] cfg80211: failed to load regulatory.db worker1 # [ 9.996642] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.997086] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.879660] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.882161] systemd[1]: Started Getty on tty1. worker1 # [ 9.884240] systemd[1]: Reached target Login Prompts. lb # [ 9.891982] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.899626] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 10.039881] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 10.033473] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 9.902137] dhcpcd[691]: eth0: waiting for carrier worker2 # [ 9.902932] dhcpcd[691]: eth0: carrier acquired worker2 # [ 9.911452] dhcpcd[691]: DUID 00:01:00:01:32:45:1b:19:52:54:00:12:34:56 worker2 # [ 9.912567] dhcpcd[691]: eth0: IAID 00:12:34:56 worker2 # [ 9.913328] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 10.089073] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 10.113673] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 10.114385] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 10.112608] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 10.117857] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 10.113332] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 10.118778] cfg80211: failed to load regulatory.db worker1 # [ 10.116111] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 10.116941] cfg80211: failed to load regulatory.db client: (finished: waiting for unit network-addresses-eth1.service, in 10.69 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 10.031290] postgresql-pre-start[727]: The files belonging to this database system will be owned by user "postgres". worker1 # [ 10.165021] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 10.030807] dhcpcd[693]: eth0: waiting for carrier worker1 # [ 10.031771] dhcpcd[693]: eth0: carrier acquired lb # [ 10.035682] postgresql-pre-start[727]: This user must also own the server process. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 10.040844] dhcpcd[693]: DUID 00:01:00:01:32:45:1b:1a:52:54:00:12:34:56 worker1 # [ 10.041983] dhcpcd[693]: eth0: IAID 00:12:34:56 worker1 # [ 10.042696] dhcpcd[693]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 10.049195] postgresql-pre-start[727]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 10.050488] postgresql-pre-start[727]: The default database encoding has accordingly been set to "UTF8". lb # [ 10.052191] postgresql-pre-start[727]: The default text search configuration will be set to "english". lb # [ 10.054375] postgresql-pre-start[727]: Data page checksums are enabled. lb # [ 10.055993] postgresql-pre-start[727]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 10.061465] postgresql-pre-start[727]: creating subdirectories ... ok lb # [ 10.062521] postgresql-pre-start[727]: selecting dynamic shared memory implementation ... posix lb # [ 10.217970] kvm_amd: TSC scaling supported lb # [ 10.219312] kvm_amd: Nested Virtualization enabled lb # [ 10.219901] kvm_amd: Nested Paging enabled lb # [ 10.222658] kvm_amd: LBR virtualization supported lb # [ 10.224717] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 10.226542] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 10.227838] kvm_amd: Virtual GIF supported lb # [ 10.094277] dhcpcd[707]: eth0: waiting for carrier lb # [ 10.096555] dhcpcd[707]: eth0: carrier acquired lb # [ 10.233457] kvm_amd: Virtual NMI enabled lb # [ 10.119962] dhcpcd[707]: DUID 00:01:00:01:32:45:1b:1a:52:54:00:12:34:56 lb # [ 10.123600] dhcpcd[707]: eth0: IAID 00:12:34:56 lb # [ 10.124285] dhcpcd[707]: eth0: adding address fe80::5054:ff:fe12:3456 lb: (finished: waiting for unit network-addresses-eth1.service, in 0.14 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb # [ 10.320872] EDAC MC: Ver: 3.0.0 lb # [ 10.231556] postgresql-pre-start[727]: selecting default "max_connections" ... 100 lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.259869] dhcpcd[707]: eth0: soliciting a DHCP lease lb # [ 10.417194] NET: Registered PF_PACKET protocol family lb # [ 10.287589] dhcpcd[707]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 10.290192] dhcpcd[707]: eth0: probing address 10.0.2.15/24 lb # [ 10.310047] postgresql-pre-start[727]: selecting default "shared_buffers" ... 128MB worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1 # [ 10.318211] dhcpcd[693]: eth0: soliciting a DHCP lease worker1 # [ 10.472887] NET: Registered PF_PACKET protocol family worker1 # [ 10.342443] dhcpcd[693]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.345188] dhcpcd[693]: eth0: probing address 10.0.2.15/24 worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.393355] systemd-vconsole-setup[732]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 10.399974] systemd[1]: Finished Virtual Console Setup. worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service client # [ 11.277841] dhcpcd[563]: eth0: soliciting an IPv6 router client # [ 11.280679] dhcpcd[563]: eth0: Router Advertisement from fe80::2 client # [ 11.282748] dhcpcd[563]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 11.284873] dhcpcd[563]: eth0: adding route to fec0::/64 client # [ 11.286800] dhcpcd[563]: eth0: adding default route via fe80::2 lb # [ 11.480631] dhcpcd[707]: eth0: soliciting an IPv6 router lb # [ 11.482108] dhcpcd[707]: eth0: Router Advertisement from fe80::2 lb # [ 11.482995] dhcpcd[707]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.484128] dhcpcd[707]: eth0: adding route to fec0::/64 lb # [ 11.484923] dhcpcd[707]: eth0: adding default route via fe80::2 worker2 # [ 11.779302] dhcpcd[691]: eth0: soliciting a DHCP lease worker2 # [ 11.939399] NET: Registered PF_PACKET protocol family worker2 # [ 11.813195] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 11.818343] dhcpcd[691]: eth0: probing address 10.0.2.15/24 worker2 # [ 11.998122] dhcpcd[691]: eth0: soliciting an IPv6 router worker2 # [ 12.000874] dhcpcd[691]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.002894] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.005173] dhcpcd[691]: eth0: adding route to fec0::/64 worker2 # [ 12.007134] dhcpcd[691]: eth0: adding default route via fe80::2 lb # [ 12.124865] postgresql-pre-start[727]: selecting default time zone ... UTC lb # [ 12.129627] postgresql-pre-start[727]: creating configuration files ... ok lb # [ 12.371104] postgresql-pre-start[727]: running bootstrap script ... ok worker1 # [ 12.559746] dhcpcd[693]: eth0: soliciting an IPv6 router worker1 # [ 12.562595] dhcpcd[693]: eth0: Router Advertisement from fe80::2 worker1 # [ 12.564605] dhcpcd[693]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 12.566801] dhcpcd[693]: eth0: adding route to fec0::/64 worker1 # [ 12.568668] dhcpcd[693]: eth0: adding default route via fe80::2 lb # [ 12.902893] postgresql-pre-start[727]: performing post-bootstrap initialization ... ok lb # [ 13.023387] postgresql-pre-start[727]: syncing data to disk ... ok lb # [ 13.025124] postgresql-pre-start[727]: initdb: warning: enabling "trust" authentication for local connections lb # [ 13.026426] postgresql-pre-start[727]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 13.028292] postgresql-pre-start[727]: Success. You can now start the database server using: lb # [ 13.029315] postgresql-pre-start[727]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 13.125691] postgres[801]: [801] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 13.129601] postgres[801]: [801] LOG: listening on IPv6 address "::1", port 5432 lb # [ 13.130740] postgres[801]: [801] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 13.133075] postgres[801]: [801] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 13.145357] postgres[810]: [810] LOG: database system was shut down at 2026-09-22 10:55:24 GMT lb # [ 13.150534] postgres[801]: [801] LOG: database system is ready to accept connections lb # [ 13.154866] systemd[1]: Started PostgreSQL Server. lb # [ 13.161431] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 13.359451] postgresql-setup-start[827]: CREATE DATABASE lb # [ 13.403779] postgresql-setup-start[832]: CREATE ROLE lb # [ 13.422067] postgresql-setup-start[834]: ALTER DATABASE lb # [ 13.427352] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 13.429437] systemd[1]: Reached target PostgreSQL. client # [ 14.804997] dhcpcd[563]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 14.808246] dhcpcd[563]: eth0: adding route to 10.0.2.0/24 client # [ 14.810223] dhcpcd[563]: eth0: adding default route via 10.0.2.2 lb # [ 14.861769] dhcpcd[707]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 14.862729] dhcpcd[707]: eth0: adding route to 10.0.2.0/24 lb # [ 14.863472] dhcpcd[707]: eth0: adding default route via 10.0.2.2 client # [ 14.920805] systemd[1]: Started DHCP Client. client # [ 14.922794] systemd[1]: Reached target Multi-User System. client # [ 14.923815] systemd[1]: Startup finished in 867ms (kernel) + 3.926s (initrd) + 10.129s (userspace) = 14.923s. lb # [ 14.947309] systemd[1]: Started DHCP Client. lb # [ 14.948941] systemd[1]: Reached target Network is Online. lb # [ 14.952934] systemd[1]: Started Envoy reverse proxy. lb # [ 14.957592] systemd[1]: Started mock-oidc.service. lb # [ 15.037172] mock-oidc-server[911]: Mock OIDC Server running lb # [ 15.038140] mock-oidc-server[911]: OIDC Address: 192.168.1.2:8080 lb # [ 15.039254] mock-oidc-server[911]: Issue Address: 0.0.0.0:8081 lb # [ 15.040338] mock-oidc-server[911]: Issuer: http://192.168.1.2:8080/oidc lb # [ 15.041368] mock-oidc-server[911]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 15.042513] mock-oidc-server[911]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 15.043951] mock-oidc-server[911]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 15.560287] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) worker1 # [ 15.557698] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 15.562177] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:469] statically linked extensions: worker1 # [ 15.559047] dhcpcd[693]: eth0: adding route to 10.0.2.0/24 worker1 # [ 15.559875] dhcpcd[693]: eth0: adding default route via 10.0.2.2 lb # [ 15.563646] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 15.566513] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 15.569202] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 15.572245] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 15.575488] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 15.577531] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 15.579266] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 15.580900] envoy[910]: [2026-09-22 10:55:27.557][910][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 15.582555] envoy[910]: [2026-09-22 10:55:27.558][910][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 15.584999] envoy[910]: [2026-09-22 10:55:27.558][910][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 15.587433] envoy[910]: [2026-09-22 10:55:27.558][910][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 15.589411] envoy[910]: [2026-09-22 10:55:27.558][910][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 15.591234] envoy[910]: [2026-09-22 10:55:27.558][910][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 15.608282] envoy[910]: [2026-09-22 10:55:27.558][910][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 15.610079] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 15.611909] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 15.613694] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 15.619560] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 15.621184] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 15.623600] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 15.625371] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 15.627615] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.629595] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 15.631535] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 15.635402] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 15.637366] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter worker1 # [ 15.636910] systemd[1]: Started DHCP Client. lb # [ 15.639489] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule worker1 # [ 15.639063] systemd[1]: Reached target Multi-User System. lb # [ 15.642131] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr worker1 # [ 15.639782] systemd[1]: Startup finished in 906ms (kernel) + 4.027s (initrd) + 10.704s (userspace) = 15.638s. lb # [ 15.643973] envoy[910]: [2026-09-22 10:55:27.564][910][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 15.646353] envoy[910]: [2026-09-22 10:55:27.567][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 15.650142] envoy[910]: [2026-09-22 10:55:27.567][910][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 15.651990] envoy[910]: [2026-09-22 10:55:27.567][910][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 15.654230] envoy[910]: [2026-09-22 10:55:27.567][910][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 15.655764] envoy[910]: [2026-09-22 10:55:27.567][910][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 15.657827] envoy[910]: [2026-09-22 10:55:27.567][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 15.659925] envoy[910]: [2026-09-22 10:55:27.567][910][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 15.661622] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 15.664488] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 15.668631] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 15.672082] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 15.674519] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 15.676827] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 15.680053] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 15.682081] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 15.684123] envoy[910]: [2026-09-22 10:55:27.570][910][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 15.690409] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 15.693112] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 15.699991] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 15.702363] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 15.706793] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 15.708767] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 15.711194] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 15.716146] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.718083] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 15.719870] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 15.722094] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 15.724138] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 15.728321] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 15.731643] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 15.733791] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 15.740418] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 15.742206] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 15.746149] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 15.748532] envoy[910]: [2026-09-22 10:55:27.573][910][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 15.751320] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 15.758313] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 15.760823] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 15.762741] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 15.767696] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 15.769521] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 15.771823] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 15.773605] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 15.775258] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 15.777205] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 15.779732] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 15.785202] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 15.787080] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 15.790373] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 15.816168] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 15.818626] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 15.821193] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 15.832545] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 15.834291] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 15.836065] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 15.838134] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 15.840608] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 15.842835] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 15.844913] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 15.846806] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 15.848667] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 15.851166] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 15.854201] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 15.858667] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 15.860834] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 15.863100] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 15.865081] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 15.867329] envoy[910]: [2026-09-22 10:55:27.575][910][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 15.869475] envoy[910]: [2026-09-22 10:55:27.599][910][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 15.872072] envoy[910]: [2026-09-22 10:55:27.599][910][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 15.876148] envoy[910]: [2026-09-22 10:55:27.599][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 15.878777] envoy[910]: [2026-09-22 10:55:27.599][910][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 15.884155] envoy[910]: [2026-09-22 10:55:27.599][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 15.885719] envoy[910]: [2026-09-22 10:55:27.599][910][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 15.888771] envoy[910]: [2026-09-22 10:55:27.599][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 15.890317] envoy[910]: [2026-09-22 10:55:27.777][910][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 15.891949] envoy[910]: [2026-09-22 10:55:27.856][910][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 15.904606] envoy[910]: [2026-09-22 10:55:27.856][910][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 15.906185] envoy[910]: [2026-09-22 10:55:27.856][910][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 15.913867] envoy[910]: [2026-09-22 10:55:27.856][910][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 15.963684] envoy[910]: [2026-09-22 10:55:27.961][910][info][main] [source/server/server.cc:968] runtime: {} lb # [ 15.970461] envoy[910]: [2026-09-22 10:55:27.968][910][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 15.973477] envoy[910]: [2026-09-22 10:55:27.971][910][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 15.976375] envoy[910]: [2026-09-22 10:55:27.974][910][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 15.979291] envoy[910]: [2026-09-22 10:55:27.977][910][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 15.981070] envoy[910]: [2026-09-22 10:55:27.978][910][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 15.982892] envoy[910]: [2026-09-22 10:55:27.978][910][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 16.036716] envoy[910]: [2026-09-22 10:55:28.034][910][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 16.036614] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 16.056487] envoy[910]: [2026-09-22 10:55:28.054][910][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 16.058793] envoy[910]: [2026-09-22 10:55:28.056][910][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 16.061758] envoy[910]: [2026-09-22 10:55:28.056][910][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 16.235503] nix-grpc-daemon[784]: ts=2026-09-22T10:55:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 16.244155] nix-grpc-daemon[784]: ts=2026-09-22T10:55:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 16.250419] nix-grpc-daemon[784]: ts=2026-09-22T10:55:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 16.281103] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 16.283054] nix-grpc-daemon[784]: E0000 00:00:1790074528.396884 784 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 16.299318] nix-grpc-daemon[784]: E0000 00:00:1790074528.416699 784 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 16.302951] nix-grpc-daemon[784]: ts=2026-09-22T10:55:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 16.305670] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 16.334081] nix-grpc-daemon[784]: E0000 00:00:1790074528.451279 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 16.358789] nix-grpc-daemon[784]: E0000 00:00:1790074528.475539 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 16.363543] nix-grpc-daemon[784]: E0000 00:00:1790074528.479435 826 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 16.372679] envoy[910]: [2026-09-22 10:55:28.370][910][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 16.377207] envoy[910]: [2026-09-22 10:55:28.374][910][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 16.376904] nix-grpc-daemon[784]: E0000 00:00:1790074528.494407 826 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 16.381544] envoy[910]: [2026-09-22 10:55:28.375][910][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 16.386102] nix-grpc-daemon[784]: ts=2026-09-22T10:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 16.395345] envoy[910]: [2026-09-22 10:55:28.393][910][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 16.586973] nix-grpc-daemon[784]: ts=2026-09-22T10:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 16.990663] nix-grpc-daemon[784]: ts=2026-09-22T10:55:29Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 17.011704] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 17.014593] dhcpcd[691]: eth0: adding route to 10.0.2.0/24 worker2 # [ 17.016809] dhcpcd[691]: eth0: adding default route via 10.0.2.2 worker2 # [ 17.118730] systemd[1]: Started DHCP Client. worker2 # [ 17.121312] systemd[1]: Reached target Multi-User System. worker2 # [ 17.122081] systemd[1]: Reached target Network is Online. worker2 # [ 17.124956] systemd[1]: Starting scheduler-token.service... worker2 # [ 17.213515] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.215247] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.217123] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 89ms wall clock time, 3.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 17.221541] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 17.411322] nix-grpc-daemon[785]: ts=2026-09-22T10:55:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 17.420547] nix-grpc-daemon[785]: ts=2026-09-22T10:55:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 17.425407] nix-grpc-daemon[785]: ts=2026-09-22T10:55:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 17.461370] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 17.462730] nix-grpc-daemon[785]: E0000 00:00:1790074528.759600 785 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.478107] nix-grpc-daemon[785]: E0000 00:00:1790074528.777480 785 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.481706] nix-grpc-daemon[785]: ts=2026-09-22T10:55:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 17.484666] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 17.488381] systemd[1]: Startup finished in 864ms (kernel) + 3.934s (initrd) + 12.686s (userspace) = 17.485s. worker2 # [ 17.531387] nix-grpc-daemon[785]: E0000 00:00:1790074528.830018 827 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.547129] nix-grpc-daemon[785]: E0000 00:00:1790074528.846483 827 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.552061] nix-grpc-daemon[785]: E0000 00:00:1790074528.849882 827 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.563436] nix-grpc-daemon[785]: E0000 00:00:1790074528.862853 827 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.580665] nix-grpc-daemon[785]: ts=2026-09-22T10:55:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.588962] nix-grpc-daemon[785]: ts=2026-09-22T10:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.791520] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.793779] nix-grpc-daemon[784]: ts=2026-09-22T10:55:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.795573] nix-grpc-daemon[784]: ts=2026-09-22T10:55:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.796300] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.996364] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.998480] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.997513] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.001542] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.199223] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.200980] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.202347] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.204315] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.401349] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.403063] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.405634] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.409393] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.604255] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.607919] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.611680] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.614674] nix-grpc-daemon[785]: ts=2026-09-22T10:55:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.809680] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.812217] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.813568] nix-grpc-daemon[784]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.815985] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.016505] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.014655] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.018290] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.018661] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.219652] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.219522] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.223476] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.223787] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.424418] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.426138] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.424300] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.428153] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.627308] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.628911] nix-grpc-daemon[785]: ts=2026-09-22T10:55:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.628896] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.632327] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.829808] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.834354] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.834793] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.837393] nix-grpc-daemon[784]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.034751] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.036073] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.038757] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.040154] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.241319] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.239754] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.243426] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.243751] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.444774] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.444597] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.448466] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.448728] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.649496] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.650716] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.653334] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.654618] nix-grpc-daemon[785]: ts=2026-09-22T10:55:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.855125] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.856088] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.858888] nix-grpc-daemon[784]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.859860] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.058601] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.060530] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.062598] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.063546] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.261616] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.264102] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.265683] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.267886] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.466483] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.466653] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.470416] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.470320] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.671378] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.673168] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.674995] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.676331] nix-grpc-daemon[785]: ts=2026-09-22T10:55:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.874541] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.877298] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.878755] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.880368] nix-grpc-daemon[784]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.077624] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.079562] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.081368] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.081538] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.281194] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.283588] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.282753] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.286525] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.484883] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.486805] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.488813] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.489280] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.689472] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.691293] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.693901] nix-grpc-daemon[785]: ts=2026-09-22T10:55:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.693175] nix-grpc-daemon[784]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.893075] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.894823] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.897286] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.897751] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.095086] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.096777] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.098690] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.102564] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.297741] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.301542] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.303870] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.307872] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.502375] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.506220] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.508918] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.512837] nix-grpc-daemon[785]: ts=2026-09-22T10:55:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.706978] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.710819] nix-grpc-daemon[784]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.713762] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.715356] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.912445] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.916755] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.916169] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.920598] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.116861] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.121195] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.120598] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.122918] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.321533] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.324246] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.325321] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.328106] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.526223] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.528879] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.530544] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.532730] nix-grpc-daemon[785]: ts=2026-09-22T10:55:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.731391] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.735219] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.735577] nix-grpc-daemon[784]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.738484] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.936377] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.937186] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.941144] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.941323] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.141930] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.141955] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.144189] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.145989] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.345523] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.346575] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.350497] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.350369] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.550528] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.552291] nix-grpc-daemon[785]: ts=2026-09-22T10:55:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.551498] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.555671] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.754311] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.755974] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.757746] nix-grpc-daemon[784]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.757992] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.958719] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.961069] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.959778] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.965724] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.162585] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.164570] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.166728] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.168648] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.369060] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.367946] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.370761] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.372210] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.571332] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.573064] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.573081] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.576749] nix-grpc-daemon[785]: ts=2026-09-22T10:55:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.774283] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.779107] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.778690] nix-grpc-daemon[784]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.782229] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.979509] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.979941] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.981600] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.984111] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.182552] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.185241] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.186609] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.189192] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.386745] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.388391] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.389718] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.391684] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.589485] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.593446] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.593221] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.596728] nix-grpc-daemon[785]: ts=2026-09-22T10:55:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.794074] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.795376] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.798388] nix-grpc-daemon[784]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.799326] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.999487] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.001604] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.000399] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.004425] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.202251] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.202588] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.206399] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.206443] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.407028] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.407118] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.408901] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.410746] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.611114] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.610193] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.612866] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.614383] nix-grpc-daemon[785]: ts=2026-09-22T10:55:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.813496] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.815247] nix-grpc-daemon[784]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.817136] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.820391] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.017286] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.017887] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.021068] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.022153] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.221728] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.222996] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.225303] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.226918] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.425511] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.427083] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.428073] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.431790] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.628167] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.632236] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.631892] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.634086] nix-grpc-daemon[785]: ts=2026-09-22T10:55:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.832845] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.835382] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.836690] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.836604] nix-grpc-daemon[784]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.036511] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.038252] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.039970] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.040742] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.238577] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.240367] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.241829] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.245630] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.440910] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.442571] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.446600] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.450471] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.594207] rustfs-bucket-start[1058]: mb s3://farm lb # [ 30.598940] systemd[1]: Finished rustfs-bucket.service. lb # [ 30.605516] systemd[1]: Starting niks3 server... worker1 # [ 30.643494] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.647500] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.648691] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.653310] nix-grpc-daemon[785]: ts=2026-09-22T10:55:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.823894] postgres[1074]: [1074] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 30.825543] postgres[1074]: [1074] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker1 # [ 30.848432] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.852482] nix-grpc-daemon[784]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.855654] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 lb # [ 30.864541] niks3-server[1067]: 2026/09/22 10:55:42 OK 20241026095416_initial_model.sql (20.51ms) worker2 # [ 30.859252] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.868068] niks3-server[1067]: 2026/09/22 10:55:42 OK 20251210153512_drop_unused_gin_index.sql (3.81ms) lb # [ 30.873348] niks3-server[1067]: 2026/09/22 10:55:42 OK 20251218171726_add_pins.sql (5.24ms) lb # [ 30.878277] niks3-server[1067]: 2026/09/22 10:55:42 OK 20260628120000_add_object_size_and_stats.sql (4.98ms) lb # [ 30.883155] niks3-server[1067]: 2026/09/22 10:55:42 OK 20260905000000_add_claims.sql (3.37ms) lb # [ 30.887427] niks3-server[1067]: 2026/09/22 10:55:42 OK 20260920000000_drop_claims.sql (4.16ms) lb # [ 30.888702] niks3-server[1067]: 2026/09/22 10:55:42 goose: successfully migrated database to version: 20260920000000 lb # [ 30.894179] niks3-server[1067]: 2026/09/22 10:55:42 OK 1_commit_pending_closure.sql (6.82ms) lb # [ 30.896673] niks3-server[1067]: 2026/09/22 10:55:42 OK 2_object_stats_trigger.sql (1.26ms) lb # [ 30.898032] niks3-server[1067]: 2026/09/22 10:55:42 goose: up to current file version: 2 lb # [ 30.904047] niks3-server[1067]: 2026/09/22 10:55:42 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key lb # [ 30.979287] niks3-server[1067]: 2026/09/22 10:55:42 INFO Read proxy enabled — serving cache objects from S3 lb # [ 30.981544] niks3-server[1067]: 2026/09/22 10:55:42 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 30.985974] systemd[1]: Started niks3 server. lb # [ 30.986695] niks3-server[1067]: 2026/09/22 10:55:42 INFO systemd watchdog enabled interval=15s lb # [ 30.987827] systemd[1]: Reached target Multi-User System. lb # [ 30.990651] systemd[1]: Startup finished in 859ms (kernel) + 4.075s (initrd) + 26.055s (userspace) = 30.989s. lb # [ 30.992679] niks3-server[1067]: 2026/09/22 10:55:42 INFO Starting HTTP server address=0.0.0.0:5751 worker1 # [ 31.054755] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.056413] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.057971] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.059926] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 20.61 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.05 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 31.225646] envoy[910]: conn peer=[::1]:36026 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds) worker1 # [ 31.255600] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.259196] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.261675] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.264798] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.354602] systemd[1]: Starting scheduler-token.service... worker2 # [ 31.424557] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 31.426249] systemd[1]: Finished scheduler-token.service. worker2 # [ 31.427457] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 72ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 31.459887] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.462306] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.464202] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.464077] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 31.664763] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.665417] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.668527] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.669224] nix-grpc-daemon[785]: ts=2026-09-22T10:55:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.869390] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.871226] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.873648] nix-grpc-daemon[784]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.875242] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.075444] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.075968] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.079476] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.079815] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.280517] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.280235] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.283672] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.284087] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.484496] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.486183] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.484809] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.488743] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 32.687168] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.689752] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.691072] nix-grpc-daemon[784]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.693671] nix-grpc-daemon[785]: ts=2026-09-22T10:55:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.892197] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.895969] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.896239] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.899529] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.096428] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.098321] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.100860] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.101542] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.298910] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.301784] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.302969] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.305532] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.503971] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.506389] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.508155] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.510157] nix-grpc-daemon[785]: ts=2026-09-22T10:55:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 33.709291] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.711373] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.713183] nix-grpc-daemon[784]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.715719] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.914146] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.917969] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.918070] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.921144] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.118925] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.119689] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.122761] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.123461] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.323855] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.324075] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.327571] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.327801] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.528065] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.528220] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.530110] nix-grpc-daemon[785]: ts=2026-09-22T10:55:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.530238] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 34.730736] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.732540] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.731609] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.734701] nix-grpc-daemon[784]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.932338] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.934249] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.935067] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.938534] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.135717] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.136184] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.140158] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.140127] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.340818] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.341111] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.344732] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.345757] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.545062] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.546165] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.546897] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.547961] nix-grpc-daemon[785]: ts=2026-09-22T10:55:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 35.747537] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.749335] nix-grpc-daemon[784]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.749319] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.753671] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 35.950320] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.954673] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.956272] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.954120] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.155791] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.157564] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.159744] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.161410] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.360479] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.362473] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.364477] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.366219] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.565264] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.566858] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.569478] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.570617] nix-grpc-daemon[785]: ts=2026-09-22T10:55:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.770343] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 36.771661] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.774593] nix-grpc-daemon[784]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.775801] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 36.974954] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.976800] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.978366] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.981564] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.178792] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.178492] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.180744] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.182555] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.381798] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.382887] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.384909] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.386851] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.585773] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.587610] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.589721] nix-grpc-daemon[785]: ts=2026-09-22T10:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.591517] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.791956] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.790681] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.793927] nix-grpc-daemon[784]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.794733] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 37.994923] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.996271] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.999093] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.000331] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.201290] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.200896] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.205248] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.204949] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.405251] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.406204] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.409167] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.410125] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.609877] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.611059] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.613879] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.615094] nix-grpc-daemon[785]: ts=2026-09-22T10:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.814191] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.815478] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.818105] nix-grpc-daemon[784]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.819432] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 39.018987] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.021726] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.023093] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.024909] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.222291] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.223997] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.225089] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.228164] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.425197] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.425390] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.429105] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.429151] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.627126] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.630563] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.631077] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.633668] nix-grpc-daemon[785]: ts=2026-09-22T10:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.831890] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.831970] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.835852] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.835901] nix-grpc-daemon[784]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 40.036533] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.037599] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.040525] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.041365] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.242403] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.242319] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.246339] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.246168] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.446683] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.447120] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.450467] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.450949] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.651349] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.652167] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.655329] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.656066] nix-grpc-daemon[785]: ts=2026-09-22T10:55:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.856318] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.856851] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.860253] nix-grpc-daemon[784]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.860675] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.002774] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_take_over lb # [ 41.006919] niks3-server[1067]: 2026/09/22 10:55:53 INFO lead: acquired remote=192.168.1.4:43780 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 41.061085] nix-grpc-daemon[784]: ts=2026-09-22T10:55:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.062325] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.065221] nix-grpc-daemon[784]: ts=2026-09-22T10:55:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.066197] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 41.266765] nix-grpc-daemon[784]: ts=2026-09-22T10:55:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.267401] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.270626] nix-grpc-daemon[784]: ts=2026-09-22T10:55:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.271463] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.471588] nix-grpc-daemon[784]: ts=2026-09-22T10:55:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.472479] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.475502] nix-grpc-daemon[784]: ts=2026-09-22T10:55:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.476383] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.676441] nix-grpc-daemon[784]: ts=2026-09-22T10:55:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.677608] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.689913] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45512 worker2 # [ 41.695415] nix-grpc-daemon[785]: ts=2026-09-22T10:55:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 41.716827] nix-grpc-daemon[785]: ts=2026-09-22T10:55:53Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 41.721509] nix-grpc-daemon[785]: ts=2026-09-22T10:55:53Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45512 worker2 # [ 41.725408] nix-grpc-daemon[785]: ts=2026-09-22T10:55:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 11.25 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 43.101909] nix-grpc-daemon[784]: ts=2026-09-22T10:55:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 43.112521] systemd[1]: Started Nix Daemon. worker1 # [ 43.321608] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 43.350119] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 1/5) worker1 # [ 43.415597] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 137 ms (attempt 2/5) worker1 # [ 43.552881] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 3/5) worker1 # [ 43.586304] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 4/5) worker1 # [ 43.763310] nix-grpc-daemon[784]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 43.767272] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 43.809493] nix-grpc-daemon[785]: ts=2026-09-22T10:55:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 43.821990] systemd[1]: Started Nix Daemon. worker2 # [ 44.036698] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 44.061872] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5) worker2 # [ 44.124470] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 2/5) worker2 # [ 44.318106] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 3/5) worker2 # [ 44.401996] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 737 ms (attempt 4/5) worker2 # [ 45.151682] nix-grpc-daemon[785]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 45.155852] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 45.176160] nix-grpc-daemon[785]: ts=2026-09-22T10:55:56Z level=debug event=path_info_miss path=32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test error="error: path '/nix/store/32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 45.197253] nix-grpc-daemon[785]: ts=2026-09-22T10:55:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 45.205984] nix-grpc-daemon[785]: ts=2026-09-22T10:55:56Z level=debug event=path_info_miss path=32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test error="error: path '/nix/store/32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds) client: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds) worker2 # [ 45.541922] nix-grpc-daemon[785]: ts=2026-09-22T10:55:56Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:55040 worker1 # [ 45.573105] nix-grpc-daemon[784]: ts=2026-09-22T10:55:57Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 45.576265] nix-grpc-daemon[784]: ts=2026-09-22T10:55:57Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:47832 worker2 # [ 45.593373] nix-grpc-daemon[785]: ts=2026-09-22T10:55:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:55040 worker1 # [ 45.590069] nix-grpc-daemon[784]: ts=2026-09-22T10:55:57Z level=debug event=path_info_miss path=32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test error="error: path '/nix/store/32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 45.601409] nix-grpc-daemon[785]: ts=2026-09-22T10:55:56Z level=debug event=path_info_miss path=32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test error="error: path '/nix/store/32wy8ar5zjxjxi6xl8k9avi2i4758n86-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds) worker2 # [ 45.842547] nix-grpc-daemon[785]: ts=2026-09-22T10:55:57Z level=info event=denied method=QueryMissing cn=- role=none lb # [ 46.046656] envoy[910]: conn peer=[2001:db8:1::1]:35196 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2152 lb # [ 46.050795] envoy[910]: conn peer=[2001:db8:1::1]:35206 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=70 lb # [ 46.054256] envoy[910]: conn peer=[2001:db8:1::1]:35212 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=14 worker2 # [ 46.067168] nix-grpc-daemon[785]: ts=2026-09-22T10:55:57Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.31 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker2 # [ 46.312889] nix-grpc-daemon[785]: ts=2026-09-22T10:55:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55040 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 46.325711] nix-grpc-daemon[784]: ts=2026-09-22T10:55:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 46.337146] nix-grpc-daemon[784]: E0000 00:00:1790074558.454409 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 46.369049] nix-grpc-daemon[784]: E0000 00:00:1790074558.486434 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 46.370244] nix-grpc-daemon[785]: ts=2026-09-22T10:55:57Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 46.375221] nix-grpc-daemon[785]: ts=2026-09-22T10:55:57Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 46.375296] nix-grpc-daemon[784]: E0000 00:00:1790074558.490932 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 46.395931] nix-grpc-daemon[784]: E0000 00:00:1790074558.513036 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 46.434372] nix-grpc-daemon[784]: ts=2026-09-22T10:55:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 46.457319] nix-grpc-daemon[784]: ts=2026-09-22T10:55:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 client # copying 1 paths to 'lb:50051'... worker1 # [ 46.471069] nix-grpc-daemon[784]: ts=2026-09-22T10:55:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 46.498698] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 46.524067] nix-grpc-daemon[784]: ts=2026-09-22T10:55:58Z level=info event=niks3_push_started pid=865 worker1 # [ 46.775892] nix-grpc-daemon[865]: time=2026-09-22T10:55:58.890Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 46.960484] nix-daemon[853]: accepted connection from pid 877, user nix-grpc-daemon (trusted) worker1 # [ 46.976061] nix-daemon[853]: reaped child process 880, status = succeeded worker1 # [ 47.122710] nix-daemon[853]: accepted connection from pid 882, user nix-grpc-daemon (trusted) worker1 # [ 47.137302] nix-daemon[853]: reaped child process 885, status = succeeded lb # [ 47.152558] niks3-server[1067]: 2026/09/22 10:55:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 47.171728] nix-grpc-daemon[865]: time=2026-09-22T10:55:59.289Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 47.173795] nix-grpc-daemon[865]: time=2026-09-22T10:55:59.291Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 47.213151] niks3-server[1067]: 2026/09/22 10:55:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 47.235072] niks3-server[1067]: 2026/09/22 10:55:59 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 47.244362] niks3-server[1067]: 2026/09/22 10:55:59 INFO Signed narinfos id=1 count=1 worker1 # [ 47.242381] nix-grpc-daemon[865]: time=2026-09-22T10:55:59.359Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.255378] niks3-server[1067]: 2026/09/22 10:55:59 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 47.261097] niks3-server[1067]: 2026/09/22 10:55:59 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 47.271993] niks3-server[1067]: 2026/09/22 10:55:59 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 47.277293] niks3-server[1067]: 2026/09/22 10:55:59 INFO Completed upload id=1 worker1 # [ 47.273733] nix-grpc-daemon[865]: time=2026-09-22T10:55:59.391Z level=INFO msg="Upload complete. (484ms)" worker1 # [ 47.280367] nix-grpc-daemon[784]: ts=2026-09-22T10:55:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 47.286258] nix-grpc-daemon[784]: ts=2026-09-22T10:55:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 47.299159] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 47.305838] nix-daemon[853]: reaped child process 863, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker1 # [ 47.315841] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 48.732916] nix-daemon[853]: reaped child process 889, status = succeeded worker1 # [ 48.875839] nix-daemon[853]: accepted connection from pid 906, user nix-grpc-daemon (trusted) worker1 # [ 48.887336] nix-daemon[853]: reaped child process 909, status = succeeded lb # [ 48.907768] niks3-server[1067]: 2026/09/22 10:56:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.915388] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.032Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.917064] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.034Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 48.959735] niks3-server[1067]: 2026/09/22 10:56:00 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 48.966536] niks3-server[1067]: 2026/09/22 10:56:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 48.972051] niks3-server[1067]: 2026/09/22 10:56:00 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker1 # [ 48.974581] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.091Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.977978] niks3-server[1067]: 2026/09/22 10:56:00 INFO Signed narinfos id=2 count=1 lb # [ 48.980712] niks3-server[1067]: 2026/09/22 10:56:00 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 48.991210] niks3-server[1067]: 2026/09/22 10:56:00 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 48.998104] niks3-server[1067]: 2026/09/22 10:56:00 INFO Completed upload id=2 lb # [ 49.000290] niks3-server[1067]: 2026/09/22 10:56:00 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker1 # [ 48.994537] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.111Z level=INFO msg="Upload complete. (267ms)" worker1 # [ 49.002253] nix-grpc-daemon[784]: ts=2026-09-22T10:56:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 49.014370] nix-daemon[853]: reaped child process 887, status = succeeded worker2 # [ 49.019378] nix-grpc-daemon[785]: ts=2026-09-22T10:56:00Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 49.023425] nix-grpc-daemon[785]: ts=2026-09-22T10:56:00Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.064100] nix-grpc-daemon[784]: ts=2026-09-22T10:56:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 49.076727] nix-grpc-daemon[784]: ts=2026-09-22T10:56:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 49.091072] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.208Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 49.098801] nix-grpc-daemon[784]: ts=2026-09-22T10:56:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 49.117369] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 49.294590] nix-daemon[853]: accepted connection from pid 913, user nix-grpc-daemon (trusted) worker1 # [ 49.307755] nix-daemon[853]: reaped child process 916, status = succeeded worker1 # [ 49.462722] nix-daemon[853]: accepted connection from pid 918, user nix-grpc-daemon (trusted) worker1 # [ 49.475232] nix-daemon[853]: reaped child process 921, status = succeeded lb # [ 49.492950] niks3-server[1067]: 2026/09/22 10:56:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.501873] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.619Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 49.503399] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.620Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 49.528344] niks3-server[1067]: 2026/09/22 10:56:01 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 49.537514] niks3-server[1067]: 2026/09/22 10:56:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 49.544494] niks3-server[1067]: 2026/09/22 10:56:01 INFO Signed narinfos id=3 count=1 worker1 # [ 49.543504] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.661Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.551055] niks3-server[1067]: 2026/09/22 10:56:01 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 49.560296] niks3-server[1067]: 2026/09/22 10:56:01 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 49.570357] niks3-server[1067]: 2026/09/22 10:56:01 INFO Completed upload id=3 lb # [ 49.572110] niks3-server[1067]: 2026/09/22 10:56:01 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 49.566800] nix-grpc-daemon[865]: time=2026-09-22T10:56:01.684Z level=INFO msg="Upload complete. (434ms)" worker1 # [ 49.572179] nix-grpc-daemon[784]: ts=2026-09-22T10:56:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 49.578324] nix-grpc-daemon[784]: ts=2026-09-22T10:56:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 49.589615] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 49.601429] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... worker1 # [ 49.603554] nix-daemon[853]: reaped child process 911, status = succeeded client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 50.829755] nix-daemon[853]: reaped child process 925, status = succeeded worker1 # [ 50.985635] nix-daemon[853]: accepted connection from pid 941, user nix-grpc-daemon (trusted) worker1 # [ 50.997996] nix-daemon[853]: reaped child process 944, status = succeeded lb # [ 51.019099] niks3-server[1067]: 2026/09/22 10:56:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.022032] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.139Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 51.023540] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.141Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 51.055888] niks3-server[1067]: 2026/09/22 10:56:03 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 51.062641] niks3-server[1067]: 2026/09/22 10:56:03 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 51.076054] niks3-server[1067]: 2026/09/22 10:56:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign worker1 # [ 51.078643] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.195Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.081991] niks3-server[1067]: 2026/09/22 10:56:03 INFO Signed narinfos id=4 count=1 lb # [ 51.085713] niks3-server[1067]: 2026/09/22 10:56:03 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 51.096234] niks3-server[1067]: 2026/09/22 10:56:03 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 51.099042] niks3-server[1067]: 2026/09/22 10:56:03 INFO Completed upload id=4 lb # [ 51.100591] niks3-server[1067]: 2026/09/22 10:56:03 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 51.095394] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.212Z level=INFO msg="Upload complete. (284ms)" worker2 # [ 51.105099] nix-grpc-daemon[785]: ts=2026-09-22T10:56:02Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker1 # [ 51.102141] nix-grpc-daemon[784]: ts=2026-09-22T10:56:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 51.106969] nix-grpc-daemon[785]: ts=2026-09-22T10:56:02Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.115549] nix-daemon[853]: reaped child process 923, status = succeeded worker1 # [ 51.149435] nix-grpc-daemon[784]: ts=2026-09-22T10:56:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 51.161147] nix-grpc-daemon[784]: ts=2026-09-22T10:56:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 51.174311] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.291Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 51.181314] nix-grpc-daemon[784]: ts=2026-09-22T10:56:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 51.192168] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 51.352114] nix-daemon[853]: accepted connection from pid 948, user nix-grpc-daemon (trusted) worker1 # [ 51.364350] nix-daemon[853]: reaped child process 951, status = succeeded worker1 # [ 51.519633] nix-daemon[853]: accepted connection from pid 953, user nix-grpc-daemon (trusted) worker1 # [ 51.531595] nix-daemon[853]: reaped child process 956, status = succeeded lb # [ 51.551182] niks3-server[1067]: 2026/09/22 10:56:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.557853] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.675Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 51.559248] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.675Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 51.585458] niks3-server[1067]: 2026/09/22 10:56:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 51.588928] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.706Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.592864] niks3-server[1067]: 2026/09/22 10:56:03 INFO Signed narinfos id=5 count=1 lb # [ 51.597766] niks3-server[1067]: 2026/09/22 10:56:03 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 51.602969] niks3-server[1067]: 2026/09/22 10:56:03 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 51.615829] niks3-server[1067]: 2026/09/22 10:56:03 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 51.622621] niks3-server[1067]: 2026/09/22 10:56:03 INFO Completed upload id=5 worker1 # [ 51.621198] nix-grpc-daemon[865]: time=2026-09-22T10:56:03.738Z level=INFO msg="Upload complete. (417ms)" lb # [ 51.625211] niks3-server[1067]: 2026/09/22 10:56:03 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 51.625116] nix-grpc-daemon[784]: ts=2026-09-22T10:56:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 51.630365] nix-grpc-daemon[784]: ts=2026-09-22T10:56:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 51.639540] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 51.647932] nix-daemon[853]: reaped child process 946, status = succeeded worker1 # [ 51.653273] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 52.676834] nix-daemon[853]: reaped child process 960, status = succeeded worker1 # [ 52.814858] nix-daemon[853]: accepted connection from pid 976, user nix-grpc-daemon (trusted) worker1 # [ 52.826721] nix-daemon[853]: reaped child process 979, status = succeeded lb # [ 52.847396] niks3-server[1067]: 2026/09/22 10:56:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.852985] nix-grpc-daemon[865]: time=2026-09-22T10:56:04.970Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 52.854648] nix-grpc-daemon[865]: time=2026-09-22T10:56:04.971Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 52.891563] niks3-server[1067]: 2026/09/22 10:56:04 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 52.897117] niks3-server[1067]: 2026/09/22 10:56:04 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 52.909491] niks3-server[1067]: 2026/09/22 10:56:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 52.915568] niks3-server[1067]: 2026/09/22 10:56:04 INFO Signed narinfos id=6 count=1 worker1 # [ 52.914272] nix-grpc-daemon[865]: time=2026-09-22T10:56:05.031Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.918203] niks3-server[1067]: 2026/09/22 10:56:04 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 52.927683] niks3-server[1067]: 2026/09/22 10:56:04 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 52.931711] niks3-server[1067]: 2026/09/22 10:56:04 INFO Completed upload id=6 worker1 # [ 52.927868] nix-grpc-daemon[865]: time=2026-09-22T10:56:05.045Z level=INFO msg="Upload complete. (265ms)" lb # [ 52.932973] niks3-server[1067]: 2026/09/22 10:56:04 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 52.930662] nix-grpc-daemon[784]: ts=2026-09-22T10:56:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 52.937275] nix-daemon[853]: reaped child process 958, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.88 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.42 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.21 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker1 # [ 54.207993] nix-grpc-daemon[784]: ts=2026-09-22T10:56:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47832 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 54.221679] nix-grpc-daemon[784]: ts=2026-09-22T10:56:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 54.227437] nix-grpc-daemon[865]: time=2026-09-22T10:56:06.344Z level=INFO msg="All 2 paths already cached" worker2 # [ 54.239539] nix-grpc-daemon[785]: ts=2026-09-22T10:56:05Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.27 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.16 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: worker1 # [ 55.020738] nix-grpc-daemon[784]: ts=2026-09-22T10:56:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47832 client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 55.025324] nix-grpc-daemon[785]: ts=2026-09-22T10:56:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 55.046243] nix-grpc-daemon[785]: ts=2026-09-22T10:56:06Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 55.048129] nix-grpc-daemon[785]: ts=2026-09-22T10:56:06Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 55.095921] nix-grpc-daemon[784]: ts=2026-09-22T10:56:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 55.108539] nix-grpc-daemon[784]: ts=2026-09-22T10:56:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 55.121318] nix-grpc-daemon[865]: time=2026-09-22T10:56:07.238Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 55.129068] nix-grpc-daemon[784]: ts=2026-09-22T10:56:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 55.137891] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 55.309362] nix-daemon[853]: accepted connection from pid 996, user nix-grpc-daemon (trusted) worker1 # [ 55.322732] nix-daemon[853]: reaped child process 999, status = succeeded worker1 # [ 55.477238] nix-daemon[853]: accepted connection from pid 1001, user nix-grpc-daemon (trusted) worker1 # [ 55.489570] nix-daemon[853]: reaped child process 1004, status = succeeded lb # [ 55.507664] niks3-server[1067]: 2026/09/22 10:56:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.508680] nix-grpc-daemon[865]: time=2026-09-22T10:56:07.625Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 55.510213] nix-grpc-daemon[865]: time=2026-09-22T10:56:07.627Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 55.525644] niks3-server[1067]: 2026/09/22 10:56:07 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 55.528471] niks3-server[1067]: 2026/09/22 10:56:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 55.530738] niks3-server[1067]: 2026/09/22 10:56:07 INFO Signed narinfos id=7 count=1 worker1 # [ 55.526830] nix-grpc-daemon[865]: time=2026-09-22T10:56:07.644Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.533495] niks3-server[1067]: 2026/09/22 10:56:07 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 55.537477] niks3-server[1067]: 2026/09/22 10:56:07 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 55.541028] niks3-server[1067]: 2026/09/22 10:56:07 INFO Completed upload id=7 worker1 # [ 55.537145] nix-grpc-daemon[865]: time=2026-09-22T10:56:07.654Z level=INFO msg="Upload complete. (385ms)" lb # [ 55.543674] niks3-server[1067]: 2026/09/22 10:56:07 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 55.539822] nix-grpc-daemon[784]: ts=2026-09-22T10:56:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 55.542299] nix-grpc-daemon[784]: ts=2026-09-22T10:56:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 55.549372] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 55.551150] nix-daemon[853]: reaped child process 994, status = succeeded worker1 # [ 55.556178] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 56.046911] envoy[910]: conn peer=[2001:db8:1::1]:35218 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 lb # [ 56.050723] envoy[910]: conn peer=[2001:db8:1::1]:35228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9554 tx=4068 ms=6663 lb # [ 56.054267] envoy[910]: conn peer=[2001:db8:1::1]:41910 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=44 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 56.972627] nix-daemon[853]: reaped child process 1008, status = succeeded worker1 # [ 57.104815] nix-daemon[853]: accepted connection from pid 1024, user nix-grpc-daemon (trusted) worker1 # [ 57.116860] nix-daemon[853]: reaped child process 1027, status = succeeded lb # [ 57.136615] niks3-server[1067]: 2026/09/22 10:56:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.141700] nix-grpc-daemon[865]: time=2026-09-22T10:56:09.258Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 57.143752] nix-grpc-daemon[865]: time=2026-09-22T10:56:09.260Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 57.179165] niks3-server[1067]: 2026/09/22 10:56:09 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 57.188279] niks3-server[1067]: 2026/09/22 10:56:09 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 57.192453] niks3-server[1067]: 2026/09/22 10:56:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 57.197373] niks3-server[1067]: 2026/09/22 10:56:09 INFO Signed narinfos id=8 count=1 worker1 # [ 57.196467] nix-grpc-daemon[865]: time=2026-09-22T10:56:09.313Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.204581] niks3-server[1067]: 2026/09/22 10:56:09 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 57.214327] niks3-server[1067]: 2026/09/22 10:56:09 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 57.219093] niks3-server[1067]: 2026/09/22 10:56:09 INFO Completed upload id=8 worker1 # [ 57.217465] nix-grpc-daemon[865]: time=2026-09-22T10:56:09.334Z level=INFO msg="Upload complete. (253ms)" lb # [ 57.222840] niks3-server[1067]: 2026/09/22 10:56:09 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 57.219850] nix-grpc-daemon[784]: ts=2026-09-22T10:56:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 57.226860] nix-daemon[853]: reaped child process 1006, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.45 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.95 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 57.684303] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 2f14bb8dca5548e782e90fb410bbd44e client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 57.898802] nix[889]: don't know how to build these paths: client # [ 57.899761] nix[889]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 57.885439] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 57.896538] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 57.902889] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.909148] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 57.925120] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 client # [ 57.948149] nix[889]: copying 1 paths to 'lb:50051'... worker2 # [ 57.936135] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 client # [ 57.949088] nix[889]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 57.947632] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 57.965686] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=info event=niks3_push_started pid=923 worker2 # [ 58.204853] nix-grpc-daemon[923]: time=2026-09-22T10:56:09.501Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 58.395087] nix-daemon[873]: accepted connection from pid 935, user nix-grpc-daemon (trusted) worker2 # [ 58.410732] nix-daemon[873]: reaped child process 938, status = succeeded worker2 # [ 58.576161] nix-daemon[873]: accepted connection from pid 941, user nix-grpc-daemon (trusted) worker2 # [ 58.588423] nix-daemon[873]: reaped child process 944, status = succeeded lb # [ 58.610275] niks3-server[1067]: 2026/09/22 10:56:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 58.612404] nix-grpc-daemon[923]: time=2026-09-22T10:56:09.911Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 58.614477] nix-grpc-daemon[923]: time=2026-09-22T10:56:09.913Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 58.636718] niks3-server[1067]: 2026/09/22 10:56:10 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 58.639975] niks3-server[1067]: 2026/09/22 10:56:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 58.641970] niks3-server[1067]: 2026/09/22 10:56:10 INFO Signed narinfos id=9 count=1 worker2 # [ 58.638443] nix-grpc-daemon[923]: time=2026-09-22T10:56:09.937Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.650117] niks3-server[1067]: 2026/09/22 10:56:10 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 58.653062] niks3-server[1067]: 2026/09/22 10:56:10 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 58.656221] niks3-server[1067]: 2026/09/22 10:56:10 INFO Completed upload id=9 worker2 # [ 58.652584] nix-grpc-daemon[923]: time=2026-09-22T10:56:09.951Z level=INFO msg="Upload complete. (434ms)" worker2 # [ 58.654579] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 58.659027] niks3-server[1067]: 2026/09/22 10:56:10 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 58.658046] nix-grpc-daemon[785]: ts=2026-09-22T10:56:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 58.665109] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 58.666362] nix-daemon[873]: reaped child process 921, status = succeeded worker2 # [ 58.671614] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # [ 58.683319] nix[889]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 58.762361] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: e7cd6ba1bece45289a37147c448e4255 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds) worker2 # [ 59.010354] nix-grpc-daemon[785]: ts=2026-09-22T10:56:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55040 client # [ 59.029373] nix[905]: this derivation will be built: worker2 # [ 59.017282] nix-grpc-daemon[785]: ts=2026-09-22T10:56:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55040 client # [ 59.034202] nix[905]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 59.029589] nix-grpc-daemon[785]: ts=2026-09-22T10:56:10Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 client # [ 59.047565] nix[905]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker2 # [ 59.034744] nix-grpc-daemon[785]: ts=2026-09-22T10:56:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.05 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 62.286870] nix-daemon[873]: reaped child process 948, status = succeeded worker2 # [ 62.441291] nix-daemon[873]: accepted connection from pid 980, user nix-grpc-daemon (trusted) worker2 # [ 62.452125] nix-daemon[873]: reaped child process 983, status = succeeded lb # [ 62.473975] niks3-server[1067]: 2026/09/22 10:56:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.478133] nix-grpc-daemon[923]: time=2026-09-22T10:56:13.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 62.479848] nix-grpc-daemon[923]: time=2026-09-22T10:56:13.779Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 62.511172] niks3-server[1067]: 2026/09/22 10:56:14 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 62.526278] niks3-server[1067]: 2026/09/22 10:56:14 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 62.535898] niks3-server[1067]: 2026/09/22 10:56:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 62.542426] niks3-server[1067]: 2026/09/22 10:56:14 INFO Signed narinfos id=10 count=1 worker2 # [ 62.539427] nix-grpc-daemon[923]: time=2026-09-22T10:56:13.838Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.546095] niks3-server[1067]: 2026/09/22 10:56:14 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 62.556320] niks3-server[1067]: 2026/09/22 10:56:14 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 62.560048] niks3-server[1067]: 2026/09/22 10:56:14 INFO Completed upload id=10 worker2 # [ 62.556634] nix-grpc-daemon[923]: time=2026-09-22T10:56:13.855Z level=INFO msg="Upload complete. (275ms)" lb # [ 62.561849] niks3-server[1067]: 2026/09/22 10:56:14 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 62.562922] nix-grpc-daemon[785]: ts=2026-09-22T10:56:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 62.569229] nix-grpc-daemon[785]: ts=2026-09-22T10:56:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 62.579494] nix-daemon[873]: reaped child process 946, status = succeeded client # [ 62.621595] systemd[1]: dedup2.service: Deactivated successfully. client # [ 62.627598] systemd[1]: dedup2.service: Consumed 140ms CPU time over 3.863s wall clock time, 35.2M memory peak, 6.2K incoming IP traffic, 5.9K outgoing IP traffic. client # [ 62.665275] systemd[1]: dedup1.service: Deactivated successfully. client # [ 62.666297] systemd[1]: dedup1.service: Consumed 119ms CPU time over 4.982s wall clock time, 41.4M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.96 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 63.790537] nix-grpc-daemon[785]: ts=2026-09-22T10:56:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 63.802159] nix-grpc-daemon[785]: ts=2026-09-22T10:56:15Z level=debug event=want client=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 63.806219] nix-grpc-daemon[785]: ts=2026-09-22T10:56:15Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 63.846581] nix-grpc-daemon[784]: ts=2026-09-22T10:56:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 63.859270] nix-grpc-daemon[784]: ts=2026-09-22T10:56:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 63.873089] nix-grpc-daemon[784]: ts=2026-09-22T10:56:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 63.881672] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 64.045320] nix-daemon[853]: accepted connection from pid 1052, user nix-grpc-daemon (trusted) worker1 # [ 64.058957] nix-daemon[853]: reaped child process 1055, status = succeeded worker1 # [ 64.208214] nix-daemon[853]: accepted connection from pid 1057, user nix-grpc-daemon (trusted) worker1 # [ 64.219726] nix-daemon[853]: reaped child process 1060, status = succeeded lb # [ 64.238951] niks3-server[1067]: 2026/09/22 10:56:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.244318] nix-grpc-daemon[865]: time=2026-09-22T10:56:16.361Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 64.245634] nix-grpc-daemon[865]: time=2026-09-22T10:56:16.361Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 64.270853] niks3-server[1067]: 2026/09/22 10:56:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 64.273655] nix-grpc-daemon[865]: time=2026-09-22T10:56:16.391Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.277602] niks3-server[1067]: 2026/09/22 10:56:16 INFO Signed narinfos id=11 count=1 lb # [ 64.288965] niks3-server[1067]: 2026/09/22 10:56:16 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 64.350490] niks3-server[1067]: 2026/09/22 10:56:16 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 64.358170] niks3-server[1067]: 2026/09/22 10:56:16 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst worker1 # [ 64.369579] nix-grpc-daemon[865]: time=2026-09-22T10:56:16.487Z level=INFO msg="Upload complete. (474ms)" lb # [ 64.373567] niks3-server[1067]: 2026/09/22 10:56:16 INFO Completed upload id=11 worker1 # [ 64.372069] nix-grpc-daemon[784]: ts=2026-09-22T10:56:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 64.375186] nix-grpc-daemon[784]: ts=2026-09-22T10:56:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 64.381586] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) lb # [ 64.383513] niks3-server[1067]: 2026/09/22 10:56:16 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker1 # [ 64.384080] nix-daemon[853]: reaped child process 1050, status = succeeded worker1 # [ 64.388867] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) lb # [ 66.047142] envoy[910]: conn peer=[2001:db8:1::1]:41922 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4169 tx=1806 ms=2212 lb # [ 66.048757] envoy[910]: conn peer=[2001:db8:1::1]:41948 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1576 tx=1373 ms=3574 lb # [ 66.050208] envoy[910]: conn peer=[2001:db8:1::1]:41938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3011 tx=1451 ms=4738 worker1 # [ 70.602977] nix-grpc-daemon[784]: ts=2026-09-22T10:56:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=6 outputs=0 worker1 # [ 70.625617] nix-daemon[853]: reaped child process 1062, status = succeeded worker1 # [ 70.628148] nix-daemon[853]: reaped child process 1064, status = succeeded worker2 # [ 70.846825] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 70.857161] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=debug event=want client=7 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 70.863437] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 70.869461] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 70.882162] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 70.893661] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 70.905375] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 71.082771] nix-daemon[873]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker2 # [ 71.096203] nix-daemon[873]: reaped child process 1003, status = succeeded worker2 # [ 71.243814] nix-daemon[873]: accepted connection from pid 1005, user nix-grpc-daemon (trusted) worker2 # [ 71.254582] nix-daemon[873]: reaped child process 1008, status = succeeded lb # [ 71.271337] niks3-server[1067]: 2026/09/22 10:56:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.276164] nix-grpc-daemon[923]: time=2026-09-22T10:56:22.575Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 71.277873] nix-grpc-daemon[923]: time=2026-09-22T10:56:22.575Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 71.303944] niks3-server[1067]: 2026/09/22 10:56:23 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 71.311688] niks3-server[1067]: 2026/09/22 10:56:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker2 # [ 71.315027] nix-grpc-daemon[923]: time=2026-09-22T10:56:22.614Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.319236] niks3-server[1067]: 2026/09/22 10:56:23 INFO Signed narinfos id=12 count=1 lb # [ 71.326251] niks3-server[1067]: 2026/09/22 10:56:23 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 71.337768] niks3-server[1067]: 2026/09/22 10:56:23 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 71.344560] niks3-server[1067]: 2026/09/22 10:56:23 INFO Completed upload id=12 worker2 # [ 71.340986] nix-grpc-daemon[923]: time=2026-09-22T10:56:22.640Z level=INFO msg="Upload complete. (424ms)" lb # [ 71.347510] niks3-server[1067]: 2026/09/22 10:56:23 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker2 # [ 71.344727] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 71.350331] nix-grpc-daemon[785]: ts=2026-09-22T10:56:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 71.359886] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 71.368657] nix-daemon[873]: reaped child process 998, status = succeeded worker2 # [ 71.371590] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) lb # [ 76.048365] envoy[910]: conn peer=[2001:db8:1::1]:32934 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2983 tx=972 ms=6825 worker2 # [ 77.383227] nix-grpc-daemon[785]: ts=2026-09-22T10:56:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=7 outputs=0 worker2 # [ 77.394670] nix-daemon[873]: reaped child process 1012, status = succeeded worker2 # [ 77.395617] nix-daemon[873]: reaped child process 1010, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.89 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share client # [ 77.507575] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 5ab07be6bde84268921ea95db0b9d3bb client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share worker1 # [ 77.691687] nix-grpc-daemon[784]: ts=2026-09-22T10:56:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47832 client # [ 77.709867] nix[978]: don't know how to build these paths: client # [ 77.711329] nix[978]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 77.703836] nix-grpc-daemon[785]: ts=2026-09-22T10:56:29Z level=debug event=want client=8 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 77.705803] nix-grpc-daemon[785]: ts=2026-09-22T10:56:29Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 77.707850] nix-grpc-daemon[784]: ts=2026-09-22T10:56:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 77.718315] nix-grpc-daemon[784]: ts=2026-09-22T10:56:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 client # [ 77.739882] nix[978]: copying 1 paths to 'lb:50051'... client # [ 77.740694] nix[978]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker1 # [ 77.727817] nix-grpc-daemon[784]: ts=2026-09-22T10:56:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 77.739091] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 77.882827] nix-daemon[853]: accepted connection from pid 1087, user nix-grpc-daemon (trusted) worker1 # [ 77.895100] nix-daemon[853]: reaped child process 1090, status = succeeded worker1 # [ 78.033521] nix-daemon[853]: accepted connection from pid 1092, user nix-grpc-daemon (trusted) worker1 # [ 78.045477] nix-daemon[853]: reaped child process 1095, status = succeeded lb # [ 78.065089] niks3-server[1067]: 2026/09/22 10:56:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.067556] nix-grpc-daemon[865]: time=2026-09-22T10:56:30.184Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 78.069087] nix-grpc-daemon[865]: time=2026-09-22T10:56:30.186Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 78.093920] niks3-server[1067]: 2026/09/22 10:56:30 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 78.106142] niks3-server[1067]: 2026/09/22 10:56:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 78.109603] nix-grpc-daemon[865]: time=2026-09-22T10:56:30.226Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.113487] niks3-server[1067]: 2026/09/22 10:56:30 INFO Signed narinfos id=13 count=1 lb # [ 78.120940] niks3-server[1067]: 2026/09/22 10:56:30 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 78.132611] niks3-server[1067]: 2026/09/22 10:56:30 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 78.179827] niks3-server[1067]: 2026/09/22 10:56:30 INFO Completed upload id=13 worker1 # [ 78.176005] nix-grpc-daemon[865]: time=2026-09-22T10:56:30.293Z level=INFO msg="Upload complete. (425ms)" lb # [ 78.182201] niks3-server[1067]: 2026/09/22 10:56:30 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker1 # [ 78.180730] nix-grpc-daemon[784]: ts=2026-09-22T10:56:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 78.187093] nix-grpc-daemon[784]: ts=2026-09-22T10:56:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 78.198157] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 78.212577] nix-daemon[853]: reaped child process 1085, status = succeeded client # [ 78.229111] nix[978]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker1 # [ 78.218102] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # [ 78.570776] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 665cc26dd03c4c6f92c1f833785f33cb client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share, in 1.08 seconds) client # [ 78.774374] nix[994]: don't know how to build these paths: client # [ 78.775348] nix[994]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 78.760907] nix-grpc-daemon[785]: ts=2026-09-22T10:56:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 78.767121] nix-grpc-daemon[785]: ts=2026-09-22T10:56:30Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 78.769445] nix-grpc-daemon[784]: ts=2026-09-22T10:56:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 client # [ 78.784858] nix[994]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 81.855730] systemd[1]: share1.service: Sent signal SIGINT to main process 978 (nix) on client request. client # [ 81.865260] nix[978]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 81.873775] nix[978]: error: interrupted by the user client # [ 81.912609] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 81.914175] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 81.916389] systemd[1]: share1.service: Consumed 114ms CPU time over 4.408s wall clock time, 41.4M memory peak, 6.1K incoming IP traffic, 8.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 0.05 seconds) client: waiting for success: ! systemctl is-active share2 worker1 # [ 82.253955] nix-daemon[853]: reaped child process 1099, status = succeeded worker1 # [ 82.404868] nix-daemon[853]: accepted connection from pid 1133, user nix-grpc-daemon (trusted) worker1 # [ 82.416839] nix-daemon[853]: reaped child process 1136, status = succeeded lb # [ 82.436728] niks3-server[1067]: 2026/09/22 10:56:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.442187] nix-grpc-daemon[865]: time=2026-09-22T10:56:34.559Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 82.445059] nix-grpc-daemon[865]: time=2026-09-22T10:56:34.561Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 82.474536] niks3-server[1067]: 2026/09/22 10:56:34 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 82.490157] niks3-server[1067]: 2026/09/22 10:56:34 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 82.499166] niks3-server[1067]: 2026/09/22 10:56:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 82.500070] nix-grpc-daemon[865]: time=2026-09-22T10:56:34.617Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.503574] niks3-server[1067]: 2026/09/22 10:56:34 INFO Signed narinfos id=14 count=1 lb # [ 82.508485] niks3-server[1067]: 2026/09/22 10:56:34 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 82.518590] niks3-server[1067]: 2026/09/22 10:56:34 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 82.521039] niks3-server[1067]: 2026/09/22 10:56:34 INFO Completed upload id=14 worker1 # [ 82.518771] nix-grpc-daemon[865]: time=2026-09-22T10:56:34.636Z level=INFO msg="Upload complete. (286ms)" lb # [ 82.523917] niks3-server[1067]: 2026/09/22 10:56:34 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker1 # [ 82.521800] nix-grpc-daemon[784]: ts=2026-09-22T10:56:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=8 outputs=1 worker1 # [ 82.525137] nix-grpc-daemon[784]: ts=2026-09-22T10:56:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=8 outputs=1 worker1 # [ 82.531198] nix-daemon[853]: reaped child process 1097, status = succeeded client # [ 82.559118] systemd[1]: share2.service: Deactivated successfully. client # [ 82.561290] systemd[1]: share2.service: Consumed 115ms CPU time over 3.990s wall clock time, 35.4M memory peak, 5.8K incoming IP traffic, 5.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 5.77 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 83.417770] systemd[1]: Started Nix Daemon. client # [ 83.576870] nix-daemon[1040]: accepted connection from pid 1037, user root (trusted) worker1 # [ 83.750485] nix-grpc-daemon[784]: ts=2026-09-22T10:56:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:47832 worker2 # [ 83.755619] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 83.765928] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=debug event=want client=10 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 83.769710] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 83.772711] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 83.781119] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 83.789801] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 83.798215] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 83.978042] nix-daemon[873]: accepted connection from pid 1057, user nix-grpc-daemon (trusted) worker2 # [ 83.997129] nix-daemon[873]: reaped child process 1060, status = succeeded worker2 # [ 84.180249] nix-daemon[873]: accepted connection from pid 1062, user nix-grpc-daemon (trusted) worker2 # [ 84.200206] nix-daemon[873]: reaped child process 1065, status = succeeded lb # [ 84.219703] niks3-server[1067]: 2026/09/22 10:56:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 84.313158] nix-grpc-daemon[923]: time=2026-09-22T10:56:35.612Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 84.315488] nix-grpc-daemon[923]: time=2026-09-22T10:56:35.614Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 84.331856] niks3-server[1067]: 2026/09/22 10:56:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 84.334816] niks3-server[1067]: 2026/09/22 10:56:36 INFO Signed narinfos id=15 count=1 worker2 # [ 84.331230] nix-grpc-daemon[923]: time=2026-09-22T10:56:35.630Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.340872] niks3-server[1067]: 2026/09/22 10:56:36 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 84.346238] niks3-server[1067]: 2026/09/22 10:56:36 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 84.349198] niks3-server[1067]: 2026/09/22 10:56:36 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 84.360287] niks3-server[1067]: 2026/09/22 10:56:36 INFO Completed upload id=15 worker2 # [ 84.356408] nix-grpc-daemon[923]: time=2026-09-22T10:56:35.655Z level=INFO msg="Upload complete. (550ms)" worker2 # [ 84.358975] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 84.365384] niks3-server[1067]: 2026/09/22 10:56:36 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker2 # [ 84.362140] nix-grpc-daemon[785]: ts=2026-09-22T10:56:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 84.370070] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 84.374507] nix-daemon[873]: reaped child process 1055, status = succeeded worker2 # [ 84.380155] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 85.399916] nix-daemon[873]: reaped child process 1069, status = succeeded worker2 # [ 85.562141] nix-daemon[873]: accepted connection from pid 1085, user nix-grpc-daemon (trusted) worker2 # [ 85.580880] nix-daemon[873]: reaped child process 1088, status = succeeded lb # [ 85.596836] niks3-server[1067]: 2026/09/22 10:56:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.599577] nix-grpc-daemon[923]: time=2026-09-22T10:56:36.898Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 85.602749] nix-grpc-daemon[923]: time=2026-09-22T10:56:36.900Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 85.624504] niks3-server[1067]: 2026/09/22 10:56:37 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 85.628840] niks3-server[1067]: 2026/09/22 10:56:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 85.634510] niks3-server[1067]: 2026/09/22 10:56:37 INFO Signed narinfos id=16 count=1 worker2 # [ 85.631273] nix-grpc-daemon[923]: time=2026-09-22T10:56:36.930Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.637526] niks3-server[1067]: 2026/09/22 10:56:37 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 85.641303] niks3-server[1067]: 2026/09/22 10:56:37 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 85.648037] niks3-server[1067]: 2026/09/22 10:56:37 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 85.654847] niks3-server[1067]: 2026/09/22 10:56:37 INFO Completed upload id=16 worker2 # [ 85.651389] nix-grpc-daemon[923]: time=2026-09-22T10:56:36.950Z level=INFO msg="Upload complete. (262ms)" lb # [ 85.656924] niks3-server[1067]: 2026/09/22 10:56:37 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker2 # [ 85.655534] nix-grpc-daemon[785]: ts=2026-09-22T10:56:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=9 outputs=1 worker2 # [ 85.665787] nix-daemon[873]: reaped child process 1067, status = succeeded worker1 # [ 85.704374] nix-grpc-daemon[784]: ts=2026-09-22T10:56:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 85.715102] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 85.745676] nix-grpc-daemon[784]: ts=2026-09-22T10:56:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 85.749699] nix-grpc-daemon[784]: ts=2026-09-22T10:56:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 86.016693] nix-grpc-daemon[784]: ts=2026-09-22T10:56:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 86.020563] nix-grpc-daemon[784]: ts=2026-09-22T10:56:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 86.024265] nix-grpc-daemon[865]: time=2026-09-22T10:56:38.141Z level=INFO msg="All 1 paths already cached" worker2 # [ 86.037984] nix-grpc-daemon[785]: ts=2026-09-22T10:56:37Z level=debug event=want client=11 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 86.040505] nix-grpc-daemon[785]: ts=2026-09-22T10:56:37Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=1 lb # [ 86.049394] envoy[910]: conn peer=[2001:db8:1::1]:32940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2982 tx=977 ms=6549 lb # [ 86.051344] envoy[910]: conn peer=[2001:db8:1::1]:59350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2982 tx=812 ms=4179 lb # [ 86.053739] envoy[910]: conn peer=[2001:db8:1::1]:59364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=3772 lb # [ 86.055719] envoy[910]: conn peer=[2001:db8:1::1]:41766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=58 lb # [ 86.057471] envoy[910]: conn peer=[2001:db8:1::1]:41764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1850 ms=2054 worker2 # [ 86.083244] nix-grpc-daemon[785]: ts=2026-09-22T10:56:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 86.093419] nix-grpc-daemon[785]: ts=2026-09-22T10:56:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 86.102438] nix-grpc-daemon[923]: time=2026-09-22T10:56:37.401Z level=INFO msg="All 1 paths already cached" worker2 # [ 86.107473] nix-grpc-daemon[785]: ts=2026-09-22T10:56:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 86.114067] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 86.287898] nix-daemon[873]: accepted connection from pid 1094, user nix-grpc-daemon (trusted) worker2 # [ 86.305138] nix-daemon[873]: reaped child process 1097, status = succeeded worker2 # [ 86.468070] nix-daemon[873]: accepted connection from pid 1099, user nix-grpc-daemon (trusted) worker2 # [ 86.482096] nix-daemon[873]: reaped child process 1102, status = succeeded lb # [ 86.497244] niks3-server[1067]: 2026/09/22 10:56:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.503605] nix-grpc-daemon[923]: time=2026-09-22T10:56:37.802Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 86.505152] nix-grpc-daemon[923]: time=2026-09-22T10:56:37.802Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 86.529236] niks3-server[1067]: 2026/09/22 10:56:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 86.539164] niks3-server[1067]: 2026/09/22 10:56:38 INFO Signed narinfos id=17 count=1 worker2 # [ 86.540261] nix-grpc-daemon[923]: time=2026-09-22T10:56:37.839Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.553922] niks3-server[1067]: 2026/09/22 10:56:38 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 86.789687] niks3-server[1067]: 2026/09/22 10:56:38 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 86.804736] niks3-server[1067]: 2026/09/22 10:56:38 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 86.818890] niks3-server[1067]: 2026/09/22 10:56:38 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo lb # [ 86.822197] niks3-server[1067]: 2026/09/22 10:56:38 INFO Completed upload id=17 worker2 # [ 86.819200] nix-grpc-daemon[923]: time=2026-09-22T10:56:38.118Z level=INFO msg="Upload complete. (697ms)" worker2 # [ 86.822470] nix-grpc-daemon[785]: ts=2026-09-22T10:56:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 86.827384] nix-grpc-daemon[785]: ts=2026-09-22T10:56:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 86.831733] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 86.841183] nix-daemon[873]: reaped child process 1092, status = succeeded worker2 # [ 86.845566] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 87.459791] nix-daemon[873]: reaped child process 1106, status = succeeded worker2 # [ 87.610759] nix-daemon[873]: accepted connection from pid 1122, user nix-grpc-daemon (trusted) worker2 # [ 87.625367] nix-daemon[873]: reaped child process 1125, status = succeeded lb # [ 87.643438] niks3-server[1067]: 2026/09/22 10:56:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.649086] nix-grpc-daemon[923]: time=2026-09-22T10:56:38.948Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 87.651690] nix-grpc-daemon[923]: time=2026-09-22T10:56:38.950Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 87.687632] niks3-server[1067]: 2026/09/22 10:56:39 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 87.698156] niks3-server[1067]: 2026/09/22 10:56:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 87.703109] niks3-server[1067]: 2026/09/22 10:56:39 INFO Signed narinfos id=18 count=1 worker2 # [ 87.702663] nix-grpc-daemon[923]: time=2026-09-22T10:56:39.001Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.708702] niks3-server[1067]: 2026/09/22 10:56:39 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 87.717550] niks3-server[1067]: 2026/09/22 10:56:39 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 87.726986] niks3-server[1067]: 2026/09/22 10:56:39 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 87.731078] niks3-server[1067]: 2026/09/22 10:56:39 INFO Completed upload id=18 worker2 # [ 87.727537] nix-grpc-daemon[923]: time=2026-09-22T10:56:39.026Z level=INFO msg="Upload complete. (272ms)" lb # [ 87.733957] niks3-server[1067]: 2026/09/22 10:56:39 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker2 # [ 87.730417] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=10 outputs=1 worker2 # [ 87.737255] nix-daemon[873]: reaped child process 1104, status = succeeded worker1 # [ 87.777890] nix-grpc-daemon[784]: ts=2026-09-22T10:56:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 87.790610] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 87.824498] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 87.830569] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 88.060332] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55040 worker1 # [ 88.062875] nix-grpc-daemon[784]: ts=2026-09-22T10:56:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 88.070503] nix-grpc-daemon[865]: time=2026-09-22T10:56:40.187Z level=INFO msg="All 2 paths already cached" worker2 # [ 88.083247] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=want client=12 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 88.088770] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 88.096373] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 88.110813] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 88.125099] nix-grpc-daemon[923]: time=2026-09-22T10:56:39.423Z level=INFO msg="All 2 paths already cached" worker2 # [ 88.132953] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 88.142330] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 88.309695] nix-daemon[873]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker2 # [ 88.324678] nix-daemon[873]: reaped child process 1134, status = succeeded worker2 # [ 88.481851] nix-daemon[873]: accepted connection from pid 1136, user nix-grpc-daemon (trusted) worker2 # [ 88.496676] nix-daemon[873]: reaped child process 1139, status = succeeded lb # [ 88.510305] niks3-server[1067]: 2026/09/22 10:56:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.511931] nix-grpc-daemon[923]: time=2026-09-22T10:56:39.811Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 88.513540] nix-grpc-daemon[923]: time=2026-09-22T10:56:39.811Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 88.526351] niks3-server[1067]: 2026/09/22 10:56:40 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 88.532801] niks3-server[1067]: 2026/09/22 10:56:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 88.536580] niks3-server[1067]: 2026/09/22 10:56:40 INFO Signed narinfos id=19 count=1 worker2 # [ 88.535864] nix-grpc-daemon[923]: time=2026-09-22T10:56:39.834Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.545591] niks3-server[1067]: 2026/09/22 10:56:40 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 88.551787] niks3-server[1067]: 2026/09/22 10:56:40 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 88.555082] niks3-server[1067]: 2026/09/22 10:56:40 INFO Completed upload id=19 worker2 # [ 88.551450] nix-grpc-daemon[923]: time=2026-09-22T10:56:39.850Z level=INFO msg="Upload complete. (395ms)" worker2 # [ 88.553817] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 88.558305] niks3-server[1067]: 2026/09/22 10:56:40 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker2 # [ 88.557541] nix-grpc-daemon[785]: ts=2026-09-22T10:56:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 88.563183] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 88.569221] nix-daemon[873]: reaped child process 1129, status = succeeded worker2 # [ 88.575477] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 89.204856] nix-daemon[873]: reaped child process 1143, status = succeeded worker2 # [ 89.337893] nix-daemon[873]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker2 # [ 89.353363] nix-daemon[873]: reaped child process 1162, status = succeeded lb # [ 89.368224] niks3-server[1067]: 2026/09/22 10:56:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.374192] nix-grpc-daemon[923]: time=2026-09-22T10:56:40.673Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 89.378268] nix-grpc-daemon[923]: time=2026-09-22T10:56:40.675Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 89.416512] niks3-server[1067]: 2026/09/22 10:56:41 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 89.426400] niks3-server[1067]: 2026/09/22 10:56:41 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 89.437507] niks3-server[1067]: 2026/09/22 10:56:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 89.443525] niks3-server[1067]: 2026/09/22 10:56:41 INFO Signed narinfos id=20 count=1 worker2 # [ 89.442844] nix-grpc-daemon[923]: time=2026-09-22T10:56:40.742Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.446793] niks3-server[1067]: 2026/09/22 10:56:41 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 89.457366] niks3-server[1067]: 2026/09/22 10:56:41 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 89.461314] niks3-server[1067]: 2026/09/22 10:56:41 INFO Completed upload id=20 worker2 # [ 89.457739] nix-grpc-daemon[923]: time=2026-09-22T10:56:40.756Z level=INFO msg="Upload complete. (275ms)" lb # [ 89.463300] niks3-server[1067]: 2026/09/22 10:56:41 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker2 # [ 89.464732] nix-grpc-daemon[785]: ts=2026-09-22T10:56:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=11 outputs=1 worker2 # [ 89.477934] nix-daemon[873]: reaped child process 1141, status = succeeded worker1 # [ 89.508068] nix-grpc-daemon[784]: ts=2026-09-22T10:56:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 89.515825] nix-grpc-daemon[784]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker1 # [ 89.533856] nix-grpc-daemon[784]: ts=2026-09-22T10:56:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 89.536100] nix-grpc-daemon[784]: ts=2026-09-22T10:56:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_out=232 client # [ 89.662427] nix-daemon[1040]: reaped child process 1042, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.41 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.48 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.35 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 90.610929] nix-daemon[1040]: accepted connection from pid 1123, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker1 # [ 90.768717] nix-grpc-daemon[784]: ts=2026-09-22T10:56:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:47832 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 90.772218] nix-grpc-daemon[785]: ts=2026-09-22T10:56:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 client # copying 1 paths... client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 90.782824] nix-grpc-daemon[785]: ts=2026-09-22T10:56:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 90.789322] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 90.948198] nix-daemon[873]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 90.963151] nix-daemon[873]: reaped child process 1172, status = succeeded lb # [ 90.981964] niks3-server[1067]: 2026/09/22 10:56:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.984406] nix-grpc-daemon[923]: time=2026-09-22T10:56:42.283Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 90.986487] nix-grpc-daemon[923]: time=2026-09-22T10:56:42.285Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 91.011333] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 91.025921] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 91.029556] niks3-server[1067]: 2026/09/22 10:56:43 INFO Signed narinfos id=21 count=1 worker2 # [ 91.028908] nix-grpc-daemon[923]: time=2026-09-22T10:56:42.328Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.034500] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 91.041374] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 91.046244] niks3-server[1067]: 2026/09/22 10:56:43 INFO Completed upload id=21 worker2 # [ 91.042738] nix-grpc-daemon[923]: time=2026-09-22T10:56:42.342Z level=INFO msg="Upload complete. (247ms)" worker2 # [ 91.045162] nix-grpc-daemon[785]: ts=2026-09-22T10:56:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_in=120 lb # [ 91.050424] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 91.054586] nix-daemon[873]: reaped child process 1167, status = succeeded worker2 # [ 91.059802] nix-grpc-daemon[785]: ts=2026-09-22T10:56:42Z level=debug event=want client=13 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 91.062164] nix-grpc-daemon[785]: ts=2026-09-22T10:56:42Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 91.063949] nix-grpc-daemon[784]: ts=2026-09-22T10:56:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 91.072117] nix-grpc-daemon[784]: ts=2026-09-22T10:56:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 91.081867] nix-grpc-daemon[784]: ts=2026-09-22T10:56:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 91.086892] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 91.218161] nix-daemon[853]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker1 # [ 91.232643] nix-daemon[853]: reaped child process 1151, status = succeeded worker1 # [ 91.374522] nix-daemon[853]: accepted connection from pid 1153, user nix-grpc-daemon (trusted) worker1 # [ 91.389071] nix-daemon[853]: reaped child process 1156, status = succeeded lb # [ 91.403262] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 91.414583] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 91.422280] nix-grpc-daemon[865]: time=2026-09-22T10:56:43.539Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 91.424646] nix-grpc-daemon[865]: time=2026-09-22T10:56:43.541Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker1 # [ 91.426321] nix-grpc-daemon[865]: time=2026-09-22T10:56:43.541Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 91.454310] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 91.464982] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 91.469063] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 91.471487] niks3-server[1067]: 2026/09/22 10:56:43 INFO Signed narinfos id=22 count=1 lb # [ 91.475910] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 91.478382] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 91.480782] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 91.482287] niks3-server[1067]: 2026/09/22 10:56:43 INFO Signed narinfos id=23 count=2 worker1 # [ 91.477798] nix-grpc-daemon[865]: time=2026-09-22T10:56:43.594Z level=INFO msg="Uploading 3 narinfos" lb # [ 91.503754] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 91.506684] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 91.511078] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 91.514688] niks3-server[1067]: 2026/09/22 10:56:43 INFO Completed upload id=22 lb # [ 91.515990] niks3-server[1067]: 2026/09/22 10:56:43 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 91.519256] niks3-server[1067]: 2026/09/22 10:56:43 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 91.522293] niks3-server[1067]: 2026/09/22 10:56:43 INFO Completed upload id=23 worker1 # [ 91.518647] nix-grpc-daemon[865]: time=2026-09-22T10:56:43.636Z level=INFO msg="Upload complete. (424ms)" worker1 # [ 91.524160] nix-grpc-daemon[784]: ts=2026-09-22T10:56:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=2 nar_bytes_in=976 worker1 # [ 91.529828] nix-grpc-daemon[784]: ts=2026-09-22T10:56:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 91.540972] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 91.545606] nix-daemon[853]: reaped child process 1146, status = succeeded worker1 # [ 91.549946] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 92.369692] nix-daemon[853]: reaped child process 1160, status = succeeded worker1 # [ 92.497275] nix-daemon[853]: accepted connection from pid 1176, user nix-grpc-daemon (trusted) worker1 # [ 92.510744] nix-daemon[853]: reaped child process 1179, status = succeeded lb # [ 92.525703] niks3-server[1067]: 2026/09/22 10:56:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 92.529983] nix-grpc-daemon[865]: time=2026-09-22T10:56:44.647Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 92.558714] niks3-server[1067]: 2026/09/22 10:56:44 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 92.564551] niks3-server[1067]: 2026/09/22 10:56:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 92.572968] niks3-server[1067]: 2026/09/22 10:56:44 INFO Signed narinfos id=24 count=1 worker1 # [ 92.573453] nix-grpc-daemon[865]: time=2026-09-22T10:56:44.690Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.581968] niks3-server[1067]: 2026/09/22 10:56:44 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 92.594728] niks3-server[1067]: 2026/09/22 10:56:44 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 92.598043] niks3-server[1067]: 2026/09/22 10:56:44 INFO Completed upload id=24 worker1 # [ 92.594570] nix-grpc-daemon[865]: time=2026-09-22T10:56:44.711Z level=INFO msg="Upload complete. (235ms)" lb # [ 92.599907] niks3-server[1067]: 2026/09/22 10:56:44 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker1 # [ 92.599482] nix-grpc-daemon[784]: ts=2026-09-22T10:56:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=12 outputs=1 worker1 # [ 92.610714] nix-daemon[853]: reaped child process 1158, status = succeeded client # copying 1 paths... worker1 # [ 92.645148] nix-grpc-daemon[784]: ts=2026-09-22T10:56:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47832 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 92.657370] nix-grpc-daemon[784]: ts=2026-09-22T10:56:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 92.659041] nix-grpc-daemon[784]: ts=2026-09-22T10:56:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_out=120 client # [ 92.768126] nix-daemon[1040]: reaped child process 1126, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.29 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 92.910344] nix-daemon[1040]: accepted connection from pid 1145, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 93.053232] nix-grpc-daemon[784]: ts=2026-09-22T10:56:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 93.056204] nix-grpc-daemon[784]: ts=2026-09-22T10:56:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 93.061084] nix-grpc-daemon[865]: time=2026-09-22T10:56:45.178Z level=INFO msg="All 1 paths already cached" worker2 # [ 93.077310] nix-grpc-daemon[785]: ts=2026-09-22T10:56:44Z level=debug event=want client=14 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 93.082500] nix-grpc-daemon[785]: ts=2026-09-22T10:56:44Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 93.119793] nix-grpc-daemon[785]: ts=2026-09-22T10:56:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 93.131479] nix-grpc-daemon[785]: ts=2026-09-22T10:56:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55040 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 93.145626] nix-grpc-daemon[785]: ts=2026-09-22T10:56:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 93.157417] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 93.173073] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5) worker2 # [ 93.245965] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5) worker2 # [ 93.319686] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 3/5) worker2 # [ 93.384537] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 787 ms (attempt 4/5) worker2 # [ 94.175701] nix-grpc-daemon[785]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 94.179938] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 94.185230] nix-grpc-daemon[785]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 94.341236] nix-daemon[873]: accepted connection from pid 1185, user nix-grpc-daemon (trusted) worker2 # [ 94.354357] nix-daemon[873]: reaped child process 1188, status = succeeded worker2 # [ 94.498983] nix-daemon[873]: accepted connection from pid 1190, user nix-grpc-daemon (trusted) worker2 # [ 94.510789] nix-daemon[873]: reaped child process 1193, status = succeeded lb # [ 94.526619] niks3-server[1067]: 2026/09/22 10:56:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 94.532850] nix-grpc-daemon[923]: time=2026-09-22T10:56:45.832Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 94.534717] nix-grpc-daemon[923]: time=2026-09-22T10:56:45.833Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 94.549196] niks3-server[1067]: 2026/09/22 10:56:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 94.553659] niks3-server[1067]: 2026/09/22 10:56:46 INFO Signed narinfos id=25 count=1 worker2 # [ 94.549841] nix-grpc-daemon[923]: time=2026-09-22T10:56:45.849Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.556927] niks3-server[1067]: 2026/09/22 10:56:46 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 94.559896] niks3-server[1067]: 2026/09/22 10:56:46 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 94.565062] niks3-server[1067]: 2026/09/22 10:56:46 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 94.569054] niks3-server[1067]: 2026/09/22 10:56:46 INFO Completed upload id=25 worker2 # [ 94.565398] nix-grpc-daemon[923]: time=2026-09-22T10:56:45.864Z level=INFO msg="Upload complete. (359ms)" worker2 # [ 94.567323] nix-grpc-daemon[785]: ts=2026-09-22T10:56:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 94.572314] niks3-server[1067]: 2026/09/22 10:56:46 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker2 # [ 94.571115] nix-grpc-daemon[785]: ts=2026-09-22T10:56:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 94.578486] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 94.580385] nix-daemon[873]: reaped child process 1178, status = succeeded worker2 # [ 94.585352] nix-daemon[873]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 95.799779] nix-daemon[873]: reaped child process 1197, status = succeeded worker2 # [ 95.932603] nix-daemon[873]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker2 # [ 95.944539] nix-daemon[873]: reaped child process 1216, status = succeeded lb # [ 95.960979] niks3-server[1067]: 2026/09/22 10:56:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.966054] nix-grpc-daemon[923]: time=2026-09-22T10:56:47.265Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 95.985505] niks3-server[1067]: 2026/09/22 10:56:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 95.989499] niks3-server[1067]: 2026/09/22 10:56:47 INFO Signed narinfos id=26 count=1 worker2 # [ 95.986028] nix-grpc-daemon[923]: time=2026-09-22T10:56:47.285Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.993590] niks3-server[1067]: 2026/09/22 10:56:47 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 95.997550] niks3-server[1067]: 2026/09/22 10:56:47 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 96.004779] niks3-server[1067]: 2026/09/22 10:56:48 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 96.009554] niks3-server[1067]: 2026/09/22 10:56:48 INFO Completed upload id=26 worker2 # [ 96.005955] nix-grpc-daemon[923]: time=2026-09-22T10:56:47.305Z level=INFO msg="Upload complete. (212ms)" lb # [ 96.012347] niks3-server[1067]: 2026/09/22 10:56:48 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker2 # [ 96.009192] nix-grpc-daemon[785]: ts=2026-09-22T10:56:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=13 outputs=1 worker2 # [ 96.016366] nix-daemon[873]: reaped child process 1195, status = succeeded lb # [ 96.049825] envoy[910]: conn peer=[2001:db8:1::1]:41782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=2070 ms=1825 lb # [ 96.051626] envoy[910]: conn peer=[2001:db8:1::1]:41798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=21 lb # [ 96.053332] envoy[910]: conn peer=[2001:db8:1::1]:41806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=49 lb # [ 96.055916] envoy[910]: conn peer=[2001:db8:1::1]:41804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2299 ms=1525 lb # [ 96.057780] envoy[910]: conn peer=[2001:db8:1::1]:41814 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4209 tx=1828 ms=1941 lb # [ 96.059715] envoy[910]: conn peer=[2001:db8:1::1]:41828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=49 client # copying 1 paths... worker2 # [ 96.061083] nix-grpc-daemon[785]: ts=2026-09-22T10:56:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55040 client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 96.076587] nix-grpc-daemon[785]: ts=2026-09-22T10:56:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 96.078287] nix-grpc-daemon[785]: ts=2026-09-22T10:56:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_out=120 client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.43 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 96.248498] nix-daemon[1040]: reaped child process 1148, status = succeeded client # [ 96.374866] nix-daemon[1040]: accepted connection from pid 1167, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 96.528767] nix-grpc-daemon[785]: ts=2026-09-22T10:56:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55040 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 96.532236] nix-grpc-daemon[784]: ts=2026-09-22T10:56:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 96.538815] nix-grpc-daemon[865]: time=2026-09-22T10:56:48.656Z level=INFO msg="All 1 paths already cached" worker2 # [ 96.548144] nix-grpc-daemon[785]: ts=2026-09-22T10:56:47Z level=debug event=want client=15 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker1 # [ 96.549917] nix-grpc-daemon[784]: ts=2026-09-22T10:56:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker2 # [ 96.550195] nix-grpc-daemon[785]: ts=2026-09-22T10:56:47Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 96.556765] nix-grpc-daemon[784]: ts=2026-09-22T10:56:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 96.563796] nix-grpc-daemon[865]: time=2026-09-22T10:56:48.681Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 96.567926] nix-grpc-daemon[784]: ts=2026-09-22T10:56:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 96.573215] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 96.725219] nix-daemon[853]: accepted connection from pid 1183, user nix-grpc-daemon (trusted) worker1 # [ 96.740533] nix-daemon[853]: reaped child process 1186, status = succeeded worker1 # [ 96.891615] nix-daemon[853]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 96.904973] nix-daemon[853]: reaped child process 1191, status = succeeded lb # [ 96.918579] niks3-server[1067]: 2026/09/22 10:56:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 96.927224] nix-grpc-daemon[865]: time=2026-09-22T10:56:49.044Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 96.928657] nix-grpc-daemon[865]: time=2026-09-22T10:56:49.044Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 96.944920] niks3-server[1067]: 2026/09/22 10:56:48 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 96.950523] niks3-server[1067]: 2026/09/22 10:56:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 96.954207] niks3-server[1067]: 2026/09/22 10:56:48 INFO Signed narinfos id=27 count=1 worker1 # [ 96.952497] nix-grpc-daemon[865]: time=2026-09-22T10:56:49.069Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.956763] niks3-server[1067]: 2026/09/22 10:56:48 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 96.965054] niks3-server[1067]: 2026/09/22 10:56:48 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 96.968734] niks3-server[1067]: 2026/09/22 10:56:48 INFO Completed upload id=27 worker1 # [ 96.964847] nix-grpc-daemon[865]: time=2026-09-22T10:56:49.082Z level=INFO msg="Upload complete. (386ms)" lb # [ 96.971648] niks3-server[1067]: 2026/09/22 10:56:48 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker1 # [ 96.967197] nix-grpc-daemon[784]: ts=2026-09-22T10:56:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=0 paths=1 nar_bytes_in=560 worker1 # [ 96.972341] nix-grpc-daemon[784]: ts=2026-09-22T10:56:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 96.979357] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 96.982215] nix-daemon[853]: reaped child process 1181, status = succeeded client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 96.988524] nix-daemon[853]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 98.205205] nix-daemon[853]: reaped child process 1195, status = succeeded worker1 # [ 98.311395] nix-daemon[853]: accepted connection from pid 1211, user nix-grpc-daemon (trusted) worker1 # [ 98.323330] nix-daemon[853]: reaped child process 1214, status = succeeded lb # [ 98.341469] niks3-server[1067]: 2026/09/22 10:56:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.344555] nix-grpc-daemon[865]: time=2026-09-22T10:56:50.461Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 98.359031] niks3-server[1067]: 2026/09/22 10:56:50 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 98.362057] niks3-server[1067]: 2026/09/22 10:56:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 98.364239] niks3-server[1067]: 2026/09/22 10:56:50 INFO Signed narinfos id=28 count=1 worker1 # [ 98.360508] nix-grpc-daemon[865]: time=2026-09-22T10:56:50.477Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.368682] niks3-server[1067]: 2026/09/22 10:56:50 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 98.371934] niks3-server[1067]: 2026/09/22 10:56:50 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 98.375365] niks3-server[1067]: 2026/09/22 10:56:50 INFO Completed upload id=28 worker1 # [ 98.371590] nix-grpc-daemon[865]: time=2026-09-22T10:56:50.489Z level=INFO msg="Upload complete. (175ms)" lb # [ 98.376908] niks3-server[1067]: 2026/09/22 10:56:50 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker1 # [ 98.374681] nix-grpc-daemon[784]: ts=2026-09-22T10:56:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47832 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=14 outputs=1 client # copying 1 paths... worker1 # [ 98.381318] nix-daemon[853]: reaped child process 1193, status = succeeded worker2 # [ 98.380811] nix-grpc-daemon[785]: ts=2026-09-22T10:56:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 98.387852] nix-grpc-daemon[785]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 98.405145] nix-grpc-daemon[785]: ts=2026-09-22T10:56:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55040 worker2 # [ 98.408089] nix-grpc-daemon[785]: ts=2026-09-22T10:56:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55040 duration_s=0 paths=1 nar_bytes_out=120 client # [ 98.510236] nix-daemon[1040]: reaped child process 1170, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.32 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 8.79 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.36 seconds) client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.17 seconds) worker2 # [ 99.615878] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 100.514673] nix-grpc-daemon[785]: ts=2026-09-22T10:56:51Z level=info event=signal_exit lb # [ 100.804981] niks3-server[1067]: 2026/09/22 10:56:52 INFO lead: released remote=192.168.1.4:43780 lb # [ 101.002710] niks3-server[1067]: 2026/09/22 10:56:53 INFO lead: acquired remote=192.168.1.3:36544 worker1 # [ 101.003937] nix-grpc-daemon[784]: ts=2026-09-22T10:56:53Z level=info event=scheduler_take_over worker1 # [ 101.803316] nix-grpc-daemon[784]: ts=2026-09-22T10:56:53Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 101.805937] nix-grpc-daemon[785]: ts=2026-09-22T10:56:53Z level=info event=scheduler_restarting worker2 # [ 101.810941] nix-grpc-daemon[785]: ts=2026-09-22T10:56:53Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 101.814433] nix-grpc-daemon[785]: ts=2026-09-22T10:56:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45512 worker2 # [ 101.818199] nix-grpc-daemon[785]: ts=2026-09-22T10:56:53Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 101.821726] nix-grpc-daemon[785]: ts=2026-09-22T10:56:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45512 worker2 # [ 101.825371] nix-grpc-daemon[785]: ts=2026-09-22T10:56:53Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 101.893201] nix-daemon[873]: reaped child process 875, status = succeeded worker1 # [ 102.004518] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.006270] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.014158] nix-grpc-daemon[785]: ts=2026-09-22T10:56:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 102.207450] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.211473] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.411882] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.413678] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.614660] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.627551] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:46228 worker1 # [ 102.632881] nix-grpc-daemon[784]: ts=2026-09-22T10:56:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 102.670130] nix-grpc-daemon[785]: E0000 00:00:1790074613.969196 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 102.675581] nix-grpc-daemon[785]: E0000 00:00:1790074613.969363 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 103.656893] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 103.661865] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 103.665296] systemd[1]: nix-grpc-daemon.service: Consumed 2.421s CPU time over 1min 26.433s wall clock time, 57.2M memory peak, 87.8K incoming IP traffic, 270.8K outgoing IP traffic. worker2 # [ 103.677208] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 103.680886] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 103.683477] systemd[1]: nix-grpc-daemon.socket: Consumed 304us CPU time over 1min 34.533s wall clock time, 256K memory peak, 103K incoming IP traffic, 83.6K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 103.978723] nix-grpc-daemon[784]: ts=2026-09-22T10:56:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47832 worker1 # [ 103.982585] nix-grpc-daemon[784]: ts=2026-09-22T10:56:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47832 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 104.066200] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 104.132696] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 104.340471] nix-grpc-daemon[784]: ts=2026-09-22T10:56:56Z level=info event=signal_exit lb # [ 104.648603] niks3-server[1067]: 2026/09/22 10:56:56 INFO lead: released remote=192.168.1.3:36544 worker2 # [ 104.645856] systemd[1]: Starting scheduler-token.service... worker2 # [ 104.735890] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 104.738042] systemd[1]: Finished scheduler-token.service. worker2 # [ 104.741239] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 92ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 104.745737] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 104.914572] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 104.916773] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 104.920738] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 104.927068] nix-grpc-daemon[1243]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 104.928414] nix-grpc-daemon[1243]: E0000 00:00:1790074616.226380 1243 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 104.933412] nix-grpc-daemon[1243]: E0000 00:00:1790074616.231997 1243 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 104.938209] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 104.942143] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 104.953973] niks3-server[1067]: 2026/09/22 10:56:56 INFO lead: acquired remote=192.168.1.4:34476 worker2 # [ 104.950464] nix-grpc-daemon[1243]: E0000 00:00:1790074616.249883 1283 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 104.954181] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_take_over worker2 # [ 104.964335] nix-grpc-daemon[1243]: E0000 00:00:1790074616.263647 1283 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 104.968202] nix-grpc-daemon[1243]: E0000 00:00:1790074616.265975 1283 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 104.979074] nix-grpc-daemon[1243]: E0000 00:00:1790074616.278352 1283 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 104.988315] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.189955] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.193981] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.395330] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.399471] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.600822] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.604904] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.644762] nix-grpc-daemon[784]: ts=2026-09-22T10:56:57Z level=info event=scheduler_restarting worker1 # [ 105.647560] nix-grpc-daemon[784]: ts=2026-09-22T10:56:57Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 105.649366] nix-grpc-daemon[784]: ts=2026-09-22T10:56:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:46228 worker1 # [ 105.650844] nix-grpc-daemon[784]: ts=2026-09-22T10:56:57Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 105.666499] nix-daemon[853]: reaped child process 855, status = succeeded worker2 # [ 105.806103] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.810139] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.851526] nix-grpc-daemon[784]: ts=2026-09-22T10:56:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 106.012159] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.024156] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:57Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 106.028731] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:47082 worker2 # [ 106.032588] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 106.049677] envoy[910]: conn peer=[2001:db8:1::1]:34832 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=50 lb # [ 106.051541] envoy[910]: conn peer=[2001:db8:1::1]:34824 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3745 tx=1924 ms=3074 lb # [ 106.053179] envoy[910]: conn peer=[2001:db8:1::1]:34848 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3746 tx=1984 ms=1930 lb # [ 106.054810] envoy[910]: conn peer=[2001:db8:1::1]:34856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=51 lb # [ 106.056356] envoy[910]: conn peer=[2001:db8:1::4]:32896 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=99674 tx=4686 ms=84433 lb # [ 106.058139] envoy[910]: conn peer=[2001:db8:1::1]:48170 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=14 lb # [ 106.059708] envoy[910]: conn peer=192.168.1.3:53184 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=26226 tx=4958 ms=88492 worker1 # [ 106.521588] nix-grpc-daemon[784]: E0000 00:00:1790074618.638872 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 106.526480] nix-grpc-daemon[784]: E0000 00:00:1790074618.639014 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 107.594602] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 107.599717] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 107.602430] systemd[1]: nix-grpc-daemon.service: Consumed 2.695s CPU time over 1min 31.557s wall clock time, 62.3M memory peak, 94.2K incoming IP traffic, 178.8K outgoing IP traffic. worker1 # [ 107.614366] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 107.617850] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 107.620691] systemd[1]: nix-grpc-daemon.socket: Consumed 314us CPU time over 1min 38.337s wall clock time, 256K memory peak, 95.6K incoming IP traffic, 79.7K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 107.911614] nix-grpc-daemon[1243]: ts=2026-09-22T10:56:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 107.918053] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 107.927328] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5) worker2 # [ 107.974041] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 2/5) worker2 # [ 108.017987] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 325 ms (attempt 3/5) worker2 # [ 108.349363] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 540 ms (attempt 4/5) worker2 # [ 108.895688] nix-grpc-daemon[1243]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 108.899656] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 108.925785] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 108.939969] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 108.963522] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:00Z level=info event=niks3_push_started pid=1303 worker2 # [ 109.129094] nix-grpc-daemon[1303]: time=2026-09-22T10:57:00.427Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 109.276127] nix-daemon[873]: accepted connection from pid 1316, user nix-grpc-daemon (trusted) worker2 # [ 109.290967] nix-daemon[873]: reaped child process 1319, status = succeeded lb # [ 109.310935] niks3-server[1067]: 2026/09/22 10:57:01 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 109.319901] niks3-server[1067]: 2026/09/22 10:57:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 109.324262] nix-grpc-daemon[1303]: time=2026-09-22T10:57:00.623Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 109.327957] nix-grpc-daemon[1303]: time=2026-09-22T10:57:00.625Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 109.329575] nix-grpc-daemon[1303]: time=2026-09-22T10:57:00.625Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 109.371395] niks3-server[1067]: 2026/09/22 10:57:01 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 109.395314] niks3-server[1067]: 2026/09/22 10:57:01 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 109.401633] niks3-server[1067]: 2026/09/22 10:57:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 109.404322] niks3-server[1067]: 2026/09/22 10:57:01 INFO Signed narinfos id=30 count=2 lb # [ 109.408063] niks3-server[1067]: 2026/09/22 10:57:01 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 109.410932] niks3-server[1067]: 2026/09/22 10:57:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 109.414928] niks3-server[1067]: 2026/09/22 10:57:01 INFO Signed narinfos id=29 count=1 worker2 # [ 109.412116] nix-grpc-daemon[1303]: time=2026-09-22T10:57:00.710Z level=INFO msg="Uploading 3 narinfos" lb # [ 109.418292] niks3-server[1067]: 2026/09/22 10:57:01 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 109.433300] niks3-server[1067]: 2026/09/22 10:57:01 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 109.438171] niks3-server[1067]: 2026/09/22 10:57:01 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 109.445647] niks3-server[1067]: 2026/09/22 10:57:01 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 109.448902] niks3-server[1067]: 2026/09/22 10:57:01 INFO Completed upload id=30 lb # [ 109.450533] niks3-server[1067]: 2026/09/22 10:57:01 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 109.454881] niks3-server[1067]: 2026/09/22 10:57:01 INFO Completed upload id=29 worker2 # [ 109.451343] nix-grpc-daemon[1303]: time=2026-09-22T10:57:00.750Z level=INFO msg="Upload complete. (318ms)" worker2 # [ 109.454130] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 duration_s=0 paths=2 nar_bytes_in=312 lb # [ 109.458157] niks3-server[1067]: 2026/09/22 10:57:01 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo worker2 # [ 109.461766] nix-daemon[873]: reaped child process 1301, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.80 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 109.561751] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 109.568236] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 109.723383] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 109.725799] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 109.729778] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 109.736068] nix-grpc-daemon[1237]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 109.739118] nix-grpc-daemon[1237]: E0000 00:00:1790074621.853442 1237 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 109.741335] nix-grpc-daemon[1237]: E0000 00:00:1790074621.856561 1237 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 109.748746] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 109.752761] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 109.758085] nix-grpc-daemon[1237]: E0000 00:00:1790074621.875120 1278 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 109.773354] nix-grpc-daemon[1237]: E0000 00:00:1790074621.890812 1278 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 109.778058] nix-grpc-daemon[1237]: E0000 00:00:1790074621.893145 1278 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 109.787675] nix-grpc-daemon[1237]: E0000 00:00:1790074621.905109 1278 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 109.798211] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.800920] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:01Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:47082 worker2 # [ 109.802900] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.32 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb # [ 109.967385] niks3-server[1067]: 2026/09/22 10:57:01 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 109.971143] systemd[1]: Stopping niks3 server... worker2 # [ 109.968142] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:01Z level=info event=scheduler_lock_lost status=200 worker1 # [ 109.967755] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:02Z level=info event=scheduler_lock_lost status=200 lb # [ 109.975786] niks3-server[1067]: 2026/09/22 10:57:01 INFO lead: released remote=192.168.1.4:34476 lb # [ 109.987293] systemd[1]: niks3.service: Deactivated successfully. lb # [ 109.989403] systemd[1]: Stopped niks3 server. lb # [ 109.990235] systemd[1]: niks3.service: Consumed 635ms CPU time over 1min 19.383s wall clock time, 21.2M memory peak, 77.1K incoming IP traffic, 112.8K outgoing IP traffic. lb # [ 109.999696] systemd[1]: Starting niks3 server... lb # [ 110.076628] niks3-server[1201]: 2026/09/22 10:57:02 goose: no migrations to run. current version: 20260920000000 lb # [ 110.085161] niks3-server[1201]: 2026/09/22 10:57:02 OK 1_commit_pending_closure.sql (6.7ms) lb # [ 110.089391] niks3-server[1201]: 2026/09/22 10:57:02 OK 2_object_stats_trigger.sql (3.8ms) lb # [ 110.090489] niks3-server[1201]: 2026/09/22 10:57:02 goose: up to current file version: 2 lb # [ 110.092146] niks3-server[1201]: 2026/09/22 10:57:02 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key lb # [ 110.106827] niks3-server[1201]: 2026/09/22 10:57:02 INFO Read proxy enabled — serving cache objects from S3 lb # [ 110.108218] niks3-server[1201]: 2026/09/22 10:57:02 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 110.111430] systemd[1]: Started niks3 server. lb # [ 110.112123] niks3-server[1201]: 2026/09/22 10:57:02 INFO systemd watchdog enabled interval=15s lb # [ 110.114459] niks3-server[1201]: 2026/09/22 10:57:02 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 110.640515] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47090 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 110.653171] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 110.664802] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 110.682650] nix-grpc-daemon[1237]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 1/5) worker1 # [ 110.784321] nix-grpc-daemon[1237]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5) worker1 # [ 110.792786] nix-grpc-daemon[1237]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 235 ms (attempt 3/5) lb # [ 110.975763] niks3-server[1201]: 2026/09/22 10:57:02 INFO lead: acquired remote=192.168.1.4:34538 worker1 # [ 111.033587] nix-grpc-daemon[1237]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 178 ms (attempt 4/5) worker1 # [ 111.217899] nix-grpc-daemon[1237]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 111.220838] nix-grpc-daemon[1237]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 111.267163] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:02Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 111.271238] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:02Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 111.310525] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 111.326503] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47090 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 111.339840] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 111.349868] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 111.551437] nix-daemon[873]: accepted connection from pid 1338, user nix-grpc-daemon (trusted) worker2 # [ 111.567387] nix-daemon[873]: reaped child process 1341, status = succeeded worker2 # [ 111.750534] nix-daemon[873]: accepted connection from pid 1343, user nix-grpc-daemon (trusted) worker2 # [ 111.766322] nix-daemon[873]: reaped child process 1346, status = succeeded lb # [ 111.783553] niks3-server[1201]: 2026/09/22 10:57:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 111.792951] nix-grpc-daemon[1303]: time=2026-09-22T10:57:03.091Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 111.794387] nix-grpc-daemon[1303]: time=2026-09-22T10:57:03.091Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 111.826379] niks3-server[1201]: 2026/09/22 10:57:03 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 111.831431] niks3-server[1201]: 2026/09/22 10:57:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 111.848494] niks3-server[1201]: 2026/09/22 10:57:03 INFO Signed narinfos id=31 count=1 worker2 # [ 111.845610] nix-grpc-daemon[1303]: time=2026-09-22T10:57:03.144Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.859085] niks3-server[1201]: 2026/09/22 10:57:03 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 111.868084] niks3-server[1201]: 2026/09/22 10:57:03 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 111.871127] niks3-server[1201]: 2026/09/22 10:57:03 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo lb # [ 111.875349] niks3-server[1201]: 2026/09/22 10:57:03 INFO Completed upload id=31 worker2 # [ 111.871962] nix-grpc-daemon[1303]: time=2026-09-22T10:57:03.171Z level=INFO msg="Upload complete. (506ms)" worker2 # [ 111.877145] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 111.884356] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 111.895198] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 111.904417] nix-daemon[873]: reaped child process 1336, status = succeeded worker2 # [ 111.909908] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 113.325883] nix-daemon[873]: reaped child process 1350, status = succeeded worker2 # [ 113.467833] nix-daemon[873]: accepted connection from pid 1366, user nix-grpc-daemon (trusted) worker2 # [ 113.482138] nix-daemon[873]: reaped child process 1369, status = succeeded lb # [ 113.500853] niks3-server[1201]: 2026/09/22 10:57:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 113.508538] nix-grpc-daemon[1303]: time=2026-09-22T10:57:04.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 113.510128] nix-grpc-daemon[1303]: time=2026-09-22T10:57:04.809Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 113.535630] niks3-server[1201]: 2026/09/22 10:57:05 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 113.551612] niks3-server[1201]: 2026/09/22 10:57:05 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 113.563763] niks3-server[1201]: 2026/09/22 10:57:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 113.569622] niks3-server[1201]: 2026/09/22 10:57:05 INFO Signed narinfos id=32 count=1 worker2 # [ 113.566493] nix-grpc-daemon[1303]: time=2026-09-22T10:57:04.865Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.573120] niks3-server[1201]: 2026/09/22 10:57:05 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 113.581830] niks3-server[1201]: 2026/09/22 10:57:05 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 113.588235] niks3-server[1201]: 2026/09/22 10:57:05 INFO Completed upload id=32 worker2 # [ 113.584849] nix-grpc-daemon[1303]: time=2026-09-22T10:57:04.884Z level=INFO msg="Upload complete. (266ms)" lb # [ 113.590075] niks3-server[1201]: 2026/09/22 10:57:05 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 113.594672] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 113.606161] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:04Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 113.609358] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:04Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 113.618415] nix-daemon[873]: reaped child process 1348, status = succeeded worker2 # [ 113.648246] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 113.661316] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 113.675443] nix-grpc-daemon[1303]: time=2026-09-22T10:57:04.974Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 113.683726] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 113.692487] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 113.859581] nix-daemon[873]: accepted connection from pid 1375, user nix-grpc-daemon (trusted) worker2 # [ 113.873948] nix-daemon[873]: reaped child process 1378, status = succeeded worker2 # [ 114.039522] nix-daemon[873]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 114.054464] nix-daemon[873]: reaped child process 1383, status = succeeded lb # [ 114.071920] niks3-server[1201]: 2026/09/22 10:57:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 114.076946] nix-grpc-daemon[1303]: time=2026-09-22T10:57:05.376Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 114.078507] nix-grpc-daemon[1303]: time=2026-09-22T10:57:05.377Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 114.104500] niks3-server[1201]: 2026/09/22 10:57:06 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 114.114404] niks3-server[1201]: 2026/09/22 10:57:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 114.117732] nix-grpc-daemon[1303]: time=2026-09-22T10:57:05.417Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.121288] niks3-server[1201]: 2026/09/22 10:57:06 INFO Signed narinfos id=33 count=1 lb # [ 114.125576] niks3-server[1201]: 2026/09/22 10:57:06 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 114.137827] niks3-server[1201]: 2026/09/22 10:57:06 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 114.143102] niks3-server[1201]: 2026/09/22 10:57:06 INFO Completed upload id=33 worker2 # [ 114.139535] nix-grpc-daemon[1303]: time=2026-09-22T10:57:05.438Z level=INFO msg="Upload complete. (433ms)" worker2 # [ 114.143386] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 duration_s=0 paths=1 nar_bytes_in=656 lb # [ 114.149568] niks3-server[1201]: 2026/09/22 10:57:06 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 114.148590] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 114.158064] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 114.162525] nix-daemon[873]: reaped child process 1373, status = succeeded worker2 # [ 114.167913] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 115.193587] nix-daemon[873]: reaped child process 1387, status = succeeded worker2 # [ 115.321957] nix-daemon[873]: accepted connection from pid 1403, user nix-grpc-daemon (trusted) worker2 # [ 115.334953] nix-daemon[873]: reaped child process 1406, status = succeeded lb # [ 115.349864] niks3-server[1201]: 2026/09/22 10:57:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 115.354756] nix-grpc-daemon[1303]: time=2026-09-22T10:57:06.653Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 115.356291] nix-grpc-daemon[1303]: time=2026-09-22T10:57:06.655Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 115.373919] niks3-server[1201]: 2026/09/22 10:57:07 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 115.376887] niks3-server[1201]: 2026/09/22 10:57:07 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 115.380960] niks3-server[1201]: 2026/09/22 10:57:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 115.383471] niks3-server[1201]: 2026/09/22 10:57:07 INFO Signed narinfos id=34 count=1 worker2 # [ 115.381160] nix-grpc-daemon[1303]: time=2026-09-22T10:57:06.680Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.387615] niks3-server[1201]: 2026/09/22 10:57:07 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 115.392752] niks3-server[1201]: 2026/09/22 10:57:07 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 115.397080] niks3-server[1201]: 2026/09/22 10:57:07 INFO Completed upload id=34 worker2 # [ 115.393371] nix-grpc-daemon[1303]: time=2026-09-22T10:57:06.692Z level=INFO msg="Upload complete. (217ms)" lb # [ 115.399787] niks3-server[1201]: 2026/09/22 10:57:07 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 115.397167] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 115.403593] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:06Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 115.405276] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:06Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 115.408527] nix-daemon[873]: reaped child process 1385, status = succeeded worker2 # [ 115.448297] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 115.458400] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 115.467690] nix-grpc-daemon[1303]: time=2026-09-22T10:57:06.767Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 115.474404] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 115.483093] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 115.646395] nix-daemon[873]: accepted connection from pid 1412, user nix-grpc-daemon (trusted) worker2 # [ 115.659081] nix-daemon[873]: reaped child process 1415, status = succeeded worker2 # [ 115.829079] nix-daemon[873]: accepted connection from pid 1417, user nix-grpc-daemon (trusted) worker2 # [ 115.841944] nix-daemon[873]: reaped child process 1420, status = succeeded lb # [ 115.860162] niks3-server[1201]: 2026/09/22 10:57:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 115.861361] nix-grpc-daemon[1303]: time=2026-09-22T10:57:07.160Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 115.863302] nix-grpc-daemon[1303]: time=2026-09-22T10:57:07.162Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 115.876534] niks3-server[1201]: 2026/09/22 10:57:07 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 115.880308] niks3-server[1201]: 2026/09/22 10:57:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 115.882776] niks3-server[1201]: 2026/09/22 10:57:07 INFO Signed narinfos id=35 count=1 worker2 # [ 115.879289] nix-grpc-daemon[1303]: time=2026-09-22T10:57:07.178Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.885574] niks3-server[1201]: 2026/09/22 10:57:07 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 115.890656] niks3-server[1201]: 2026/09/22 10:57:07 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 115.893059] niks3-server[1201]: 2026/09/22 10:57:07 INFO Completed upload id=35 worker2 # [ 115.889404] nix-grpc-daemon[1303]: time=2026-09-22T10:57:07.188Z level=INFO msg="Upload complete. (397ms)" worker2 # [ 115.891383] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47090 duration_s=0 paths=1 nar_bytes_in=784 lb # [ 115.895658] niks3-server[1201]: 2026/09/22 10:57:07 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 115.894578] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 worker2 # [ 115.901294] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker2 # [ 115.904404] nix-daemon[873]: reaped child process 1410, status = succeeded client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 115.911118] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) lb # [ 116.050114] envoy[910]: conn peer=[2001:db8:1::1]:48180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1009 tx=305 ms=1558 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 116.925475] nix-daemon[873]: reaped child process 1424, status = succeeded worker2 # [ 117.068815] nix-daemon[873]: accepted connection from pid 1440, user nix-grpc-daemon (trusted) worker2 # [ 117.081348] nix-daemon[873]: reaped child process 1443, status = succeeded lb # [ 117.102728] niks3-server[1201]: 2026/09/22 10:57:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 117.107926] nix-grpc-daemon[1303]: time=2026-09-22T10:57:08.407Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 117.110064] nix-grpc-daemon[1303]: time=2026-09-22T10:57:08.408Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 117.143419] niks3-server[1201]: 2026/09/22 10:57:09 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 117.149163] niks3-server[1201]: 2026/09/22 10:57:09 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 117.159117] niks3-server[1201]: 2026/09/22 10:57:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 117.164673] niks3-server[1201]: 2026/09/22 10:57:09 INFO Signed narinfos id=36 count=1 worker2 # [ 117.163720] nix-grpc-daemon[1303]: time=2026-09-22T10:57:08.462Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.168886] niks3-server[1201]: 2026/09/22 10:57:09 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 117.180626] niks3-server[1201]: 2026/09/22 10:57:09 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 117.184967] niks3-server[1201]: 2026/09/22 10:57:09 INFO Completed upload id=36 worker2 # [ 117.183827] nix-grpc-daemon[1303]: time=2026-09-22T10:57:08.483Z level=INFO msg="Upload complete. (264ms)" lb # [ 117.188214] niks3-server[1201]: 2026/09/22 10:57:09 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 117.186158] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47090 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 117.193794] nix-daemon[873]: reaped child process 1422, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2, in 6.82 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath, in 0.18 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 7.58 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 117.655231] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 117.945121] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:09Z level=info event=signal_exit lb # [ 118.186577] niks3-server[1201]: 2026/09/22 10:57:10 INFO lead: released remote=192.168.1.4:34538 worker2 # [ 119.181940] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:10Z level=info event=scheduler_restarting worker2 # [ 119.184548] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:10Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 119.183349] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:11Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 119.186204] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47082 worker2 # [ 119.187695] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:10Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 119.188977] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47082 worker2 # [ 119.190386] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:10Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 119.199329] nix-daemon[873]: reaped child process 1295, status = succeeded worker1 # [ 119.382719] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.384638] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.394270] nix-grpc-daemon[1243]: ts=2026-09-22T10:57:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 119.585236] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.588113] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 119.788556] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.792246] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.973893] nix-grpc-daemon[1243]: E0000 00:00:1790074631.273175 1288 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 119.979306] nix-grpc-daemon[1243]: E0000 00:00:1790074631.278382 1288 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 119.993158] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.996916] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 120.197647] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.199441] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.291528] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 120.294505] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 120.297891] systemd[1]: nix-grpc-daemon.service: Consumed 1.157s CPU time over 15.544s wall clock time, 35.2M memory peak, 46.1K incoming IP traffic, 82.8K outgoing IP traffic. worker2 # [ 120.309575] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 120.313869] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 120.317168] systemd[1]: nix-grpc-daemon.socket: Consumed 326us CPU time over 16.250s wall clock time, 256K memory peak, 38K incoming IP traffic, 27.8K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 120.399932] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.401675] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 120.602606] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.606377] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 120.806572] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.808276] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 120.976210] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_take_over lb # [ 120.980637] niks3-server[1201]: 2026/09/22 10:57:12 INFO lead: acquired remote=192.168.1.3:42044 worker1 # [ 121.008708] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 121.010617] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 121.212801] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 121.216581] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 121.417464] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 121.421344] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 121.622329] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 121.626223] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 121.826379] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 121.829494] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:47684 worker1 # [ 121.831130] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: worker1 # [ 122.773251] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42062 client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 122.776386] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 122.794025] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:14Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 122.796050] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:14Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 122.839926] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 122.851910] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42062 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 122.865726] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 122.874904] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 122.895836] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:15Z level=info event=niks3_push_started pid=1316 worker1 # [ 123.079917] nix-grpc-daemon[1316]: time=2026-09-22T10:57:15.196Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 123.232552] nix-daemon[853]: accepted connection from pid 1329, user nix-grpc-daemon (trusted) worker1 # [ 123.243551] nix-daemon[853]: reaped child process 1332, status = succeeded worker1 # [ 123.396504] nix-daemon[853]: accepted connection from pid 1334, user nix-grpc-daemon (trusted) worker1 # [ 123.408559] nix-daemon[853]: reaped child process 1337, status = succeeded lb # [ 123.428129] niks3-server[1201]: 2026/09/22 10:57:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 123.429702] nix-grpc-daemon[1316]: time=2026-09-22T10:57:15.547Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 123.432270] nix-grpc-daemon[1316]: time=2026-09-22T10:57:15.548Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 123.450330] niks3-server[1201]: 2026/09/22 10:57:15 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 123.454962] niks3-server[1201]: 2026/09/22 10:57:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 123.457151] niks3-server[1201]: 2026/09/22 10:57:15 INFO Signed narinfos id=37 count=1 worker1 # [ 123.455064] nix-grpc-daemon[1316]: time=2026-09-22T10:57:15.572Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.462591] niks3-server[1201]: 2026/09/22 10:57:15 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 123.466685] niks3-server[1201]: 2026/09/22 10:57:15 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 123.471031] niks3-server[1201]: 2026/09/22 10:57:15 INFO Completed upload id=37 worker1 # [ 123.467163] nix-grpc-daemon[1316]: time=2026-09-22T10:57:15.584Z level=INFO msg="Upload complete. (384ms)" worker1 # [ 123.469321] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 123.473130] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 123.480092] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 123.482498] nix-daemon[853]: reaped child process 1314, status = succeeded worker1 # [ 123.487947] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 124.903677] nix-daemon[853]: reaped child process 1341, status = succeeded worker1 # [ 125.040710] nix-daemon[853]: accepted connection from pid 1357, user nix-grpc-daemon (trusted) worker1 # [ 125.052669] nix-daemon[853]: reaped child process 1360, status = succeeded lb # [ 125.072880] niks3-server[1201]: 2026/09/22 10:57:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.082822] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.200Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 125.084398] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.201Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 125.125085] niks3-server[1201]: 2026/09/22 10:57:17 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 125.127797] niks3-server[1201]: 2026/09/22 10:57:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 125.131802] niks3-server[1201]: 2026/09/22 10:57:17 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker1 # [ 125.128451] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.133361] niks3-server[1201]: 2026/09/22 10:57:17 INFO Signed narinfos id=38 count=1 lb # [ 125.142310] niks3-server[1201]: 2026/09/22 10:57:17 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 125.150463] niks3-server[1201]: 2026/09/22 10:57:17 INFO Completed upload id=38 worker1 # [ 125.146650] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.264Z level=INFO msg="Upload complete. (250ms)" lb # [ 125.153343] niks3-server[1201]: 2026/09/22 10:57:17 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls worker1 # [ 125.150299] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 lb # [ 125.157877] niks3-server[1201]: 2026/09/22 10:57:17 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker1 # [ 125.160507] nix-daemon[853]: reaped child process 1339, status = succeeded worker1 # [ 125.165069] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 125.166984] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 125.209733] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 125.221936] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 125.236438] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.353Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 125.244274] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 125.252565] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 125.405678] nix-daemon[853]: accepted connection from pid 1366, user nix-grpc-daemon (trusted) worker1 # [ 125.418076] nix-daemon[853]: reaped child process 1369, status = succeeded worker1 # [ 125.565167] nix-daemon[853]: accepted connection from pid 1371, user nix-grpc-daemon (trusted) worker1 # [ 125.577371] nix-daemon[853]: reaped child process 1374, status = succeeded lb # [ 125.590974] niks3-server[1201]: 2026/09/22 10:57:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.595289] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.712Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 125.596777] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.714Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 125.612929] niks3-server[1201]: 2026/09/22 10:57:17 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 125.617057] niks3-server[1201]: 2026/09/22 10:57:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 125.620116] niks3-server[1201]: 2026/09/22 10:57:17 INFO Signed narinfos id=39 count=1 worker1 # [ 125.616163] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.733Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.625194] niks3-server[1201]: 2026/09/22 10:57:17 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 125.630201] niks3-server[1201]: 2026/09/22 10:57:17 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 125.634539] niks3-server[1201]: 2026/09/22 10:57:17 INFO Completed upload id=39 worker1 # [ 125.630641] nix-grpc-daemon[1316]: time=2026-09-22T10:57:17.748Z level=INFO msg="Upload complete. (365ms)" lb # [ 125.636321] niks3-server[1201]: 2026/09/22 10:57:17 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 125.632650] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 125.636748] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 125.643218] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 125.645758] nix-daemon[853]: reaped child process 1364, status = succeeded client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker1 # [ 125.651617] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) lb # [ 126.050256] envoy[910]: conn peer=[2001:db8:1::1]:48194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9700 tx=4135 ms=6559 lb # [ 126.052044] envoy[910]: conn peer=[2001:db8:1::4]:39092 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5746 tx=730 ms=14401 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 126.676669] nix-daemon[853]: reaped child process 1378, status = succeeded worker1 # [ 126.807759] nix-daemon[853]: accepted connection from pid 1394, user nix-grpc-daemon (trusted) worker1 # [ 126.820713] nix-daemon[853]: reaped child process 1397, status = succeeded lb # [ 126.834680] niks3-server[1201]: 2026/09/22 10:57:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 126.840234] nix-grpc-daemon[1316]: time=2026-09-22T10:57:18.957Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 126.842262] nix-grpc-daemon[1316]: time=2026-09-22T10:57:18.959Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 126.871393] niks3-server[1201]: 2026/09/22 10:57:18 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 126.877950] niks3-server[1201]: 2026/09/22 10:57:18 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 126.891989] niks3-server[1201]: 2026/09/22 10:57:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 126.896339] niks3-server[1201]: 2026/09/22 10:57:18 INFO Signed narinfos id=40 count=1 worker1 # [ 126.893114] nix-grpc-daemon[1316]: time=2026-09-22T10:57:19.010Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.901868] niks3-server[1201]: 2026/09/22 10:57:18 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 126.909988] niks3-server[1201]: 2026/09/22 10:57:18 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 126.912899] niks3-server[1201]: 2026/09/22 10:57:18 INFO Completed upload id=40 worker1 # [ 126.909222] nix-grpc-daemon[1316]: time=2026-09-22T10:57:19.026Z level=INFO msg="Upload complete. (250ms)" lb # [ 126.915596] niks3-server[1201]: 2026/09/22 10:57:18 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 126.917480] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 126.925092] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 126.929395] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 126.938197] nix-daemon[853]: reaped child process 1376, status = succeeded worker1 # [ 126.968707] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 126.981331] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 126.994261] nix-grpc-daemon[1316]: time=2026-09-22T10:57:19.111Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 127.002396] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 127.010529] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 127.150543] nix-daemon[853]: accepted connection from pid 1403, user nix-grpc-daemon (trusted) worker1 # [ 127.163075] nix-daemon[853]: reaped child process 1406, status = succeeded worker1 # [ 127.309877] nix-daemon[853]: accepted connection from pid 1408, user nix-grpc-daemon (trusted) worker1 # [ 127.322379] nix-daemon[853]: reaped child process 1411, status = succeeded lb # [ 127.337739] niks3-server[1201]: 2026/09/22 10:57:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 127.342543] nix-grpc-daemon[1316]: time=2026-09-22T10:57:19.460Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 127.344092] nix-grpc-daemon[1316]: time=2026-09-22T10:57:19.461Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 127.368961] niks3-server[1201]: 2026/09/22 10:57:19 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 127.377437] niks3-server[1201]: 2026/09/22 10:57:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 127.381211] nix-grpc-daemon[1316]: time=2026-09-22T10:57:19.498Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.385215] niks3-server[1201]: 2026/09/22 10:57:19 INFO Signed narinfos id=41 count=1 lb # [ 127.389604] niks3-server[1201]: 2026/09/22 10:57:19 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 127.401656] niks3-server[1201]: 2026/09/22 10:57:19 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 127.409354] niks3-server[1201]: 2026/09/22 10:57:19 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 127.410686] nix-grpc-daemon[1316]: time=2026-09-22T10:57:19.528Z level=INFO msg="Upload complete. (387ms)" lb # [ 127.414579] niks3-server[1201]: 2026/09/22 10:57:19 INFO Completed upload id=41 worker1 # [ 127.412564] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 127.414991] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 127.420401] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 127.425068] nix-daemon[853]: reaped child process 1401, status = succeeded client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 127.429849] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 128.442242] nix-daemon[853]: reaped child process 1415, status = succeeded worker1 # [ 128.563642] nix-daemon[853]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker1 # [ 128.575487] nix-daemon[853]: reaped child process 1434, status = succeeded lb # [ 128.590846] niks3-server[1201]: 2026/09/22 10:57:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 128.591621] nix-grpc-daemon[1316]: time=2026-09-22T10:57:20.708Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 128.593099] nix-grpc-daemon[1316]: time=2026-09-22T10:57:20.710Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 128.612463] niks3-server[1201]: 2026/09/22 10:57:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 128.614728] niks3-server[1201]: 2026/09/22 10:57:20 INFO Signed narinfos id=42 count=1 worker1 # [ 128.611147] nix-grpc-daemon[1316]: time=2026-09-22T10:57:20.728Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.616134] niks3-server[1201]: 2026/09/22 10:57:20 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 128.620456] niks3-server[1201]: 2026/09/22 10:57:20 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 128.624787] niks3-server[1201]: 2026/09/22 10:57:20 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 128.628143] niks3-server[1201]: 2026/09/22 10:57:20 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 128.631228] niks3-server[1201]: 2026/09/22 10:57:20 INFO Completed upload id=42 worker1 # [ 128.628550] nix-grpc-daemon[1316]: time=2026-09-22T10:57:20.746Z level=INFO msg="Upload complete. (192ms)" lb # [ 128.632819] niks3-server[1201]: 2026/09/22 10:57:20 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 128.631686] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 128.638089] nix-daemon[853]: reaped child process 1413, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.11 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.17 seconds) worker2 # [ 128.912812] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 128.919938] systemd[1]: Starting scheduler-token.service... worker2 # [ 128.985280] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 128.986507] systemd[1]: Finished scheduler-token.service. worker2 # [ 128.988153] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 65ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 128.993478] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 129.154463] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:20Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 129.156935] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 129.161114] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 129.169095] nix-grpc-daemon[1464]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 129.170416] nix-grpc-daemon[1464]: E0000 00:00:1790074640.467584 1464 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 129.177319] nix-grpc-daemon[1464]: E0000 00:00:1790074640.472714 1464 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 129.179932] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 129.183684] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 129.189280] nix-grpc-daemon[1464]: E0000 00:00:1790074640.487412 1503 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 129.201131] nix-grpc-daemon[1464]: E0000 00:00:1790074640.500567 1503 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 129.204157] nix-grpc-daemon[1464]: E0000 00:00:1790074640.502802 1503 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 129.215319] nix-grpc-daemon[1464]: E0000 00:00:1790074640.514698 1503 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 129.225691] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.235178] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 129.238252] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:47684 worker1 # [ 129.242575] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.06 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs client # [ 129.535893] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 6eb58902e5a9447595f97dcae06ea713 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds) worker2 # [ 129.746866] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 129.753176] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # [ 129.772444] nix[1294]: don't know how to build these paths: client # [ 129.773428] nix[1294]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 129.771781] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 129.775762] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 129.813459] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 129.826154] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42062 client # [ 129.849299] nix[1294]: copying 1 paths to 'lb:50051'... worker1 # [ 129.837223] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 client # [ 129.851333] nix[1294]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 129.849663] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 130.018172] nix-daemon[853]: accepted connection from pid 1447, user nix-grpc-daemon (trusted) worker1 # [ 130.030210] nix-daemon[853]: reaped child process 1450, status = succeeded worker1 # [ 130.177049] nix-daemon[853]: accepted connection from pid 1452, user nix-grpc-daemon (trusted) worker1 # [ 130.187815] nix-daemon[853]: reaped child process 1455, status = succeeded lb # [ 130.205647] niks3-server[1201]: 2026/09/22 10:57:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 130.209402] nix-grpc-daemon[1316]: time=2026-09-22T10:57:22.326Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 130.210903] nix-grpc-daemon[1316]: time=2026-09-22T10:57:22.328Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 130.232586] niks3-server[1201]: 2026/09/22 10:57:22 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 130.244616] niks3-server[1201]: 2026/09/22 10:57:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 130.249458] niks3-server[1201]: 2026/09/22 10:57:22 INFO Signed narinfos id=43 count=1 worker1 # [ 130.248536] nix-grpc-daemon[1316]: time=2026-09-22T10:57:22.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.255109] niks3-server[1201]: 2026/09/22 10:57:22 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 130.265106] niks3-server[1201]: 2026/09/22 10:57:22 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker1 # [ 130.267377] nix-grpc-daemon[1316]: time=2026-09-22T10:57:22.384Z level=INFO msg="Upload complete. (406ms)" lb # [ 130.271323] niks3-server[1201]: 2026/09/22 10:57:22 INFO Completed upload id=43 lb # [ 130.276614] niks3-server[1201]: 2026/09/22 10:57:22 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 130.270281] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 130.275311] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 worker1 # [ 130.284516] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker1 # [ 130.289086] nix-daemon[853]: reaped child process 1445, status = succeeded worker1 # [ 130.294694] nix-daemon[853]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) client # [ 130.306394] nix[1294]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 132.300895] systemd-journald[286]: Received client request to rotate journal, rotating. worker2 # [ 132.318331] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/825d5723e21840e48bbdef128e6cdc7c. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 132.236294] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds) client: must succeed: sleep 5.0 worker1 # [ 132.751527] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:24Z level=info event=draining lb # [ 136.050852] envoy[910]: conn peer=[2001:db8:1::1]:54272 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9573 tx=4052 ms=5870 client: (finished: must succeed: sleep 5.0, in 5.04 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 137.514400] nix-daemon[853]: reaped child process 1459, status = succeeded worker1 # [ 137.654547] nix-daemon[853]: accepted connection from pid 1500, user nix-grpc-daemon (trusted) worker1 # [ 137.666660] nix-daemon[853]: reaped child process 1503, status = succeeded lb # [ 137.687738] niks3-server[1201]: 2026/09/22 10:57:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.692479] nix-grpc-daemon[1316]: time=2026-09-22T10:57:29.809Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.694315] nix-grpc-daemon[1316]: time=2026-09-22T10:57:29.811Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 137.732864] niks3-server[1201]: 2026/09/22 10:57:29 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 137.739089] niks3-server[1201]: 2026/09/22 10:57:29 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 137.746317] niks3-server[1201]: 2026/09/22 10:57:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 137.751750] niks3-server[1201]: 2026/09/22 10:57:29 INFO Signed narinfos id=44 count=1 worker1 # [ 137.751061] nix-grpc-daemon[1316]: time=2026-09-22T10:57:29.868Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.759095] niks3-server[1201]: 2026/09/22 10:57:29 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 137.769659] niks3-server[1201]: 2026/09/22 10:57:29 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 137.772961] niks3-server[1201]: 2026/09/22 10:57:29 INFO Completed upload id=44 lb # [ 137.775056] niks3-server[1201]: 2026/09/22 10:57:29 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 137.770464] nix-grpc-daemon[1316]: time=2026-09-22T10:57:29.887Z level=INFO msg="Upload complete. (263ms)" worker1 # [ 137.776837] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42062 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 137.788487] nix-daemon[853]: reaped child process 1457, status = succeeded client # [ 137.827892] systemd[1]: rs.service: Deactivated successfully. client # [ 137.831948] systemd[1]: rs.service: Consumed 124ms CPU time over 8.294s wall clock time, 41.4M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 138.754322] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:30Z level=info event=signal_exit lb # [ 139.211980] niks3-server[1201]: 2026/09/22 10:57:31 INFO lead: released remote=192.168.1.3:42044 worker2 # [ 140.209356] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:31Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 140.213114] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:32Z level=info event=scheduler_restarting worker1 # [ 140.216366] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47684 worker1 # [ 140.220302] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:32Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 140.223483] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47684 worker1 # [ 140.226758] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:32Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 140.229828] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:32Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 140.246473] nix-daemon[853]: reaped child process 1289, status = succeeded worker2 # [ 140.409127] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 140.411215] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 140.423718] nix-grpc-daemon[1237]: ts=2026-09-22T10:57:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 140.611824] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 140.613564] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.14 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 140.813610] nix-grpc-daemon[1237]: E0000 00:00:1790074652.930968 1282 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 140.814813] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 140.815917] nix-grpc-daemon[1237]: E0000 00:00:1790074652.931100 1282 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 140.818804] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 141.019872] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.024158] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 141.225764] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.229494] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.376537] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 141.380166] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 141.383568] systemd[1]: nix-grpc-daemon.service: Consumed 1.273s CPU time over 31.808s wall clock time, 35.8M memory peak, 48.6K incoming IP traffic, 103.8K outgoing IP traffic. worker1 # [ 141.399737] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 141.430383] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.434225] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.561948] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 141.564261] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 141.568272] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 141.575067] nix-grpc-daemon[1510]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 141.576414] nix-grpc-daemon[1510]: E0000 00:00:1790074653.691937 1510 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 141.581346] nix-grpc-daemon[1510]: E0000 00:00:1790074653.697116 1510 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 141.583806] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 141.585996] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 141.590052] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=scheduler_take_over lb # [ 141.594416] niks3-server[1201]: 2026/09/22 10:57:33 INFO lead: acquired remote=192.168.1.3:45416 worker1 # [ 141.593926] nix-grpc-daemon[1510]: E0000 00:00:1790074653.710875 1552 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 141.605453] nix-grpc-daemon[1510]: E0000 00:00:1790074653.722917 1552 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 141.609132] nix-grpc-daemon[1510]: E0000 00:00:1790074653.725205 1552 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 141.619739] nix-grpc-daemon[1510]: E0000 00:00:1790074653.737218 1552 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 141.627259] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.628793] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 141.635248] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.639104] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 141.829443] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.831205] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 141.839575] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.841240] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 142.031526] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.033569] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 142.042095] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.043908] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 142.234202] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.236141] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 142.244938] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.246508] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 142.437198] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.444125] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:43740 worker2 # [ 142.447213] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 142.447836] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 142.459139] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 142.463263] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:43740 worker1 # [ 142.467087] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.55 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid client # [ 143.069626] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: e1189d1e128d46c69274ba07968dbbc8 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds) worker1 # [ 143.254700] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49688 worker1 # [ 143.266577] nix-daemon[853]: accepted connection from pid 1510, user nix-grpc-daemon (trusted) client # [ 143.292603] nix[1329]: don't know how to build these paths: client # [ 143.293615] nix[1329]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 143.288240] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:35Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 143.293317] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:35Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 143.337068] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49688 worker1 # [ 143.349809] nix-grpc-daemon[1510]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5) worker1 # [ 143.427816] nix-grpc-daemon[1510]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 2/5) worker1 # [ 143.600793] nix-grpc-daemon[1510]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 201 ms (attempt 3/5) worker1 # [ 143.807497] nix-grpc-daemon[1510]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 4/5) worker1 # [ 143.829530] nix-grpc-daemon[1510]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 143.832845] nix-grpc-daemon[1510]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 143.851445] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49688 client # [ 143.870797] nix[1329]: copying 1 paths to 'lb:50051'... worker1 # [ 143.861426] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49688 client # [ 143.874321] nix[1329]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 143.867718] nix-daemon[853]: accepted connection from pid 1510, user nix-grpc-daemon (trusted) worker1 # [ 143.879559] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:35Z level=info event=niks3_push_started pid=1579 worker1 # [ 144.040830] nix-grpc-daemon[1579]: time=2026-09-22T10:57:36.157Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 144.196820] nix-daemon[853]: accepted connection from pid 1592, user nix-grpc-daemon (trusted) worker1 # [ 144.211875] nix-daemon[853]: reaped child process 1599, status = succeeded worker1 # [ 144.363573] nix-daemon[853]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 144.376314] nix-daemon[853]: reaped child process 1604, status = succeeded lb # [ 144.396352] niks3-server[1201]: 2026/09/22 10:57:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.404078] nix-grpc-daemon[1579]: time=2026-09-22T10:57:36.521Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.405775] nix-grpc-daemon[1579]: time=2026-09-22T10:57:36.523Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 144.435973] niks3-server[1201]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 144.443081] niks3-server[1201]: 2026/09/22 10:57:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 144.448051] niks3-server[1201]: 2026/09/22 10:57:36 INFO Signed narinfos id=45 count=1 worker1 # [ 144.446887] nix-grpc-daemon[1579]: time=2026-09-22T10:57:36.564Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.459660] niks3-server[1201]: 2026/09/22 10:57:36 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 144.461796] niks3-server[1201]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 144.466750] niks3-server[1201]: 2026/09/22 10:57:36 INFO Completed upload id=45 worker1 # [ 144.462912] nix-grpc-daemon[1579]: time=2026-09-22T10:57:36.580Z level=INFO msg="Upload complete. (417ms)" lb # [ 144.468838] niks3-server[1201]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 144.465426] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49688 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 144.469400] nix-grpc-daemon[1510]: ts=2026-09-22T10:57:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49688 worker1 # [ 144.475583] nix-daemon[853]: accepted connection from pid 1510, user nix-grpc-daemon (trusted) worker1 # [ 144.477931] nix-daemon[853]: reaped child process 1577, status = succeeded worker1 # [ 144.483084] nix-daemon[853]: accepted connection from pid 1510, user nix-grpc-daemon (trusted) client # [ 144.496177] nix[1329]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb # [ 146.050643] envoy[910]: conn peer=[2001:db8:1::1]:54282 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2960 tx=1428 ms=8041 lb # [ 146.053900] envoy[910]: conn peer=[2001:db8:1::3]:33102 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3984 tx=999 ms=30620 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 146.672379] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1510 (nix-grpc-daemon) on client request. worker1 # [ 146.676292] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 146.687318] niks3-server[1201]: 2026/09/22 10:57:38 INFO lead: released remote=192.168.1.3:45416 worker2 # [ 146.690679] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:37Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 146.703672] nix[1329]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again client # [ 146.705659] nix[1329]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker1 # [ 146.701694] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 146.703236] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 146.706723] systemd[1]: nix-grpc-daemon.service: Consumed 369ms CPU time over 5.300s wall clock time, 33.2M memory peak, 14.8K incoming IP traffic, 21K outgoing IP traffic. worker1 # [ 146.711737] nix-daemon[853]: reaped child process 1606, status = succeeded worker1 # [ 146.713561] nix-daemon[853]: reaped child process 1569, status = succeeded worker1 # [ 146.722126] nix-daemon[1608]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 146.726786] nix-daemon[853]: reaped child process 1608, status = failed with exit code 1 worker2 # [ 146.891189] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 146.895249] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 146.904642] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 147.069297] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 147.071066] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 147.074458] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 147.080061] nix-grpc-daemon[1645]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 147.082093] nix-grpc-daemon[1645]: E0000 00:00:1790074659.197317 1645 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 147.087058] nix-grpc-daemon[1645]: E0000 00:00:1790074659.202445 1645 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 147.090116] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 147.091821] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 147.096460] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 147.103128] niks3-server[1201]: 2026/09/22 10:57:39 INFO lead: acquired remote=192.168.1.3:49206 worker1 # [ 147.101073] nix-grpc-daemon[1645]: E0000 00:00:1790074659.217750 1686 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 147.104143] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=scheduler_take_over worker1 # [ 147.113757] nix-grpc-daemon[1645]: E0000 00:00:1790074659.231202 1686 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 147.117122] nix-grpc-daemon[1645]: E0000 00:00:1790074659.233419 1686 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 147.127506] nix-grpc-daemon[1645]: E0000 00:00:1790074659.244976 1686 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 147.136671] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 147.138365] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:49696 worker1 # [ 147.139958] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 147.200749] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 147.204517] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 147.252139] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49704 worker1 # [ 147.262160] nix-daemon[853]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker1 # [ 147.276372] nix-daemon[853]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) client # [ 147.299812] nix[1329]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 147.288455] nix-daemon[853]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker2 # [ 147.297712] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 147.302231] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 147.303884] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:49696 worker1 # [ 147.305644] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1 # [ 151.903869] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:44Z level=info event=niks3_push_started pid=1728 worker1 # [ 151.915502] nix-daemon[853]: reaped child process 1703, status = succeeded client: waiting for success: ! systemctl is-active mid worker1 # [ 152.070678] nix-grpc-daemon[1728]: time=2026-09-22T10:57:44.187Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 152.187271] nix-daemon[853]: accepted connection from pid 1741, user nix-grpc-daemon (trusted) worker1 # [ 152.199259] nix-daemon[853]: reaped child process 1744, status = succeeded lb # [ 152.213396] niks3-server[1201]: 2026/09/22 10:57:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.214376] nix-grpc-daemon[1728]: time=2026-09-22T10:57:44.331Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.215844] nix-grpc-daemon[1728]: time=2026-09-22T10:57:44.333Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 152.237967] niks3-server[1201]: 2026/09/22 10:57:44 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 152.241619] nix-grpc-daemon[1728]: time=2026-09-22T10:57:44.359Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.245484] niks3-server[1201]: 2026/09/22 10:57:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 152.246922] niks3-server[1201]: 2026/09/22 10:57:44 INFO Signed narinfos id=46 count=1 lb # [ 152.255607] niks3-server[1201]: 2026/09/22 10:57:44 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 152.255430] nix-grpc-daemon[1728]: time=2026-09-22T10:57:44.372Z level=INFO msg="Upload complete. (181ms)" lb # [ 152.259668] niks3-server[1201]: 2026/09/22 10:57:44 INFO Completed upload id=46 worker1 # [ 152.257657] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49704 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 lb # [ 152.267485] niks3-server[1201]: 2026/09/22 10:57:44 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst worker1 # [ 152.265967] nix-daemon[853]: reaped child process 1701, status = succeeded lb # [ 152.272777] niks3-server[1201]: 2026/09/22 10:57:44 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls client # [ 152.296179] systemd[1]: mid.service: Deactivated successfully. client # [ 152.297965] systemd[1]: mid.service: Consumed 126ms CPU time over 9.227s wall clock time, 43.4M memory peak, 8.2K incoming IP traffic, 10.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.01 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr client # [ 153.069169] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 7ad837c71ac64e2a9e16ccd0913b510d client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds) worker1 # [ 153.233809] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49704 client # [ 153.252368] nix[1365]: don't know how to build these paths: client # [ 153.253793] nix[1365]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 153.250899] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:45Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 153.255313] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:45Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 153.295144] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 153.301296] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5) worker2 # [ 153.327910] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 2/5) worker2 # [ 153.416690] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 3/5) worker2 # [ 153.501483] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 190 ms (attempt 4/5) worker2 # [ 153.697539] nix-grpc-daemon[1464]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 153.701173] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 153.718177] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 client # [ 153.740391] nix[1365]: copying 1 paths to 'lb:50051'... worker2 # [ 153.728580] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 client # [ 153.743348] nix[1365]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 153.742854] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 153.761972] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:45Z level=info event=niks3_push_started pid=1612 worker2 # [ 153.921081] nix-grpc-daemon[1612]: time=2026-09-22T10:57:45.219Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 154.077817] nix-daemon[873]: accepted connection from pid 1625, user nix-grpc-daemon (trusted) worker2 # [ 154.088589] nix-daemon[873]: reaped child process 1628, status = succeeded worker2 # [ 154.247290] nix-daemon[873]: accepted connection from pid 1630, user nix-grpc-daemon (trusted) worker2 # [ 154.264432] nix-daemon[873]: reaped child process 1635, status = succeeded lb # [ 154.283600] niks3-server[1201]: 2026/09/22 10:57:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 154.294143] nix-grpc-daemon[1612]: time=2026-09-22T10:57:45.593Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 154.297440] nix-grpc-daemon[1612]: time=2026-09-22T10:57:45.594Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 154.330908] niks3-server[1201]: 2026/09/22 10:57:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 154.336191] niks3-server[1201]: 2026/09/22 10:57:46 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst worker2 # [ 154.338987] nix-grpc-daemon[1612]: time=2026-09-22T10:57:45.638Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.343596] niks3-server[1201]: 2026/09/22 10:57:46 INFO Signed narinfos id=47 count=1 lb # [ 154.350525] niks3-server[1201]: 2026/09/22 10:57:46 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 154.360634] niks3-server[1201]: 2026/09/22 10:57:46 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 154.364948] niks3-server[1201]: 2026/09/22 10:57:46 INFO Completed upload id=47 worker2 # [ 154.362532] nix-grpc-daemon[1612]: time=2026-09-22T10:57:45.661Z level=INFO msg="Upload complete. (438ms)" lb # [ 154.367299] niks3-server[1201]: 2026/09/22 10:57:46 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 154.364675] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 154.367781] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 154.372767] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 154.377247] nix-daemon[873]: reaped child process 1610, status = succeeded client # [ 154.394033] nix[1365]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... worker2 # [ 154.382225] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 155.474962] systemd[1]: intr.service: Sent signal SIGINT to main process 1365 (nix) on client request. worker2 # [ 155.464420] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:46Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 155.479790] nix[1365]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 155.485307] nix[1365]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 155.508856] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 155.510312] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 155.512226] systemd[1]: intr.service: Consumed 109ms CPU time over 2.442s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 155.597712] nix-daemon[873]: reaped child process 1639, status = succeeded worker2 # [ 155.600935] nix-daemon[1641]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 155.605481] nix-daemon[873]: reaped child process 1641, status = failed with exit code 1 lb # [ 156.051582] envoy[910]: conn peer=[2001:db8:1::3]:55658 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1335 tx=434 ms=5065 lb # [ 156.055733] envoy[910]: conn peer=[2001:db8:1::1]:55532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3878 tx=1808 ms=9019 lb # [ 156.059396] envoy[910]: conn peer=[2001:db8:1::1]:40528 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2980 tx=827 ms=2258 (finished: subtest: interrupting the client stops the build on the worker, in 3.65 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw client # [ 156.720624] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: fa1126175da0478da20aa68e7767935e client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds) client # [ 156.920946] nix[1386]: don't know how to build these paths: worker2 # [ 156.907830] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48074 client # [ 156.922373] nix[1386]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 156.917789] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:49Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 156.923209] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:49Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.966056] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49704 worker1 # [ 156.978565] nix-grpc-daemon[1645]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5) worker1 # [ 157.004427] nix-grpc-daemon[1645]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 2/5) worker1 # [ 157.016519] nix-grpc-daemon[1645]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 3/5) worker1 # [ 157.305247] nix-grpc-daemon[1645]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 4/5) worker1 # [ 157.498704] nix-grpc-daemon[1645]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 157.500417] nix-grpc-daemon[1645]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 157.512889] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49704 client # [ 157.532119] nix[1386]: copying 1 paths to 'lb:50051'... worker1 # [ 157.523777] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49704 client # [ 157.536165] nix[1386]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 157.529774] nix-daemon[853]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker1 # [ 157.680131] nix-daemon[853]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 157.691920] nix-daemon[853]: reaped child process 1783, status = succeeded worker1 # [ 157.829275] nix-daemon[853]: accepted connection from pid 1785, user nix-grpc-daemon (trusted) worker1 # [ 157.846181] nix-daemon[853]: reaped child process 1791, status = succeeded lb # [ 157.861713] niks3-server[1201]: 2026/09/22 10:57:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.865375] nix-grpc-daemon[1728]: time=2026-09-22T10:57:49.982Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 157.867110] nix-grpc-daemon[1728]: time=2026-09-22T10:57:49.982Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 157.889086] niks3-server[1201]: 2026/09/22 10:57:49 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 157.898666] niks3-server[1201]: 2026/09/22 10:57:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 157.904121] niks3-server[1201]: 2026/09/22 10:57:49 INFO Signed narinfos id=48 count=1 worker1 # [ 157.902886] nix-grpc-daemon[1728]: time=2026-09-22T10:57:50.020Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.909866] niks3-server[1201]: 2026/09/22 10:57:49 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 157.921600] niks3-server[1201]: 2026/09/22 10:57:49 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 157.926712] niks3-server[1201]: 2026/09/22 10:57:49 INFO Completed upload id=48 worker1 # [ 157.922836] nix-grpc-daemon[1728]: time=2026-09-22T10:57:50.040Z level=INFO msg="Upload complete. (386ms)" lb # [ 157.929581] niks3-server[1201]: 2026/09/22 10:57:49 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 157.925330] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49704 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 157.928071] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49704 worker1 # [ 157.933825] nix-daemon[853]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker1 # [ 157.937952] nix-daemon[853]: reaped child process 1778, status = succeeded client # [ 157.955145] nix[1386]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1 # [ 157.942786] nix-daemon[853]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 159.144576] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 159.181771] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.07 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 159.428536] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 159.431417] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 worker1 # [ 159.449303] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:51Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 159.450989] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:51Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 159.497655] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 159.510182] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 client # copying 1 paths to 'lb:50051'... worker2 # [ 159.521414] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 159.546072] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 159.721593] nix-daemon[873]: accepted connection from pid 1688, user nix-grpc-daemon (trusted) worker2 # [ 159.733691] nix-daemon[873]: reaped child process 1691, status = succeeded worker2 # [ 159.910208] nix-daemon[873]: accepted connection from pid 1693, user nix-grpc-daemon (trusted) worker2 # [ 159.921811] nix-daemon[873]: reaped child process 1696, status = succeeded lb # [ 159.943635] niks3-server[1201]: 2026/09/22 10:57:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 159.951691] nix-grpc-daemon[1612]: time=2026-09-22T10:57:51.250Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 159.953253] nix-grpc-daemon[1612]: time=2026-09-22T10:57:51.250Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 159.974585] niks3-server[1201]: 2026/09/22 10:57:51 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 159.985101] niks3-server[1201]: 2026/09/22 10:57:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 159.992761] niks3-server[1201]: 2026/09/22 10:57:51 INFO Signed narinfos id=49 count=1 worker2 # [ 159.992507] nix-grpc-daemon[1612]: time=2026-09-22T10:57:51.291Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.997781] niks3-server[1201]: 2026/09/22 10:57:51 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 160.006856] niks3-server[1201]: 2026/09/22 10:57:52 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete worker2 # [ 160.010301] nix-grpc-daemon[1612]: time=2026-09-22T10:57:51.309Z level=INFO msg="Upload complete. (452ms)" lb # [ 160.014277] niks3-server[1201]: 2026/09/22 10:57:52 INFO Completed upload id=49 lb # [ 160.018110] niks3-server[1201]: 2026/09/22 10:57:52 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 160.013491] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 160.019195] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 160.027470] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 160.032961] nix-daemon[873]: reaped child process 1686, status = succeeded worker2 # [ 160.037820] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 160.090649] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:52Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 161.863542] nix-daemon[873]: reaped child process 1700, status = succeeded worker2 # [ 162.019086] nix-daemon[873]: accepted connection from pid 1716, user nix-grpc-daemon (trusted) worker2 # [ 162.029741] nix-daemon[873]: reaped child process 1719, status = succeeded lb # [ 162.050310] niks3-server[1201]: 2026/09/22 10:57:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 162.051590] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.350Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 162.053429] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.352Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 162.072249] niks3-server[1201]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 162.076777] niks3-server[1201]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst worker2 # [ 162.076582] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.375Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.079735] niks3-server[1201]: 2026/09/22 10:57:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 162.081906] niks3-server[1201]: 2026/09/22 10:57:54 INFO Signed narinfos id=50 count=1 lb # [ 162.086697] niks3-server[1201]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 162.089559] niks3-server[1201]: 2026/09/22 10:57:54 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 162.093654] niks3-server[1201]: 2026/09/22 10:57:54 INFO Completed upload id=50 worker2 # [ 162.091078] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.390Z level=INFO msg="Upload complete. (245ms)" lb # [ 162.095241] niks3-server[1201]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 162.093392] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=2 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker1 # [ 162.098617] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:54Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 162.100388] nix-daemon[873]: reaped child process 1698, status = succeeded worker1 # [ 162.100431] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:54Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 162.142490] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 162.152318] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 162.166006] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.465Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 162.172678] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 162.180673] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 162.341402] nix-daemon[873]: accepted connection from pid 1723, user nix-grpc-daemon (trusted) worker2 # [ 162.352779] nix-daemon[873]: reaped child process 1726, status = succeeded worker2 # [ 162.497715] nix-daemon[873]: accepted connection from pid 1728, user nix-grpc-daemon (trusted) worker2 # [ 162.510458] nix-daemon[873]: reaped child process 1731, status = succeeded lb # [ 162.531899] niks3-server[1201]: 2026/09/22 10:57:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 162.536985] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.836Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 162.538497] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.837Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 162.563689] niks3-server[1201]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 162.573614] niks3-server[1201]: 2026/09/22 10:57:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker2 # [ 162.574748] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.874Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.578969] niks3-server[1201]: 2026/09/22 10:57:54 INFO Signed narinfos id=51 count=1 lb # [ 162.585302] niks3-server[1201]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 162.596395] niks3-server[1201]: 2026/09/22 10:57:54 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 162.602663] niks3-server[1201]: 2026/09/22 10:57:54 INFO Completed upload id=51 worker2 # [ 162.599087] nix-grpc-daemon[1612]: time=2026-09-22T10:57:53.898Z level=INFO msg="Upload complete. (406ms)" worker2 # [ 162.601403] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 162.607547] niks3-server[1201]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 162.606583] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 162.615720] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 162.621773] nix-daemon[873]: reaped child process 1721, status = succeeded client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... worker2 # [ 162.625721] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 163.439157] nix-daemon[873]: reaped child process 1735, status = succeeded worker2 # [ 163.573962] nix-daemon[873]: accepted connection from pid 1751, user nix-grpc-daemon (trusted) worker2 # [ 163.586817] nix-daemon[873]: reaped child process 1754, status = succeeded lb # [ 163.607406] niks3-server[1201]: 2026/09/22 10:57:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 163.617824] nix-grpc-daemon[1612]: time=2026-09-22T10:57:54.916Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 163.619218] nix-grpc-daemon[1612]: time=2026-09-22T10:57:54.916Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 163.651641] niks3-server[1201]: 2026/09/22 10:57:55 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 163.660394] niks3-server[1201]: 2026/09/22 10:57:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 163.665251] niks3-server[1201]: 2026/09/22 10:57:55 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 163.671247] niks3-server[1201]: 2026/09/22 10:57:55 INFO Signed narinfos id=52 count=1 worker2 # [ 163.670657] nix-grpc-daemon[1612]: time=2026-09-22T10:57:54.969Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.677769] niks3-server[1201]: 2026/09/22 10:57:55 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 163.684766] niks3-server[1201]: 2026/09/22 10:57:55 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 163.694990] niks3-server[1201]: 2026/09/22 10:57:55 INFO Completed upload id=52 worker2 # [ 163.691775] nix-grpc-daemon[1612]: time=2026-09-22T10:57:54.991Z level=INFO msg="Upload complete. (260ms)" lb # [ 163.701671] niks3-server[1201]: 2026/09/22 10:57:55 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker1 # [ 163.702950] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:55Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 163.699148] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker1 # [ 163.704738] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:55Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 163.712751] nix-daemon[873]: reaped child process 1733, status = succeeded worker2 # [ 163.746124] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 163.757152] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 163.770102] nix-grpc-daemon[1612]: time=2026-09-22T10:57:55.069Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 163.777978] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 163.792167] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 163.965543] nix-daemon[873]: accepted connection from pid 1758, user nix-grpc-daemon (trusted) worker2 # [ 163.978811] nix-daemon[873]: reaped child process 1761, status = succeeded worker2 # [ 164.120713] nix-daemon[873]: accepted connection from pid 1763, user nix-grpc-daemon (trusted) worker2 # [ 164.133534] nix-daemon[873]: reaped child process 1766, status = succeeded lb # [ 164.148841] niks3-server[1201]: 2026/09/22 10:57:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 164.154047] nix-grpc-daemon[1612]: time=2026-09-22T10:57:55.453Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 164.155375] nix-grpc-daemon[1612]: time=2026-09-22T10:57:55.453Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 164.179551] niks3-server[1201]: 2026/09/22 10:57:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker2 # [ 164.182281] nix-grpc-daemon[1612]: time=2026-09-22T10:57:55.481Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.186078] niks3-server[1201]: 2026/09/22 10:57:56 INFO Signed narinfos id=53 count=1 lb # [ 164.191675] niks3-server[1201]: 2026/09/22 10:57:56 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 164.198603] niks3-server[1201]: 2026/09/22 10:57:56 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 164.209645] niks3-server[1201]: 2026/09/22 10:57:56 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 164.214580] niks3-server[1201]: 2026/09/22 10:57:56 INFO Completed upload id=53 worker2 # [ 164.210914] nix-grpc-daemon[1612]: time=2026-09-22T10:57:55.510Z level=INFO msg="Upload complete. (406ms)" worker2 # [ 164.213050] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 164.216109] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 lb # [ 164.220127] niks3-server[1201]: 2026/09/22 10:57:56 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 164.222541] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 164.225708] nix-daemon[873]: reaped child process 1756, status = succeeded client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 164.232117] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 165.644729] nix-daemon[873]: reaped child process 1770, status = succeeded worker2 # [ 165.784341] nix-daemon[873]: accepted connection from pid 1786, user nix-grpc-daemon (trusted) worker2 # [ 165.794862] nix-daemon[873]: reaped child process 1789, status = succeeded lb # [ 165.817430] niks3-server[1201]: 2026/09/22 10:57:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 165.822050] nix-grpc-daemon[1612]: time=2026-09-22T10:57:57.121Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 165.823538] nix-grpc-daemon[1612]: time=2026-09-22T10:57:57.122Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 165.854967] niks3-server[1201]: 2026/09/22 10:57:57 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 165.860230] niks3-server[1201]: 2026/09/22 10:57:57 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 165.874075] niks3-server[1201]: 2026/09/22 10:57:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 165.878347] niks3-server[1201]: 2026/09/22 10:57:57 INFO Signed narinfos id=54 count=1 worker2 # [ 165.878130] nix-grpc-daemon[1612]: time=2026-09-22T10:57:57.177Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.883938] niks3-server[1201]: 2026/09/22 10:57:57 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 165.894073] niks3-server[1201]: 2026/09/22 10:57:57 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker2 # [ 165.896705] nix-grpc-daemon[1612]: time=2026-09-22T10:57:57.196Z level=INFO msg="Upload complete. (258ms)" lb # [ 165.900343] niks3-server[1201]: 2026/09/22 10:57:57 INFO Completed upload id=54 worker2 # [ 165.899423] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 lb # [ 165.903910] niks3-server[1201]: 2026/09/22 10:57:57 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 165.906069] nix-daemon[873]: reaped child process 1768, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.71 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath lb # [ 166.051286] envoy[910]: conn peer=[2001:db8:1::1]:40532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9611 tx=4090 ms=6491 client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.19 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 166.375917] nix-daemon[853]: reaped child process 1796, status = succeeded worker1 # [ 166.515924] nix-daemon[853]: accepted connection from pid 1839, user nix-grpc-daemon (trusted) worker1 # [ 166.527967] nix-daemon[853]: reaped child process 1842, status = succeeded lb # [ 166.546506] niks3-server[1201]: 2026/09/22 10:57:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.547208] nix-grpc-daemon[1728]: time=2026-09-22T10:57:58.664Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.548669] nix-grpc-daemon[1728]: time=2026-09-22T10:57:58.666Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 166.564721] niks3-server[1201]: 2026/09/22 10:57:58 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 166.569053] niks3-server[1201]: 2026/09/22 10:57:58 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 166.571270] niks3-server[1201]: 2026/09/22 10:57:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 166.571562] nix-grpc-daemon[1728]: time=2026-09-22T10:57:58.688Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.574480] niks3-server[1201]: 2026/09/22 10:57:58 INFO Signed narinfos id=55 count=1 lb # [ 166.580541] niks3-server[1201]: 2026/09/22 10:57:58 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 166.585869] niks3-server[1201]: 2026/09/22 10:57:58 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 166.588649] niks3-server[1201]: 2026/09/22 10:57:58 INFO Completed upload id=55 worker1 # [ 166.585969] nix-grpc-daemon[1728]: time=2026-09-22T10:57:58.703Z level=INFO msg="Upload complete. (225ms)" lb # [ 166.590510] niks3-server[1201]: 2026/09/22 10:57:58 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 166.589312] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49704 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 166.595947] nix-daemon[853]: reaped child process 1794, status = succeeded client # [ 166.627120] systemd[1]: sw.service: Deactivated successfully. client # [ 166.628712] systemd[1]: sw.service: Consumed 110ms CPU time over 9.908s wall clock time, 43.4M memory peak, 7.2K incoming IP traffic, 8.2K outgoing IP traffic. worker1 # [ 167.092747] nix-grpc-daemon[1645]: ts=2026-09-22T10:57:59Z level=info event=signal_exit lb # [ 167.105709] niks3-server[1201]: 2026/09/22 10:57:59 INFO lead: released remote=192.168.1.3:49206 client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 168.102056] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:59Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 168.101381] nix-grpc-daemon[1645]: ts=2026-09-22T10:58:00Z level=info event=scheduler_restarting worker1 # [ 168.107175] nix-grpc-daemon[1645]: ts=2026-09-22T10:58:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49696 worker1 # [ 168.108816] nix-grpc-daemon[1645]: ts=2026-09-22T10:58:00Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 168.110180] nix-grpc-daemon[1645]: ts=2026-09-22T10:58:00Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 168.111458] nix-grpc-daemon[1645]: ts=2026-09-22T10:58:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49696 worker1 # [ 168.112905] nix-grpc-daemon[1645]: ts=2026-09-22T10:58:00Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 168.121139] nix-daemon[853]: reaped child process 1699, status = succeeded worker2 # [ 168.302506] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 168.306555] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 168.315674] nix-grpc-daemon[1645]: ts=2026-09-22T10:58:00Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 168.419940] nix-grpc-daemon[1645]: E0000 00:00:1790074680.537183 1690 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker1 # [ 168.424338] nix-grpc-daemon[1645]: E0000 00:00:1790074680.537299 1690 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 168.507073] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 168.509075] nix-grpc-daemon[1464]: ts=2026-09-22T10:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 168.709754] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 168.711492] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 168.912236] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 168.913950] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 169.115137] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 169.116776] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 169.118555] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 169.120227] systemd[1]: nix-grpc-daemon.service: Consumed 626ms CPU time over 22.417s wall clock time, 33.4M memory peak, 25.2K incoming IP traffic, 32K outgoing IP traffic. worker1 # [ 169.129910] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 169.186223] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_take_over lb # [ 169.190561] niks3-server[1201]: 2026/09/22 10:58:01 INFO lead: acquired remote=192.168.1.4:45030 worker1 # [ 169.282452] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 169.284850] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 169.288703] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 169.296066] nix-grpc-daemon[1856]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 169.298185] nix-grpc-daemon[1856]: E0000 00:00:1790074681.412902 1856 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 169.303512] nix-grpc-daemon[1856]: E0000 00:00:1790074681.418069 1856 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 169.308338] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 169.310728] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 169.314518] nix-grpc-daemon[1856]: E0000 00:00:1790074681.432040 1898 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 169.317457] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 169.319229] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 169.329322] nix-grpc-daemon[1856]: E0000 00:00:1790074681.445564 1898 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 169.332139] nix-grpc-daemon[1856]: E0000 00:00:1790074681.445954 1898 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.05 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 169.342959] nix-grpc-daemon[1856]: E0000 00:00:1790074681.460420 1898 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 169.353960] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 169.355558] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 169.519968] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 169.528598] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 169.530223] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60130 worker2 # [ 169.532165] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 169.556279] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 169.557451] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60130 worker2 # [ 169.559151] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.12 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.89 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 170.748250] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48074 worker1 # [ 170.755767] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 170.761435] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 170.770079] nix-grpc-daemon[1856]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) worker1 # [ 170.824654] nix-grpc-daemon[1856]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 198 ms (attempt 2/5) worker1 # [ 171.025335] nix-grpc-daemon[1856]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 3/5) worker1 # [ 171.132103] nix-grpc-daemon[1856]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 484 ms (attempt 4/5) worker1 # [ 171.619368] nix-grpc-daemon[1856]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 171.623488] nix-grpc-daemon[1856]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 171.670742] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:02Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 171.675150] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:02Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 171.679518] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:02Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 171.683369] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:02Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 171.714895] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 171.724213] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 171.731707] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 171.737077] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 171.754222] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:03Z level=info event=niks3_push_started pid=1916 worker1 # [ 171.916940] nix-grpc-daemon[1916]: time=2026-09-22T10:58:04.033Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 172.071474] nix-daemon[853]: accepted connection from pid 1929, user nix-grpc-daemon (trusted) worker1 # [ 172.084145] nix-daemon[853]: reaped child process 1932, status = succeeded worker1 # [ 172.259959] nix-daemon[853]: accepted connection from pid 1934, user nix-grpc-daemon (trusted) worker1 # [ 172.273780] nix-daemon[853]: reaped child process 1937, status = succeeded lb # [ 172.293670] niks3-server[1201]: 2026/09/22 10:58:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.294609] nix-grpc-daemon[1916]: time=2026-09-22T10:58:04.412Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.298180] nix-grpc-daemon[1916]: time=2026-09-22T10:58:04.413Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 172.315709] niks3-server[1201]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 172.318343] niks3-server[1201]: 2026/09/22 10:58:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 172.320584] niks3-server[1201]: 2026/09/22 10:58:04 INFO Signed narinfos id=56 count=1 worker1 # [ 172.318186] nix-grpc-daemon[1916]: time=2026-09-22T10:58:04.435Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.326668] niks3-server[1201]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 172.328436] niks3-server[1201]: 2026/09/22 10:58:04 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 172.333472] niks3-server[1201]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo lb # [ 172.336505] niks3-server[1201]: 2026/09/22 10:58:04 INFO Completed upload id=56 worker1 # [ 172.332667] nix-grpc-daemon[1916]: time=2026-09-22T10:58:04.450Z level=INFO msg="Upload complete. (412ms)" worker1 # [ 172.335099] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 172.338029] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 172.345198] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 172.350281] nix-daemon[853]: reaped child process 1914, status = succeeded worker1 # [ 172.355343] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 173.771138] nix-daemon[853]: reaped child process 1941, status = succeeded worker1 # [ 173.906818] nix-daemon[853]: accepted connection from pid 1957, user nix-grpc-daemon (trusted) worker1 # [ 173.918928] nix-daemon[853]: reaped child process 1960, status = succeeded lb # [ 173.933602] niks3-server[1201]: 2026/09/22 10:58:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 173.934327] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.051Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 173.936521] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.053Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 173.954284] niks3-server[1201]: 2026/09/22 10:58:05 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 173.958581] niks3-server[1201]: 2026/09/22 10:58:05 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 173.961987] niks3-server[1201]: 2026/09/22 10:58:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 173.963670] niks3-server[1201]: 2026/09/22 10:58:05 INFO Signed narinfos id=57 count=1 worker1 # [ 173.960598] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.077Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.967952] niks3-server[1201]: 2026/09/22 10:58:05 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 173.971766] niks3-server[1201]: 2026/09/22 10:58:05 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 173.974862] niks3-server[1201]: 2026/09/22 10:58:05 INFO Completed upload id=57 worker1 # [ 173.970794] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.088Z level=INFO msg="Upload complete. (208ms)" lb # [ 173.977598] niks3-server[1201]: 2026/09/22 10:58:05 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 173.973260] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker2 # [ 173.975210] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:05Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 173.980480] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:05Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 173.980470] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 173.983040] nix-daemon[853]: reaped child process 1939, status = succeeded worker1 # [ 173.987487] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 173.992553] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 173.996256] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 174.121846] nix-daemon[853]: accepted connection from pid 1964, user nix-grpc-daemon (trusted) worker1 # [ 174.133833] nix-daemon[853]: reaped child process 1967, status = succeeded worker1 # [ 174.268497] nix-daemon[853]: accepted connection from pid 1969, user nix-grpc-daemon (trusted) worker1 # [ 174.280936] nix-daemon[853]: reaped child process 1972, status = succeeded lb # [ 174.293133] niks3-server[1201]: 2026/09/22 10:58:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.295300] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.412Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 174.296714] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.412Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 174.315984] niks3-server[1201]: 2026/09/22 10:58:06 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 174.326267] niks3-server[1201]: 2026/09/22 10:58:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 174.329774] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.447Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.333287] niks3-server[1201]: 2026/09/22 10:58:06 INFO Signed narinfos id=58 count=1 lb # [ 174.338147] niks3-server[1201]: 2026/09/22 10:58:06 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 174.349978] niks3-server[1201]: 2026/09/22 10:58:06 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 174.353116] nix-grpc-daemon[1916]: time=2026-09-22T10:58:06.470Z level=INFO msg="Upload complete. (351ms)" lb # [ 174.356953] niks3-server[1201]: 2026/09/22 10:58:06 INFO Completed upload id=58 worker1 # [ 174.356091] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 174.360060] niks3-server[1201]: 2026/09/22 10:58:06 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 174.360401] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 174.365164] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 174.367464] nix-daemon[853]: reaped child process 1962, status = succeeded worker1 # [ 174.372767] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 175.387314] nix-daemon[853]: reaped child process 1976, status = succeeded worker1 # [ 175.529515] nix-daemon[853]: accepted connection from pid 1992, user nix-grpc-daemon (trusted) worker1 # [ 175.541724] nix-daemon[853]: reaped child process 1995, status = succeeded lb # [ 175.561704] niks3-server[1201]: 2026/09/22 10:58:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 175.566288] nix-grpc-daemon[1916]: time=2026-09-22T10:58:07.683Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 175.568501] nix-grpc-daemon[1916]: time=2026-09-22T10:58:07.685Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 175.596589] niks3-server[1201]: 2026/09/22 10:58:07 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 175.605744] niks3-server[1201]: 2026/09/22 10:58:07 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 175.612477] niks3-server[1201]: 2026/09/22 10:58:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 175.619120] niks3-server[1201]: 2026/09/22 10:58:07 INFO Signed narinfos id=59 count=1 worker1 # [ 175.618368] nix-grpc-daemon[1916]: time=2026-09-22T10:58:07.735Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.625329] niks3-server[1201]: 2026/09/22 10:58:07 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 175.635790] niks3-server[1201]: 2026/09/22 10:58:07 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 175.640861] niks3-server[1201]: 2026/09/22 10:58:07 INFO Completed upload id=59 worker1 # [ 175.638635] nix-grpc-daemon[1916]: time=2026-09-22T10:58:07.756Z level=INFO msg="Upload complete. (259ms)" lb # [ 175.642835] niks3-server[1201]: 2026/09/22 10:58:07 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker2 # [ 175.642804] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:06Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 175.642357] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker1 # [ 175.645444] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker2 # [ 175.648389] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:06Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 175.651668] nix-daemon[853]: reaped child process 1974, status = succeeded worker1 # [ 175.653404] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 175.658739] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 175.662510] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 175.798197] nix-daemon[853]: accepted connection from pid 1999, user nix-grpc-daemon (trusted) worker1 # [ 175.810117] nix-daemon[853]: reaped child process 2002, status = succeeded worker1 # [ 175.972853] nix-daemon[853]: accepted connection from pid 2004, user nix-grpc-daemon (trusted) worker1 # [ 175.984671] nix-daemon[853]: reaped child process 2007, status = succeeded lb # [ 176.003633] niks3-server[1201]: 2026/09/22 10:58:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.003881] nix-grpc-daemon[1916]: time=2026-09-22T10:58:08.121Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 176.005450] nix-grpc-daemon[1916]: time=2026-09-22T10:58:08.122Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 176.019186] niks3-server[1201]: 2026/09/22 10:58:08 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 176.023476] niks3-server[1201]: 2026/09/22 10:58:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 176.025358] niks3-server[1201]: 2026/09/22 10:58:08 INFO Signed narinfos id=60 count=1 worker1 # [ 176.022703] nix-grpc-daemon[1916]: time=2026-09-22T10:58:08.140Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.027824] niks3-server[1201]: 2026/09/22 10:58:08 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 176.033392] niks3-server[1201]: 2026/09/22 10:58:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 176.035893] niks3-server[1201]: 2026/09/22 10:58:08 INFO Completed upload id=60 worker1 # [ 176.031993] nix-grpc-daemon[1916]: time=2026-09-22T10:58:08.149Z level=INFO msg="Upload complete. (363ms)" worker1 # [ 176.033879] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 176.038383] niks3-server[1201]: 2026/09/22 10:58:08 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 176.036800] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 176.043398] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 176.046368] nix-daemon[853]: reaped child process 1997, status = succeeded lb # [ 176.051073] envoy[910]: conn peer=[2001:db8:1::1]:40530 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1429 ms=9693 lb # [ 176.052528] envoy[910]: conn peer=[2001:db8:1::3]:51094 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=958 tx=344 ms=21175 worker1 # [ 176.051218] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 177.265032] nix-daemon[853]: reaped child process 2011, status = succeeded worker1 # [ 177.412025] nix-daemon[853]: accepted connection from pid 2027, user nix-grpc-daemon (trusted) worker1 # [ 177.424290] nix-daemon[853]: reaped child process 2030, status = succeeded lb # [ 177.439815] niks3-server[1201]: 2026/09/22 10:58:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 177.443210] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.560Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 177.444739] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.562Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 177.469802] niks3-server[1201]: 2026/09/22 10:58:09 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 177.475870] niks3-server[1201]: 2026/09/22 10:58:09 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 177.478147] niks3-server[1201]: 2026/09/22 10:58:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 177.480405] niks3-server[1201]: 2026/09/22 10:58:09 INFO Signed narinfos id=61 count=1 worker1 # [ 177.477906] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.595Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.484527] niks3-server[1201]: 2026/09/22 10:58:09 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 177.488345] niks3-server[1201]: 2026/09/22 10:58:09 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 177.492366] niks3-server[1201]: 2026/09/22 10:58:09 INFO Completed upload id=61 worker1 # [ 177.488397] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.605Z level=INFO msg="Upload complete. (230ms)" lb # [ 177.494046] niks3-server[1201]: 2026/09/22 10:58:09 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 177.491269] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker1 # [ 177.496357] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker2 # [ 177.494979] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:08Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 177.500758] nix-daemon[853]: reaped child process 2009, status = succeeded worker1 # [ 177.504263] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker2 # [ 177.505495] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:08Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 177.510212] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.627Z level=INFO msg="All 1 paths already cached" worker1 # [ 177.513539] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 177.518282] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 177.654953] nix-daemon[853]: accepted connection from pid 2034, user nix-grpc-daemon (trusted) worker1 # [ 177.667321] nix-daemon[853]: reaped child process 2037, status = succeeded worker1 # [ 177.811504] nix-daemon[853]: accepted connection from pid 2039, user nix-grpc-daemon (trusted) worker1 # [ 177.824077] nix-daemon[853]: reaped child process 2042, status = succeeded lb # [ 177.838797] niks3-server[1201]: 2026/09/22 10:58:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 177.842709] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.960Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 177.844230] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.961Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 177.866193] niks3-server[1201]: 2026/09/22 10:58:09 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 177.877334] niks3-server[1201]: 2026/09/22 10:58:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 177.881914] niks3-server[1201]: 2026/09/22 10:58:09 INFO Signed narinfos id=62 count=1 worker1 # [ 177.880861] nix-grpc-daemon[1916]: time=2026-09-22T10:58:09.998Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.890189] niks3-server[1201]: 2026/09/22 10:58:09 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 177.901436] niks3-server[1201]: 2026/09/22 10:58:09 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete worker1 # [ 177.903124] nix-grpc-daemon[1916]: time=2026-09-22T10:58:10.020Z level=INFO msg="Upload complete. (380ms)" lb # [ 177.906979] niks3-server[1201]: 2026/09/22 10:58:09 INFO Completed upload id=62 worker1 # [ 177.905137] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 177.910348] niks3-server[1201]: 2026/09/22 10:58:09 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 177.911428] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 177.915833] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 177.918196] nix-daemon[853]: reaped child process 2032, status = succeeded worker1 # [ 177.924052] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 179.340127] nix-daemon[853]: reaped child process 2046, status = succeeded worker1 # [ 179.489789] nix-daemon[853]: accepted connection from pid 2062, user nix-grpc-daemon (trusted) worker1 # [ 179.500856] nix-daemon[853]: reaped child process 2065, status = succeeded lb # [ 179.524907] niks3-server[1201]: 2026/09/22 10:58:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.531862] nix-grpc-daemon[1916]: time=2026-09-22T10:58:11.649Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 179.533605] nix-grpc-daemon[1916]: time=2026-09-22T10:58:11.650Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 179.569410] niks3-server[1201]: 2026/09/22 10:58:11 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 179.575470] niks3-server[1201]: 2026/09/22 10:58:11 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 179.585534] niks3-server[1201]: 2026/09/22 10:58:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 179.590885] niks3-server[1201]: 2026/09/22 10:58:11 INFO Signed narinfos id=63 count=1 worker1 # [ 179.590255] nix-grpc-daemon[1916]: time=2026-09-22T10:58:11.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.594259] niks3-server[1201]: 2026/09/22 10:58:11 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 179.605719] niks3-server[1201]: 2026/09/22 10:58:11 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 179.611878] niks3-server[1201]: 2026/09/22 10:58:11 INFO Completed upload id=63 lb # [ 179.614764] niks3-server[1201]: 2026/09/22 10:58:11 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 179.610451] nix-grpc-daemon[1916]: time=2026-09-22T10:58:11.727Z level=INFO msg="Upload complete. (278ms)" worker1 # [ 179.615985] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker2 # [ 179.617518] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:10Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 179.630800] nix-daemon[853]: reaped child process 2044, status = succeeded worker2 # [ 179.628915] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:10Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 179.668835] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 179.681220] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 179.694368] nix-grpc-daemon[1916]: time=2026-09-22T10:58:11.811Z level=INFO msg="All 1 paths already cached" worker1 # [ 179.701467] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 179.709657] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 179.889596] nix-daemon[853]: accepted connection from pid 2069, user nix-grpc-daemon (trusted) worker1 # [ 179.901831] nix-daemon[853]: reaped child process 2072, status = succeeded worker1 # [ 180.064477] nix-daemon[853]: accepted connection from pid 2074, user nix-grpc-daemon (trusted) worker1 # [ 180.076394] nix-daemon[853]: reaped child process 2077, status = succeeded lb # [ 180.096091] niks3-server[1201]: 2026/09/22 10:58:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 180.099934] nix-grpc-daemon[1916]: time=2026-09-22T10:58:12.217Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 180.101504] nix-grpc-daemon[1916]: time=2026-09-22T10:58:12.218Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 180.126786] niks3-server[1201]: 2026/09/22 10:58:12 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 180.137172] niks3-server[1201]: 2026/09/22 10:58:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 180.142684] niks3-server[1201]: 2026/09/22 10:58:12 INFO Signed narinfos id=64 count=1 worker1 # [ 180.141915] nix-grpc-daemon[1916]: time=2026-09-22T10:58:12.259Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.151115] niks3-server[1201]: 2026/09/22 10:58:12 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 180.160613] niks3-server[1201]: 2026/09/22 10:58:12 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete worker1 # [ 180.163062] nix-grpc-daemon[1916]: time=2026-09-22T10:58:12.280Z level=INFO msg="Upload complete. (439ms)" lb # [ 180.167193] niks3-server[1201]: 2026/09/22 10:58:12 INFO Completed upload id=64 lb # [ 180.170711] niks3-server[1201]: 2026/09/22 10:58:12 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 180.165840] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 180.170871] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 180.181554] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 180.185152] nix-daemon[853]: reaped child process 2067, status = succeeded worker1 # [ 180.190092] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 181.203765] nix-daemon[853]: reaped child process 2081, status = succeeded worker1 # [ 181.346483] nix-daemon[853]: accepted connection from pid 2097, user nix-grpc-daemon (trusted) worker1 # [ 181.362768] nix-daemon[853]: reaped child process 2100, status = succeeded lb # [ 181.384398] niks3-server[1201]: 2026/09/22 10:58:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 181.389205] nix-grpc-daemon[1916]: time=2026-09-22T10:58:13.506Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 181.394356] nix-grpc-daemon[1916]: time=2026-09-22T10:58:13.508Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 181.421832] niks3-server[1201]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 181.433247] niks3-server[1201]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 181.444149] niks3-server[1201]: 2026/09/22 10:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker1 # [ 181.445902] nix-grpc-daemon[1916]: time=2026-09-22T10:58:13.563Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.449487] niks3-server[1201]: 2026/09/22 10:58:13 INFO Signed narinfos id=65 count=1 lb # [ 181.455407] niks3-server[1201]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 181.464317] niks3-server[1201]: 2026/09/22 10:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 181.470085] niks3-server[1201]: 2026/09/22 10:58:13 INFO Completed upload id=65 worker1 # [ 181.466168] nix-grpc-daemon[1916]: time=2026-09-22T10:58:13.583Z level=INFO msg="Upload complete. (269ms)" lb # [ 181.471615] niks3-server[1201]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 181.468737] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker2 # [ 181.471168] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:12Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 181.476187] nix-daemon[853]: reaped child process 2079, status = succeeded worker2 # [ 181.476866] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:12Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 181.518505] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 181.531324] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 181.544656] nix-grpc-daemon[1916]: time=2026-09-22T10:58:13.662Z level=INFO msg="All 1 paths already cached" worker1 # [ 181.551859] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 181.561167] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 181.723721] nix-daemon[853]: accepted connection from pid 2104, user nix-grpc-daemon (trusted) worker1 # [ 181.735774] nix-daemon[853]: reaped child process 2107, status = succeeded worker1 # [ 181.889300] nix-daemon[853]: accepted connection from pid 2109, user nix-grpc-daemon (trusted) worker1 # [ 181.900974] nix-daemon[853]: reaped child process 2112, status = succeeded lb # [ 181.921809] niks3-server[1201]: 2026/09/22 10:58:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 181.926071] nix-grpc-daemon[1916]: time=2026-09-22T10:58:14.043Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 181.927500] nix-grpc-daemon[1916]: time=2026-09-22T10:58:14.043Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 181.951785] niks3-server[1201]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 181.961913] niks3-server[1201]: 2026/09/22 10:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 181.967236] niks3-server[1201]: 2026/09/22 10:58:13 INFO Signed narinfos id=66 count=1 worker1 # [ 181.966383] nix-grpc-daemon[1916]: time=2026-09-22T10:58:14.083Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.974063] niks3-server[1201]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 181.984765] niks3-server[1201]: 2026/09/22 10:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker1 # [ 181.987691] nix-grpc-daemon[1916]: time=2026-09-22T10:58:14.105Z level=INFO msg="Upload complete. (414ms)" lb # [ 181.991560] niks3-server[1201]: 2026/09/22 10:58:13 INFO Completed upload id=66 worker1 # [ 181.990078] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 181.994846] niks3-server[1201]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 181.995297] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 182.004479] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 182.006969] nix-daemon[853]: reaped child process 2102, status = succeeded worker1 # [ 182.011866] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 183.425100] nix-daemon[853]: reaped child process 2116, status = succeeded worker1 # [ 183.545271] nix-daemon[853]: accepted connection from pid 2132, user nix-grpc-daemon (trusted) worker1 # [ 183.557215] nix-daemon[853]: reaped child process 2135, status = succeeded lb # [ 183.574960] niks3-server[1201]: 2026/09/22 10:58:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 183.577258] nix-grpc-daemon[1916]: time=2026-09-22T10:58:15.694Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 183.578704] nix-grpc-daemon[1916]: time=2026-09-22T10:58:15.696Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 183.613399] niks3-server[1201]: 2026/09/22 10:58:15 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 183.619875] niks3-server[1201]: 2026/09/22 10:58:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker1 # [ 183.625487] nix-grpc-daemon[1916]: time=2026-09-22T10:58:15.742Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.629179] niks3-server[1201]: 2026/09/22 10:58:15 INFO Signed narinfos id=67 count=1 lb # [ 183.638342] niks3-server[1201]: 2026/09/22 10:58:15 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 183.651627] niks3-server[1201]: 2026/09/22 10:58:15 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 183.655839] niks3-server[1201]: 2026/09/22 10:58:15 INFO Completed upload id=67 worker1 # [ 183.651518] nix-grpc-daemon[1916]: time=2026-09-22T10:58:15.768Z level=INFO msg="Upload complete. (233ms)" lb # [ 183.658334] niks3-server[1201]: 2026/09/22 10:58:15 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 183.656834] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker2 # [ 183.662948] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:14Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 183.670323] nix-daemon[853]: reaped child process 2114, status = succeeded worker2 # [ 183.668611] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:14Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 183.705238] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 183.717906] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 183.730885] nix-grpc-daemon[1916]: time=2026-09-22T10:58:15.848Z level=INFO msg="All 2 paths already cached" worker1 # [ 183.737792] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 183.745776] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 183.887859] nix-daemon[853]: accepted connection from pid 2139, user nix-grpc-daemon (trusted) worker1 # [ 183.899968] nix-daemon[853]: reaped child process 2142, status = succeeded worker1 # [ 184.034128] nix-daemon[853]: accepted connection from pid 2144, user nix-grpc-daemon (trusted) worker1 # [ 184.045853] nix-daemon[853]: reaped child process 2147, status = succeeded lb # [ 184.061346] niks3-server[1201]: 2026/09/22 10:58:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 184.065735] nix-grpc-daemon[1916]: time=2026-09-22T10:58:16.183Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 184.067553] nix-grpc-daemon[1916]: time=2026-09-22T10:58:16.184Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 184.089793] niks3-server[1201]: 2026/09/22 10:58:16 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 184.100677] niks3-server[1201]: 2026/09/22 10:58:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 184.105855] niks3-server[1201]: 2026/09/22 10:58:16 INFO Signed narinfos id=68 count=1 worker1 # [ 184.104899] nix-grpc-daemon[1916]: time=2026-09-22T10:58:16.222Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.112942] niks3-server[1201]: 2026/09/22 10:58:16 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 184.123051] niks3-server[1201]: 2026/09/22 10:58:16 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker1 # [ 184.126159] nix-grpc-daemon[1916]: time=2026-09-22T10:58:16.243Z level=INFO msg="Upload complete. (367ms)" lb # [ 184.130120] niks3-server[1201]: 2026/09/22 10:58:16 INFO Completed upload id=68 worker1 # [ 184.128382] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 184.132195] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 lb # [ 184.138790] niks3-server[1201]: 2026/09/22 10:58:16 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 184.141073] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 184.145783] nix-daemon[853]: reaped child process 2137, status = succeeded worker1 # [ 184.150756] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 185.564359] nix-daemon[853]: reaped child process 2151, status = succeeded worker1 # [ 185.704564] nix-daemon[853]: accepted connection from pid 2167, user nix-grpc-daemon (trusted) worker1 # [ 185.716815] nix-daemon[853]: reaped child process 2170, status = succeeded lb # [ 185.734823] niks3-server[1201]: 2026/09/22 10:58:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 185.738790] nix-grpc-daemon[1916]: time=2026-09-22T10:58:17.856Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 185.740283] nix-grpc-daemon[1916]: time=2026-09-22T10:58:17.857Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 185.762474] niks3-server[1201]: 2026/09/22 10:58:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 185.764534] niks3-server[1201]: 2026/09/22 10:58:17 INFO Signed narinfos id=69 count=1 worker1 # [ 185.760489] nix-grpc-daemon[1916]: time=2026-09-22T10:58:17.878Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.769048] niks3-server[1201]: 2026/09/22 10:58:17 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 185.771464] niks3-server[1201]: 2026/09/22 10:58:17 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 185.774664] niks3-server[1201]: 2026/09/22 10:58:17 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 185.778991] niks3-server[1201]: 2026/09/22 10:58:17 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 185.781912] niks3-server[1201]: 2026/09/22 10:58:17 INFO Completed upload id=69 worker1 # [ 185.778093] nix-grpc-daemon[1916]: time=2026-09-22T10:58:17.895Z level=INFO msg="Upload complete. (218ms)" lb # [ 185.784654] niks3-server[1201]: 2026/09/22 10:58:17 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 185.780464] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 worker2 # [ 185.783910] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:17Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 185.787545] nix-daemon[853]: reaped child process 2149, status = succeeded worker1 # [ 185.827529] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 185.837740] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 185.849054] nix-grpc-daemon[1916]: time=2026-09-22T10:58:17.966Z level=INFO msg="All 2 paths already cached" worker1 # [ 185.855100] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 185.861848] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 185.998622] nix-daemon[853]: accepted connection from pid 2174, user nix-grpc-daemon (trusted) worker1 # [ 186.010876] nix-daemon[853]: reaped child process 2177, status = succeeded worker1 # [ 186.142522] nix-daemon[853]: accepted connection from pid 2179, user nix-grpc-daemon (trusted) worker1 # [ 186.155709] nix-daemon[853]: reaped child process 2182, status = succeeded lb # [ 186.168462] niks3-server[1201]: 2026/09/22 10:58:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 186.170242] nix-grpc-daemon[1916]: time=2026-09-22T10:58:18.287Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 186.171668] nix-grpc-daemon[1916]: time=2026-09-22T10:58:18.287Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 186.184055] niks3-server[1201]: 2026/09/22 10:58:18 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 186.187207] niks3-server[1201]: 2026/09/22 10:58:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 186.190280] niks3-server[1201]: 2026/09/22 10:58:18 INFO Signed narinfos id=70 count=1 worker1 # [ 186.186589] nix-grpc-daemon[1916]: time=2026-09-22T10:58:18.303Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.193694] niks3-server[1201]: 2026/09/22 10:58:18 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 186.198026] niks3-server[1201]: 2026/09/22 10:58:18 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 186.202821] niks3-server[1201]: 2026/09/22 10:58:18 INFO Completed upload id=70 worker1 # [ 186.198918] nix-grpc-daemon[1916]: time=2026-09-22T10:58:18.316Z level=INFO msg="Upload complete. (325ms)" worker1 # [ 186.200748] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 186.206922] niks3-server[1201]: 2026/09/22 10:58:18 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 186.203390] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 186.211169] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 186.212927] nix-daemon[853]: reaped child process 2172, status = succeeded worker1 # [ 186.218088] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 187.445749] nix-daemon[853]: reaped child process 2186, status = succeeded worker1 # [ 187.607364] nix-daemon[853]: accepted connection from pid 2202, user nix-grpc-daemon (trusted) worker1 # [ 187.618429] nix-daemon[853]: reaped child process 2205, status = succeeded lb # [ 187.634056] niks3-server[1201]: 2026/09/22 10:58:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 187.635238] nix-grpc-daemon[1916]: time=2026-09-22T10:58:19.752Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 187.636714] nix-grpc-daemon[1916]: time=2026-09-22T10:58:19.754Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 187.655096] niks3-server[1201]: 2026/09/22 10:58:19 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 187.658199] niks3-server[1201]: 2026/09/22 10:58:19 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 187.662640] niks3-server[1201]: 2026/09/22 10:58:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 187.665039] niks3-server[1201]: 2026/09/22 10:58:19 INFO Signed narinfos id=71 count=1 worker1 # [ 187.661313] nix-grpc-daemon[1916]: time=2026-09-22T10:58:19.778Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.668115] niks3-server[1201]: 2026/09/22 10:58:19 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 187.673097] niks3-server[1201]: 2026/09/22 10:58:19 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 187.677876] niks3-server[1201]: 2026/09/22 10:58:19 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo lb # [ 187.680229] niks3-server[1201]: 2026/09/22 10:58:19 INFO Completed upload id=71 worker1 # [ 187.676335] nix-grpc-daemon[1916]: time=2026-09-22T10:58:19.793Z level=INFO msg="Upload complete. (250ms)" worker1 # [ 187.678749] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker2 # [ 187.682334] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:18Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 187.685726] nix-daemon[853]: reaped child process 2184, status = succeeded worker1 # [ 187.725585] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 187.735973] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 187.747446] nix-grpc-daemon[1916]: time=2026-09-22T10:58:19.864Z level=INFO msg="All 2 paths already cached" worker1 # [ 187.753566] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 187.763133] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 187.923758] nix-daemon[853]: accepted connection from pid 2209, user nix-grpc-daemon (trusted) worker1 # [ 187.935884] nix-daemon[853]: reaped child process 2212, status = succeeded worker1 # [ 188.098827] nix-daemon[853]: accepted connection from pid 2214, user nix-grpc-daemon (trusted) worker1 # [ 188.110805] nix-daemon[853]: reaped child process 2217, status = succeeded lb # [ 188.124546] niks3-server[1201]: 2026/09/22 10:58:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 188.125212] nix-grpc-daemon[1916]: time=2026-09-22T10:58:20.242Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 188.126656] nix-grpc-daemon[1916]: time=2026-09-22T10:58:20.244Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 188.141303] niks3-server[1201]: 2026/09/22 10:58:20 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 188.144359] niks3-server[1201]: 2026/09/22 10:58:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 188.146073] niks3-server[1201]: 2026/09/22 10:58:20 INFO Signed narinfos id=72 count=1 worker1 # [ 188.142224] nix-grpc-daemon[1916]: time=2026-09-22T10:58:20.259Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.150559] niks3-server[1201]: 2026/09/22 10:58:20 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 188.155552] niks3-server[1201]: 2026/09/22 10:58:20 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 188.158742] niks3-server[1201]: 2026/09/22 10:58:20 INFO Completed upload id=72 worker1 # [ 188.156021] nix-grpc-daemon[1916]: time=2026-09-22T10:58:20.273Z level=INFO msg="Upload complete. (383ms)" lb # [ 188.160453] niks3-server[1201]: 2026/09/22 10:58:20 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 188.157724] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 188.161153] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 worker1 # [ 188.165473] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 188.169641] nix-daemon[853]: reaped child process 2207, status = succeeded worker1 # [ 188.174559] nix-daemon[853]: accepted connection from pid 1856, user nix-grpc-daemon (trusted) worker1 # [ 189.202361] nix-daemon[853]: reaped child process 2221, status = succeeded worker1 # [ 189.353897] nix-daemon[853]: accepted connection from pid 2237, user nix-grpc-daemon (trusted) worker1 # [ 189.366188] nix-daemon[853]: reaped child process 2240, status = succeeded lb # [ 189.385975] niks3-server[1201]: 2026/09/22 10:58:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 189.391189] nix-grpc-daemon[1916]: time=2026-09-22T10:58:21.508Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 189.392753] nix-grpc-daemon[1916]: time=2026-09-22T10:58:21.510Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 189.422105] niks3-server[1201]: 2026/09/22 10:58:21 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 189.435133] niks3-server[1201]: 2026/09/22 10:58:21 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 189.444291] niks3-server[1201]: 2026/09/22 10:58:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 189.449653] niks3-server[1201]: 2026/09/22 10:58:21 INFO Signed narinfos id=73 count=1 worker1 # [ 189.448554] nix-grpc-daemon[1916]: time=2026-09-22T10:58:21.565Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.455339] niks3-server[1201]: 2026/09/22 10:58:21 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 189.464682] niks3-server[1201]: 2026/09/22 10:58:21 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 189.470235] niks3-server[1201]: 2026/09/22 10:58:21 INFO Completed upload id=73 worker1 # [ 189.466441] nix-grpc-daemon[1916]: time=2026-09-22T10:58:21.583Z level=INFO msg="Upload complete. (284ms)" lb # [ 189.471877] niks3-server[1201]: 2026/09/22 10:58:21 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 189.472330] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60404 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 worker1 # [ 189.484573] nix-daemon[853]: reaped child process 2219, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.99 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 189.655765] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 74001008cd4843e588ba89f2fc40b786 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 189.830491] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48074 client # [ 189.847948] nix[1466]: don't know how to build these paths: client # [ 189.849365] nix[1466]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 189.838343] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60404 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 189.856500] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:21Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 189.869877] nix[1466]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 196.052118] envoy[910]: conn peer=[2001:db8:1::1]:45168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27128 tx=11392 ms=18778 client # [ 219.871908] nix[1466]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 219.877949] nix[1466]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 219.901651] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 219.903077] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 219.904943] systemd[1]: gpu.service: Consumed 134ms CPU time over 30.248s wall clock time, 37.4M memory peak, 5K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.57 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.25 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.97 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 222.319822] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:54Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2 worker1 # [ 223.106155] nix-grpc-daemon[1856]: ts=2026-09-22T10:58:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60404 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 223.117957] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 223.138750] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:54Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 223.143188] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:54Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 223.183226] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 223.196221] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 223.208561] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 223.221650] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 223.412541] nix-daemon[873]: accepted connection from pid 1823, user nix-grpc-daemon (trusted) worker2 # [ 223.427171] nix-daemon[873]: reaped child process 1826, status = succeeded worker2 # [ 223.620856] nix-daemon[873]: accepted connection from pid 1828, user nix-grpc-daemon (trusted) worker2 # [ 223.634947] nix-daemon[873]: reaped child process 1831, status = succeeded lb # [ 223.659308] niks3-server[1201]: 2026/09/22 10:58:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 223.664197] nix-grpc-daemon[1612]: time=2026-09-22T10:58:54.963Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 223.666213] nix-grpc-daemon[1612]: time=2026-09-22T10:58:54.965Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 223.688718] niks3-server[1201]: 2026/09/22 10:58:55 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 223.698531] niks3-server[1201]: 2026/09/22 10:58:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 223.705114] niks3-server[1201]: 2026/09/22 10:58:55 INFO Signed narinfos id=74 count=1 worker2 # [ 223.704543] nix-grpc-daemon[1612]: time=2026-09-22T10:58:55.003Z level=INFO msg="Uploading 1 narinfos" lb # [ 223.712347] niks3-server[1201]: 2026/09/22 10:58:55 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 223.723609] niks3-server[1201]: 2026/09/22 10:58:55 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 223.730205] niks3-server[1201]: 2026/09/22 10:58:55 INFO Completed upload id=74 lb # [ 223.732937] niks3-server[1201]: 2026/09/22 10:58:55 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 223.728691] nix-grpc-daemon[1612]: time=2026-09-22T10:58:55.028Z level=INFO msg="Upload complete. (494ms)" worker2 # [ 223.732912] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 223.738302] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 223.751039] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 223.755184] nix-daemon[873]: reaped child process 1821, status = succeeded client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker2 # [ 223.760501] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 224.790519] nix-daemon[873]: reaped child process 1835, status = succeeded worker2 # [ 224.968198] nix-daemon[873]: accepted connection from pid 1851, user nix-grpc-daemon (trusted) worker2 # [ 224.983469] nix-daemon[873]: reaped child process 1854, status = succeeded lb # [ 225.004847] niks3-server[1201]: 2026/09/22 10:58:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 225.010037] nix-grpc-daemon[1612]: time=2026-09-22T10:58:56.309Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 225.011668] nix-grpc-daemon[1612]: time=2026-09-22T10:58:56.311Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 225.053614] niks3-server[1201]: 2026/09/22 10:58:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker2 # [ 225.055440] nix-grpc-daemon[1612]: time=2026-09-22T10:58:56.354Z level=INFO msg="Uploading 1 narinfos" lb # [ 225.059275] niks3-server[1201]: 2026/09/22 10:58:57 INFO Signed narinfos id=75 count=1 lb # [ 225.071537] niks3-server[1201]: 2026/09/22 10:58:57 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 225.129256] niks3-server[1201]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 225.142576] niks3-server[1201]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 225.152316] niks3-server[1201]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 225.159113] niks3-server[1201]: 2026/09/22 10:58:57 INFO Completed upload id=75 worker2 # [ 225.155550] nix-grpc-daemon[1612]: time=2026-09-22T10:58:56.454Z level=INFO msg="Upload complete. (387ms)" lb # [ 225.162127] niks3-server[1201]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 225.162846] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker2 # [ 225.178995] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:56Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 225.183905] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:56Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 225.192970] nix-daemon[873]: reaped child process 1833, status = succeeded worker2 # [ 225.223548] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 225.236602] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 225.250193] nix-grpc-daemon[1612]: time=2026-09-22T10:58:56.549Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 225.258320] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 225.266734] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 225.450686] nix-daemon[873]: accepted connection from pid 1860, user nix-grpc-daemon (trusted) worker2 # [ 225.468773] nix-daemon[873]: reaped child process 1863, status = succeeded worker2 # [ 225.647840] nix-daemon[873]: accepted connection from pid 1865, user nix-grpc-daemon (trusted) worker2 # [ 225.662593] nix-daemon[873]: reaped child process 1868, status = succeeded lb # [ 225.683074] niks3-server[1201]: 2026/09/22 10:58:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 225.706430] nix-grpc-daemon[1612]: time=2026-09-22T10:58:57.005Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 225.707843] nix-grpc-daemon[1612]: time=2026-09-22T10:58:57.005Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 225.726582] niks3-server[1201]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 225.737905] niks3-server[1201]: 2026/09/22 10:58:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign lb # [ 225.743367] niks3-server[1201]: 2026/09/22 10:58:57 INFO Signed narinfos id=76 count=1 worker2 # [ 225.742842] nix-grpc-daemon[1612]: time=2026-09-22T10:58:57.042Z level=INFO msg="Uploading 1 narinfos" lb # [ 225.749919] niks3-server[1201]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 225.762831] niks3-server[1201]: 2026/09/22 10:58:57 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete worker2 # [ 225.763382] nix-grpc-daemon[1612]: time=2026-09-22T10:58:57.062Z level=INFO msg="Upload complete. (482ms)" lb # [ 225.767283] niks3-server[1201]: 2026/09/22 10:58:57 INFO Completed upload id=76 worker2 # [ 225.765594] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 225.770940] niks3-server[1201]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 225.771292] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 225.779292] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 225.780647] nix-daemon[873]: reaped child process 1858, status = succeeded worker2 # [ 225.786442] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 226.053325] envoy[910]: conn peer=[2001:db8:1::1]:33774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=30046 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 226.800488] nix-daemon[873]: reaped child process 1872, status = succeeded worker2 # [ 226.951090] nix-daemon[873]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker2 # [ 226.962103] nix-daemon[873]: reaped child process 1891, status = succeeded lb # [ 226.981535] niks3-server[1201]: 2026/09/22 10:58:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 226.986705] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.285Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 226.988919] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.287Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 227.021574] niks3-server[1201]: 2026/09/22 10:58:59 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 227.034726] niks3-server[1201]: 2026/09/22 10:58:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 227.039609] niks3-server[1201]: 2026/09/22 10:58:59 INFO Signed narinfos id=77 count=1 worker2 # [ 227.038967] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.338Z level=INFO msg="Uploading 1 narinfos" lb # [ 227.047535] niks3-server[1201]: 2026/09/22 10:58:59 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 227.053702] niks3-server[1201]: 2026/09/22 10:58:59 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 227.063319] niks3-server[1201]: 2026/09/22 10:58:59 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 227.068911] niks3-server[1201]: 2026/09/22 10:58:59 INFO Completed upload id=77 worker2 # [ 227.065331] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.364Z level=INFO msg="Upload complete. (272ms)" lb # [ 227.070530] niks3-server[1201]: 2026/09/22 10:58:59 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 227.067913] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 worker2 # [ 227.075149] nix-daemon[873]: reaped child process 1870, status = succeeded worker2 # [ 227.115989] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:58Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 227.118069] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:58Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 227.159850] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 227.168925] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 227.178205] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.477Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 227.184287] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 227.190624] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 227.351381] nix-daemon[873]: accepted connection from pid 1897, user nix-grpc-daemon (trusted) worker2 # [ 227.364326] nix-daemon[873]: reaped child process 1900, status = succeeded worker2 # [ 227.515113] nix-daemon[873]: accepted connection from pid 1902, user nix-grpc-daemon (trusted) worker2 # [ 227.527662] nix-daemon[873]: reaped child process 1905, status = succeeded lb # [ 227.547191] niks3-server[1201]: 2026/09/22 10:58:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 227.650500] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.949Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 227.655463] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.953Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 227.683816] niks3-server[1201]: 2026/09/22 10:58:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign worker2 # [ 227.687423] nix-grpc-daemon[1612]: time=2026-09-22T10:58:58.986Z level=INFO msg="Uploading 1 narinfos" lb # [ 227.691991] niks3-server[1201]: 2026/09/22 10:58:59 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 227.697116] niks3-server[1201]: 2026/09/22 10:58:59 INFO Signed narinfos id=78 count=1 lb # [ 227.713505] niks3-server[1201]: 2026/09/22 10:58:59 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete lb # [ 227.719207] niks3-server[1201]: 2026/09/22 10:58:59 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls worker2 # [ 227.723746] nix-grpc-daemon[1612]: time=2026-09-22T10:58:59.023Z level=INFO msg="Upload complete. (527ms)" lb # [ 227.727622] niks3-server[1201]: 2026/09/22 10:58:59 INFO Completed upload id=78 worker2 # [ 227.726224] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 227.730826] niks3-server[1201]: 2026/09/22 10:58:59 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 227.730133] nix-grpc-daemon[1464]: ts=2026-09-22T10:58:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 worker2 # [ 227.735400] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker2 # [ 227.742132] nix-daemon[873]: reaped child process 1895, status = succeeded worker2 # [ 227.746831] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 229.361965] nix-daemon[873]: reaped child process 1909, status = succeeded worker2 # [ 229.502725] nix-daemon[873]: accepted connection from pid 1925, user nix-grpc-daemon (trusted) worker2 # [ 229.515499] nix-daemon[873]: reaped child process 1928, status = succeeded lb # [ 229.536190] niks3-server[1201]: 2026/09/22 10:59:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 229.540487] nix-grpc-daemon[1612]: time=2026-09-22T10:59:00.839Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 229.542216] nix-grpc-daemon[1612]: time=2026-09-22T10:59:00.841Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 229.572533] niks3-server[1201]: 2026/09/22 10:59:01 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 229.586189] niks3-server[1201]: 2026/09/22 10:59:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 229.589805] niks3-server[1201]: 2026/09/22 10:59:01 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 229.596408] niks3-server[1201]: 2026/09/22 10:59:01 INFO Signed narinfos id=79 count=1 worker2 # [ 229.596024] nix-grpc-daemon[1612]: time=2026-09-22T10:59:00.895Z level=INFO msg="Uploading 1 narinfos" lb # [ 229.601313] niks3-server[1201]: 2026/09/22 10:59:01 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 229.611748] niks3-server[1201]: 2026/09/22 10:59:01 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 229.617808] niks3-server[1201]: 2026/09/22 10:59:01 INFO Completed upload id=79 worker2 # [ 229.614386] nix-grpc-daemon[1612]: time=2026-09-22T10:59:00.913Z level=INFO msg="Upload complete. (259ms)" lb # [ 229.620122] niks3-server[1201]: 2026/09/22 10:59:01 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 229.621595] nix-grpc-daemon[1464]: ts=2026-09-22T10:59:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48074 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 worker2 # [ 229.634382] nix-daemon[873]: reaped child process 1907, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.78 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.19 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 230.325555] nix-grpc-daemon[1856]: ts=2026-09-22T10:59:02Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.33 seconds) (finished: run the VM test script, in 232.00 seconds) test script finished in 232.22s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.00 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh